Aug 01 15:15:50 user nova-compute[72201]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 01 15:15:52 user nova-compute[72201]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72201) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 15:15:52 user nova-compute[72201]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72201) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 15:15:52 user nova-compute[72201]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72201) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 15:15:52 user nova-compute[72201]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:15:53 user nova-compute[72201]: INFO nova.virt.driver [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 01 15:15:53 user nova-compute[72201]: INFO nova.compute.provider_config [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] Acquiring lock "singleton_lock" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] Acquired lock "singleton_lock" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] Releasing lock "singleton_lock" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] Full set of CONF: {{(pid=72201) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ******************************************************************************** {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] Configuration options gathered from: {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ================================================================================ {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] allow_resize_to_same_host      = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] arq_binding_timeout            = 300 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] backdoor_port                  = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] backdoor_socket                = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] block_device_allocate_retries  = 300 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] block_device_allocate_retries_interval = 5 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cert                           = self.pem {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] compute_monitors               = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] config_dir                     = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] config_drive_format            = iso9660 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] config_source                  = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] console_host                   = user {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] control_exchange               = nova {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cpu_allocation_ratio           = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] daemon                         = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] debug                          = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] default_access_ip_network_name = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] default_availability_zone      = nova {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] default_ephemeral_format       = ext4 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] default_schedule_zone          = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] disk_allocation_ratio          = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] enable_new_services            = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] enabled_apis                   = ['osapi_compute'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] enabled_ssl_apis               = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] flat_injected                  = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] force_config_drive             = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] force_raw_images               = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] graceful_shutdown_timeout      = 5 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] heal_instance_info_cache_interval = 60 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] host                           = user {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] instance_build_timeout         = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] instance_delete_interval       = 300 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] instance_format                = [instance: %(uuid)s]  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] instance_name_template         = instance-%08x {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] instance_usage_audit           = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] instance_usage_audit_period    = month {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] internal_service_availability_zone = internal {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] key                            = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] live_migration_retry_count     = 30 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] log_config_append              = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] log_dir                        = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] log_file                       = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] log_options                    = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] log_rotate_interval            = 1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] log_rotate_interval_type       = days {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] log_rotation_type              = none {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] long_rpc_timeout               = 1800 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] max_concurrent_builds          = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] max_concurrent_live_migrations = 1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] max_concurrent_snapshots       = 5 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] max_local_block_devices        = 3 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] max_logfile_count              = 30 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] max_logfile_size_mb            = 200 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] maximum_instance_delete_attempts = 5 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] metadata_listen                = 0.0.0.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] metadata_listen_port           = 8775 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] metadata_workers               = 3 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] migrate_max_retries            = -1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] mkisofs_cmd                    = genisoimage {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] my_ip                          = 10.0.0.210 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] network_allocate_retries       = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] osapi_compute_listen_port      = 8774 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] osapi_compute_unique_server_name_scope =  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] osapi_compute_workers          = 3 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] password_length                = 12 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] periodic_enable                = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] periodic_fuzzy_delay           = 60 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] pointer_model                  = ps2mouse {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] preallocate_images             = none {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] publish_errors                 = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] pybasedir                      = /opt/stack/nova {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ram_allocation_ratio           = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] rate_limit_burst               = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] rate_limit_except_level        = CRITICAL {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] rate_limit_interval            = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] reboot_timeout                 = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] reclaim_instance_interval      = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] record                         = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] reimage_timeout_per_gb         = 60 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] report_interval                = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] rescue_timeout                 = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] reserved_host_cpus             = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] reserved_host_disk_mb          = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] reserved_host_memory_mb        = 512 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] reserved_huge_pages            = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] resize_confirm_window          = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] resize_fs_using_block_device   = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] resume_guests_state_on_host_boot = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] rpc_response_timeout           = 60 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] run_external_periodic_tasks    = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] running_deleted_instance_action = reap {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] running_deleted_instance_poll_interval = 1800 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] running_deleted_instance_timeout = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] scheduler_instance_sync_interval = 120 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] service_down_time              = 60 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] servicegroup_driver            = db {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] shelved_offload_time           = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] shelved_poll_interval          = 3600 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] shutdown_timeout               = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] source_is_ipv6                 = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ssl_only                       = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] state_path                     = /opt/stack/data/nova {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] sync_power_state_interval      = 600 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] sync_power_state_pool_size     = 1000 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] syslog_log_facility            = LOG_USER {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] tempdir                        = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] timeout_nbd                    = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] transport_url                  = **** {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] update_resources_interval      = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] use_cow_images                 = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] use_eventlog                   = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] use_journal                    = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] use_json                       = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] use_rootwrap_daemon            = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] use_stderr                     = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] use_syslog                     = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vcpu_pin_set                   = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vif_plugging_is_fatal          = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vif_plugging_timeout           = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] virt_mkfs                      = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] volume_usage_poll_interval     = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] watch_log_file                 = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] web                            = /usr/share/spice-html5 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_concurrency.disable_process_locking = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.auth_strategy              = keystone {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.compute_link_prefix        = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.dhcp_domain                = novalocal {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.enable_instance_password   = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.glance_link_prefix         = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.instance_list_per_project_cells = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.list_records_by_skipping_down_cells = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.local_metadata_per_cell    = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.max_limit                  = 1000 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.metadata_cache_expiration  = 15 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.neutron_default_tenant_id  = default {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.use_forwarded_for          = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.use_neutron_default_nets   = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.vendordata_dynamic_targets = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.vendordata_jsonfile_path   = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.backend                  = dogpile.cache.memcached {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.backend_argument         = **** {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.config_prefix            = cache.oslo {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.dead_timeout             = 60.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.debug_cache_backend      = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.enable_retry_client      = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.enable_socket_keepalive  = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.enabled                  = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.expiration_time          = 600 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.hashclient_retry_attempts = 2 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.memcache_dead_retry      = 300 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.memcache_password        =  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.memcache_pool_maxsize    = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.memcache_sasl_enabled    = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.memcache_username        =  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.proxies                  = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.retry_attempts           = 2 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.retry_delay              = 0.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.socket_keepalive_count   = 1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.socket_keepalive_idle    = 1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.socket_keepalive_interval = 1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.tls_allowed_ciphers      = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.tls_cafile               = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.tls_certfile             = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.tls_enabled              = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cache.tls_keyfile              = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cinder.auth_section            = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cinder.auth_type               = password {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cinder.cafile                  = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cinder.certfile                = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cinder.collect_timing          = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cinder.cross_az_attach         = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cinder.debug                   = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cinder.endpoint_template       = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cinder.http_retries            = 3 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cinder.insecure                = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cinder.keyfile                 = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cinder.os_region_name          = RegionOne {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cinder.split_loggers           = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cinder.timeout                 = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] compute.cpu_dedicated_set      = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] compute.cpu_shared_set         = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] compute.image_type_exclude_list = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] compute.max_concurrent_disk_ops = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] compute.max_disk_devices_to_attach = -1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] compute.resource_provider_association_refresh = 300 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] compute.shutdown_retry_interval = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] conductor.workers              = 3 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] console.allowed_origins        = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] console.ssl_ciphers            = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] console.ssl_minimum_version    = default {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] consoleauth.token_ttl          = 600 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cyborg.cafile                  = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cyborg.certfile                = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cyborg.collect_timing          = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cyborg.connect_retries         = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cyborg.connect_retry_delay     = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cyborg.endpoint_override       = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cyborg.insecure                = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cyborg.keyfile                 = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cyborg.max_version             = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cyborg.min_version             = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cyborg.region_name             = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cyborg.service_name            = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cyborg.service_type            = accelerator {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cyborg.split_loggers           = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cyborg.status_code_retries     = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cyborg.status_code_retry_delay = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cyborg.timeout                 = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] cyborg.version                 = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] database.backend               = sqlalchemy {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] database.connection            = **** {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] database.connection_debug      = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] database.connection_parameters =  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] database.connection_recycle_time = 3600 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] database.connection_trace      = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] database.db_inc_retry_interval = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] database.db_max_retries        = 20 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] database.db_max_retry_interval = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] database.db_retry_interval     = 1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] database.max_overflow          = 50 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] database.max_pool_size         = 5 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] database.max_retries           = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] database.mysql_enable_ndb      = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] database.mysql_wsrep_sync_wait = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] database.pool_timeout          = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] database.retry_interval        = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] database.slave_connection      = **** {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] database.sqlite_synchronous    = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api_database.backend           = sqlalchemy {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api_database.connection        = **** {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api_database.connection_debug  = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api_database.connection_parameters =  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api_database.connection_recycle_time = 3600 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api_database.connection_trace  = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api_database.db_inc_retry_interval = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api_database.db_max_retries    = 20 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api_database.db_max_retry_interval = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api_database.db_retry_interval = 1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api_database.max_overflow      = 50 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api_database.max_pool_size     = 5 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api_database.max_retries       = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api_database.mysql_enable_ndb  = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api_database.pool_timeout      = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api_database.retry_interval    = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api_database.slave_connection  = **** {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] api_database.sqlite_synchronous = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] devices.enabled_mdev_types     = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ephemeral_storage_encryption.enabled = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.api_servers             = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.cafile                  = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.certfile                = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.collect_timing          = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.connect_retries         = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.connect_retry_delay     = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.debug                   = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.default_trusted_certificate_ids = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.enable_certificate_validation = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.enable_rbd_download     = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.endpoint_override       = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.insecure                = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.keyfile                 = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.max_version             = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.min_version             = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.num_retries             = 3 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.rbd_ceph_conf           =  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.rbd_connect_timeout     = 5 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.rbd_pool                =  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.rbd_user                =  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.region_name             = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.service_name            = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.service_type            = image {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.split_loggers           = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.status_code_retries     = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.status_code_retry_delay = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.timeout                 = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.verify_glance_signatures = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] glance.version                 = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] guestfs.debug                  = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] hyperv.config_drive_cdrom      = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] hyperv.config_drive_inject_password = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] hyperv.enable_instance_metrics_collection = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] hyperv.enable_remotefx         = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] hyperv.instances_path_share    =  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] hyperv.iscsi_initiator_list    = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] hyperv.limit_cpu_features      = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] hyperv.power_state_check_timeframe = 60 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] hyperv.use_multipath_io        = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] hyperv.volume_attach_retry_count = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] hyperv.vswitch_name            = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] mks.enabled                    = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] image_cache.manager_interval   = 2400 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] image_cache.precache_concurrency = 1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] image_cache.remove_unused_base_images = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] image_cache.subdirectory_name  = _base {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.api_max_retries         = 60 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.api_retry_interval      = 2 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.auth_section            = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.auth_type               = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.cafile                  = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.certfile                = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.collect_timing          = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.connect_retries         = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.connect_retry_delay     = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.endpoint_override       = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.insecure                = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.keyfile                 = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.max_version             = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.min_version             = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.partition_key           = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.peer_list               = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.region_name             = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.serial_console_state_timeout = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.service_name            = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.service_type            = baremetal {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.split_loggers           = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.status_code_retries     = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.status_code_retry_delay = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.timeout                 = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ironic.version                 = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] key_manager.fixed_key          = **** {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican.barbican_api_version  = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican.barbican_endpoint     = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican.barbican_endpoint_type = public {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican.barbican_region_name  = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican.cafile                = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican.certfile              = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican.collect_timing        = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican.insecure              = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican.keyfile               = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican.number_of_retries     = 60 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican.retry_delay           = 1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican.send_service_user_token = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican.split_loggers         = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican.timeout               = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican.verify_ssl            = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican.verify_ssl_path       = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican_service_user.auth_section = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican_service_user.auth_type = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican_service_user.cafile   = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican_service_user.certfile = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican_service_user.collect_timing = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican_service_user.insecure = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican_service_user.keyfile  = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican_service_user.split_loggers = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] barbican_service_user.timeout  = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vault.approle_role_id          = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vault.approle_secret_id        = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vault.cafile                   = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vault.certfile                 = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vault.collect_timing           = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vault.insecure                 = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vault.keyfile                  = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vault.kv_mountpoint            = secret {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vault.kv_version               = 2 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vault.namespace                = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vault.root_token_id            = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vault.split_loggers            = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vault.ssl_ca_crt_file          = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vault.timeout                  = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vault.use_ssl                  = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] keystone.cafile                = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] keystone.certfile              = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] keystone.collect_timing        = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] keystone.connect_retries       = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] keystone.connect_retry_delay   = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] keystone.endpoint_override     = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] keystone.insecure              = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] keystone.keyfile               = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] keystone.max_version           = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] keystone.min_version           = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] keystone.region_name           = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] keystone.service_name          = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] keystone.service_type          = identity {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] keystone.split_loggers         = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] keystone.status_code_retries   = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] keystone.status_code_retry_delay = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] keystone.timeout               = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] keystone.version               = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.connection_uri         =  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.cpu_mode               = custom {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: WARNING oslo_config.cfg [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.cpu_power_governor_high = performance {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.cpu_power_governor_low = powersave {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.cpu_power_management   = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.device_detach_attempts = 8 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.device_detach_timeout  = 20 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.disk_cachemodes        = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.disk_prefix            = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.enabled_perf_events    = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.file_backed_memory     = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.gid_maps               = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.hw_disk_discard        = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.hw_machine_type        = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.images_rbd_glance_store_name =  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.images_rbd_pool        = rbd {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.images_type            = default {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.images_volume_group    = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.inject_key             = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.inject_partition       = -2 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.inject_password        = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.iscsi_iface            = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.iser_use_multipath     = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.live_migration_bandwidth = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.live_migration_downtime = 500 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.live_migration_inbound_addr = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.live_migration_permit_post_copy = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.live_migration_scheme  = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.live_migration_timeout_action = abort {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.live_migration_tunnelled = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: WARNING oslo_config.cfg [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 01 15:15:53 user nova-compute[72201]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 01 15:15:53 user nova-compute[72201]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 01 15:15:53 user nova-compute[72201]: and ``live_migration_inbound_addr`` respectively.
Aug 01 15:15:53 user nova-compute[72201]: ).  Its value may be silently ignored in the future.
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.live_migration_with_native_tls = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.max_queues             = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.nfs_mount_options      = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.num_memory_encrypted_guests = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.num_pcie_ports         = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.pmem_namespaces        = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.quobyte_client_cfg     = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.rbd_secret_uuid        = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.rbd_user               = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.remote_filesystem_transport = ssh {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.rescue_image_id        = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.rescue_kernel_id       = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.rescue_ramdisk_id      = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.rx_queue_size          = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.smbfs_mount_options    =  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.snapshot_compression   = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.snapshot_image_format  = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.sparse_logical_volumes = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.swtpm_enabled          = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.swtpm_group            = tss {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.swtpm_user             = tss {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.sysinfo_serial         = unique {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.tb_cache_size          = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.tx_queue_size          = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.uid_maps               = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.use_virtio_for_bridges = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.virt_type              = kvm {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.volume_clear           = zero {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.volume_clear_size      = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.volume_use_multipath   = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.vzstorage_cache_path   = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.vzstorage_mount_user   = stack {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.auth_section           = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.auth_type              = password {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.cafile                 = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.certfile               = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.collect_timing         = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.connect_retries        = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.connect_retry_delay    = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.default_floating_pool  = public {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.endpoint_override      = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.extension_sync_interval = 600 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.http_retries           = 3 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.insecure               = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.keyfile                = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.max_version            = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.min_version            = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.ovs_bridge             = br-int {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.physnets               = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.region_name            = RegionOne {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.service_metadata_proxy = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.service_name           = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.service_type           = network {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.split_loggers          = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.status_code_retries    = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.status_code_retry_delay = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.timeout                = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] neutron.version                = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] notifications.bdms_in_notifications = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] notifications.default_level    = INFO {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] notifications.notification_format = unversioned {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] notifications.notify_on_state_change = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] pci.alias                      = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] pci.device_spec                = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] pci.report_in_placement        = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.auth_section         = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.auth_type            = password {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.cafile               = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.certfile             = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.collect_timing       = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.connect_retries      = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.connect_retry_delay  = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.default_domain_id    = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.default_domain_name  = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.domain_id            = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.domain_name          = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.endpoint_override    = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.insecure             = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.keyfile              = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.max_version          = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.min_version          = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.password             = **** {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.project_domain_id    = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.project_domain_name  = Default {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.project_id           = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.project_name         = service {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.region_name          = RegionOne {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.service_name         = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.service_type         = placement {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.split_loggers        = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.status_code_retries  = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.status_code_retry_delay = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.system_scope         = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.timeout              = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.trust_id             = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.user_domain_id       = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.user_domain_name     = Default {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.user_id              = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.username             = placement {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] placement.version              = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] quota.cores                    = 20 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] quota.count_usage_from_placement = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] quota.injected_file_content_bytes = 10240 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] quota.injected_file_path_length = 255 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] quota.injected_files           = 5 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] quota.instances                = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] quota.key_pairs                = 100 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] quota.metadata_items           = 128 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] quota.ram                      = 51200 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] quota.recheck_quota            = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] quota.server_group_members     = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] quota.server_groups            = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] rdp.enabled                    = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] scheduler.image_metadata_prefilter = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] scheduler.max_attempts         = 3 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] scheduler.max_placement_results = 1000 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] scheduler.query_placement_for_availability_zone = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] scheduler.query_placement_for_image_type_support = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] scheduler.workers              = 3 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.host_subset_size = 1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.isolated_hosts = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.isolated_images = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.pci_in_placement = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.track_instance_changes = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] metrics.required               = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] metrics.weight_multiplier      = 1.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] metrics.weight_setting         = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] serial_console.enabled         = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] serial_console.port_range      = 10000:20000 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] serial_console.serialproxy_port = 6083 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] service_user.auth_section      = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] service_user.auth_type         = password {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] service_user.cafile            = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] service_user.certfile          = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] service_user.collect_timing    = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] service_user.insecure          = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] service_user.keyfile           = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] service_user.send_service_user_token = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] service_user.split_loggers     = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] service_user.timeout           = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] spice.agent_enabled            = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] spice.enabled                  = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] spice.html5proxy_port          = 6082 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] spice.image_compression        = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] spice.jpeg_compression         = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] spice.playback_compression     = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] spice.server_listen            = 127.0.0.1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] spice.streaming_mode           = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] spice.zlib_compression         = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] upgrade_levels.baseapi         = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] upgrade_levels.cert            = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] upgrade_levels.compute         = auto {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] upgrade_levels.conductor       = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] upgrade_levels.scheduler       = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vendordata_dynamic_auth.auth_section = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vendordata_dynamic_auth.auth_type = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vendordata_dynamic_auth.cafile = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vendordata_dynamic_auth.certfile = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vendordata_dynamic_auth.insecure = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vendordata_dynamic_auth.keyfile = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vendordata_dynamic_auth.timeout = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.api_retry_count         = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.ca_file                 = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.cache_prefix            = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.cluster_name            = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.connection_pool_size    = 10 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.console_delay_seconds   = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.datastore_regex         = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.host_ip                 = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.host_password           = **** {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.host_port               = 443 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.host_username           = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.insecure                = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.integration_bridge      = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.maximum_objects         = 100 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.pbm_default_policy      = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.pbm_enabled             = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.pbm_wsdl_location       = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.serial_port_proxy_uri   = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.serial_port_service_uri = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.task_poll_interval      = 0.5 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.use_linked_clone        = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.vnc_keymap              = en-us {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.vnc_port                = 5900 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vmware.vnc_port_total          = 10000 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vnc.auth_schemes               = ['none'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vnc.enabled                    = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vnc.novncproxy_port            = 6080 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vnc.server_listen              = 0.0.0.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vnc.vencrypt_ca_certs          = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vnc.vencrypt_client_cert       = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vnc.vencrypt_client_key        = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] workarounds.disable_rootwrap   = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] workarounds.enable_numa_live_migration = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] workarounds.libvirt_disable_apic = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] wsgi.client_socket_timeout     = 900 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] wsgi.default_pool_size         = 1000 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] wsgi.keep_alive                = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] wsgi.max_header_line           = 16384 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] wsgi.ssl_ca_file               = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] wsgi.ssl_cert_file             = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] wsgi.ssl_key_file              = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] wsgi.tcp_keepidle              = 600 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] zvm.ca_file                    = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] zvm.cloud_connector_url        = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] zvm.reachable_timeout          = 300 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_policy.enforce_new_defaults = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_policy.enforce_scope      = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_policy.policy_default_rule = default {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_policy.policy_file        = policy.yaml {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] profiler.connection_string     = messaging:// {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] profiler.enabled               = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] profiler.es_doc_type           = notification {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] profiler.es_scroll_size        = 10000 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] profiler.es_scroll_time        = 2m {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] profiler.filter_error_trace    = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] profiler.hmac_keys             = **** {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] profiler.sentinel_service_name = mymaster {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] profiler.socket_timeout        = 0.1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] profiler.trace_requests        = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] profiler.trace_sqlalchemy      = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] profiler_jaeger.process_tags   = {} {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] profiler_jaeger.service_name_prefix = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] profiler_otlp.service_name_prefix = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] remote_debug.host              = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] remote_debug.port              = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.ssl      = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_notifications.retry = -1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_messaging_notifications.transport_url = **** {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.auth_section        = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.auth_type           = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.cafile              = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.certfile            = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.collect_timing      = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.connect_retries     = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.connect_retry_delay = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.endpoint_id         = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.endpoint_override   = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.insecure            = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.keyfile             = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.max_version         = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.min_version         = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.region_name         = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.service_name        = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.service_type        = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.split_loggers       = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.status_code_retries = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.status_code_retry_delay = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.timeout             = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.valid_interfaces    = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_limit.version             = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_reports.file_event_handler = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] oslo_reports.log_dir           = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vif_plug_ovs_privileged.group  = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] vif_plug_ovs_privileged.user   = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] os_vif_linux_bridge.flat_interface = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] os_vif_ovs.isolate_vif         = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] os_vif_ovs.per_port_bridge     = False {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] os_brick.lock_path             = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] privsep_osbrick.capabilities   = [21] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] privsep_osbrick.group          = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] privsep_osbrick.helper_command = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] privsep_osbrick.user           = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] nova_sys_admin.group           = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] nova_sys_admin.helper_command  = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] nova_sys_admin.user            = None {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG oslo_service.service [None req-629522f7-92fe-4933-994d-42b498e2b40e None None] ******************************************************************************** {{(pid=72201) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Aug 01 15:15:53 user nova-compute[72201]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 01 15:15:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Starting native event thread {{(pid=72201) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Starting green dispatch thread {{(pid=72201) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Starting connection event dispatch thread {{(pid=72201) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Connecting to libvirt: qemu:///system {{(pid=72201) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fc545be0a30> {{(pid=72201) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 01 15:15:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fc545be0a30> {{(pid=72201) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 01 15:15:53 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Connection event '1' reason 'None'
Aug 01 15:15:53 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 01 15:15:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.mount [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Initialising _HostMountState generation 0 {{(pid=72201) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 01 15:16:01 user nova-compute[72201]: INFO nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Libvirt host capabilities <capabilities>
Aug 01 15:16:01 user nova-compute[72201]:   <host>
Aug 01 15:16:01 user nova-compute[72201]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 01 15:16:01 user nova-compute[72201]:     <cpu>
Aug 01 15:16:01 user nova-compute[72201]:       <arch>x86_64</arch>
Aug 01 15:16:01 user nova-compute[72201]:       <model>IvyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <vendor>Intel</vendor>
Aug 01 15:16:01 user nova-compute[72201]:       <microcode version='1070'/>
Aug 01 15:16:01 user nova-compute[72201]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 01 15:16:01 user nova-compute[72201]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature name='ss'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature name='vmx'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature name='pcid'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature name='osxsave'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature name='hypervisor'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature name='arat'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature name='tsc_adjust'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature name='md-clear'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature name='stibp'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature name='arch-capabilities'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature name='ssbd'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature name='invtsc'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature name='rsba'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature name='skip-l1dfl-vmentry'/>
Aug 01 15:16:01 user nova-compute[72201]:       <pages unit='KiB' size='4'/>
Aug 01 15:16:01 user nova-compute[72201]:       <pages unit='KiB' size='2048'/>
Aug 01 15:16:01 user nova-compute[72201]:     </cpu>
Aug 01 15:16:01 user nova-compute[72201]:     <power_management>
Aug 01 15:16:01 user nova-compute[72201]:       <suspend_mem/>
Aug 01 15:16:01 user nova-compute[72201]:       <suspend_disk/>
Aug 01 15:16:01 user nova-compute[72201]:       <suspend_hybrid/>
Aug 01 15:16:01 user nova-compute[72201]:     </power_management>
Aug 01 15:16:01 user nova-compute[72201]:     <iommu support='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     <migration_features>
Aug 01 15:16:01 user nova-compute[72201]:       <live/>
Aug 01 15:16:01 user nova-compute[72201]:       <uri_transports>
Aug 01 15:16:01 user nova-compute[72201]:         <uri_transport>tcp</uri_transport>
Aug 01 15:16:01 user nova-compute[72201]:         <uri_transport>rdma</uri_transport>
Aug 01 15:16:01 user nova-compute[72201]:       </uri_transports>
Aug 01 15:16:01 user nova-compute[72201]:     </migration_features>
Aug 01 15:16:01 user nova-compute[72201]:     <topology>
Aug 01 15:16:01 user nova-compute[72201]:       <cells num='2'>
Aug 01 15:16:01 user nova-compute[72201]:         <cell id='0'>
Aug 01 15:16:01 user nova-compute[72201]:           <memory unit='KiB'>8140616</memory>
Aug 01 15:16:01 user nova-compute[72201]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 01 15:16:01 user nova-compute[72201]:           <pages unit='KiB' size='2048'>0</pages>
Aug 01 15:16:01 user nova-compute[72201]:           <distances>
Aug 01 15:16:01 user nova-compute[72201]:             <sibling id='0' value='10'/>
Aug 01 15:16:01 user nova-compute[72201]:             <sibling id='1' value='20'/>
Aug 01 15:16:01 user nova-compute[72201]:           </distances>
Aug 01 15:16:01 user nova-compute[72201]:           <cpus num='6'>
Aug 01 15:16:01 user nova-compute[72201]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 01 15:16:01 user nova-compute[72201]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 01 15:16:01 user nova-compute[72201]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 01 15:16:01 user nova-compute[72201]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 01 15:16:01 user nova-compute[72201]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 01 15:16:01 user nova-compute[72201]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 01 15:16:01 user nova-compute[72201]:           </cpus>
Aug 01 15:16:01 user nova-compute[72201]:         </cell>
Aug 01 15:16:01 user nova-compute[72201]:         <cell id='1'>
Aug 01 15:16:01 user nova-compute[72201]:           <memory unit='KiB'>8255068</memory>
Aug 01 15:16:01 user nova-compute[72201]:           <pages unit='KiB' size='4'>2063767</pages>
Aug 01 15:16:01 user nova-compute[72201]:           <pages unit='KiB' size='2048'>0</pages>
Aug 01 15:16:01 user nova-compute[72201]:           <distances>
Aug 01 15:16:01 user nova-compute[72201]:             <sibling id='0' value='20'/>
Aug 01 15:16:01 user nova-compute[72201]:             <sibling id='1' value='10'/>
Aug 01 15:16:01 user nova-compute[72201]:           </distances>
Aug 01 15:16:01 user nova-compute[72201]:           <cpus num='6'>
Aug 01 15:16:01 user nova-compute[72201]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 01 15:16:01 user nova-compute[72201]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 01 15:16:01 user nova-compute[72201]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 01 15:16:01 user nova-compute[72201]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 01 15:16:01 user nova-compute[72201]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 01 15:16:01 user nova-compute[72201]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 01 15:16:01 user nova-compute[72201]:           </cpus>
Aug 01 15:16:01 user nova-compute[72201]:         </cell>
Aug 01 15:16:01 user nova-compute[72201]:       </cells>
Aug 01 15:16:01 user nova-compute[72201]:     </topology>
Aug 01 15:16:01 user nova-compute[72201]:     <cache>
Aug 01 15:16:01 user nova-compute[72201]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 01 15:16:01 user nova-compute[72201]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 01 15:16:01 user nova-compute[72201]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 01 15:16:01 user nova-compute[72201]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 01 15:16:01 user nova-compute[72201]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 01 15:16:01 user nova-compute[72201]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 01 15:16:01 user nova-compute[72201]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 01 15:16:01 user nova-compute[72201]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 01 15:16:01 user nova-compute[72201]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 01 15:16:01 user nova-compute[72201]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 01 15:16:01 user nova-compute[72201]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 01 15:16:01 user nova-compute[72201]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 01 15:16:01 user nova-compute[72201]:     </cache>
Aug 01 15:16:01 user nova-compute[72201]:     <secmodel>
Aug 01 15:16:01 user nova-compute[72201]:       <model>apparmor</model>
Aug 01 15:16:01 user nova-compute[72201]:       <doi>0</doi>
Aug 01 15:16:01 user nova-compute[72201]:     </secmodel>
Aug 01 15:16:01 user nova-compute[72201]:     <secmodel>
Aug 01 15:16:01 user nova-compute[72201]:       <model>dac</model>
Aug 01 15:16:01 user nova-compute[72201]:       <doi>0</doi>
Aug 01 15:16:01 user nova-compute[72201]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 01 15:16:01 user nova-compute[72201]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 01 15:16:01 user nova-compute[72201]:     </secmodel>
Aug 01 15:16:01 user nova-compute[72201]:   </host>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='alpha'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>64</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>clipper</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='armv6l'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>32</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>spitz</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>nuri</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>kzm</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>sx1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>z2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>tosa</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>n810</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>n800</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>terrier</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>midway</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>microbit</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>verdex</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>highbank</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>akita</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>connex</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>collie</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='armv7l'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>32</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>spitz</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>nuri</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>kzm</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>sx1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>z2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>tosa</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>n810</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>n800</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>terrier</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>midway</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>microbit</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>verdex</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>highbank</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>akita</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>connex</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>collie</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='aarch64'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>64</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>spitz</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>nuri</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>kzm</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>sx1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>z2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>tosa</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>n810</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>n800</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>terrier</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>midway</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>microbit</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>verdex</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>raspi3b</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>highbank</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>akita</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>connex</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>collie</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <acpi default='on' toggle='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='cris'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>32</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='i686'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>32</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>x-remote</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>isapc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>microvm</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='kvm'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <pae/>
Aug 01 15:16:01 user nova-compute[72201]:       <nonpae/>
Aug 01 15:16:01 user nova-compute[72201]:       <acpi default='on' toggle='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:       <apic default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='m68k'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>32</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>an5206</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>q800</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>next-cube</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='microblaze'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>32</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='microblazeel'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>32</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='mips'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>32</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='16'>malta</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='mipsel'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>32</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='16'>malta</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='mips64'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>64</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='16'>malta</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>pica61</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>magnum</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='mips64el'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>64</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='16'>malta</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>pica61</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>magnum</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='16'>boston</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='ppc'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>32</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mac99</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>40p</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>taihu</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='ppc64'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>64</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2048'>powernv9</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>taihu</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2048'>powernv10</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>40p</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mac99</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2048'>powernv8</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='ppc64le'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>64</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2048'>powernv9</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>taihu</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2048'>powernv10</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>40p</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>mac99</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2048'>powernv8</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='riscv32'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>32</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='8'>spike</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>opentitan</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='5'>sifive_u</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>sifive_e</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='8'>virt</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='riscv64'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>64</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='8'>spike</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='5'>sifive_u</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>shakti_c</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>sifive_e</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='8'>virt</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='s390x'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>64</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='sh4'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>32</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>shix</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>r2d</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='sh4eb'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>64</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>shix</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>r2d</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='sparc'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>32</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>SS-5</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>SS-20</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>LX</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>SS-4</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>SS-10</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>Voyager</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='sparc64'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>64</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>sun4u</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>niagara</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>sun4v</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='x86_64'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>64</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>x-remote</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='1'>isapc</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>microvm</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='kvm'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <acpi default='on' toggle='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:       <apic default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='xtensa'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>32</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>sim</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='32'>kc705</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='32'>ml605</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='32'>virt</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='32'>lx200</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='32'>lx60</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]:   <guest>
Aug 01 15:16:01 user nova-compute[72201]:     <os_type>hvm</os_type>
Aug 01 15:16:01 user nova-compute[72201]:     <arch name='xtensaeb'>
Aug 01 15:16:01 user nova-compute[72201]:       <wordsize>32</wordsize>
Aug 01 15:16:01 user nova-compute[72201]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='4'>sim</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='32'>kc705</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='32'>ml605</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='32'>virt</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='32'>lx200</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='32'>lx60</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 01 15:16:01 user nova-compute[72201]:       <domain type='qemu'/>
Aug 01 15:16:01 user nova-compute[72201]:     </arch>
Aug 01 15:16:01 user nova-compute[72201]:     <features>
Aug 01 15:16:01 user nova-compute[72201]:       <cpuselection/>
Aug 01 15:16:01 user nova-compute[72201]:       <deviceboot/>
Aug 01 15:16:01 user nova-compute[72201]:       <disksnapshot default='on' toggle='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     </features>
Aug 01 15:16:01 user nova-compute[72201]:   </guest>
Aug 01 15:16:01 user nova-compute[72201]: </capabilities>
Aug 01 15:16:01 user nova-compute[72201]: 
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 01 15:16:01 user nova-compute[72201]: <domainCapabilities>
Aug 01 15:16:01 user nova-compute[72201]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 15:16:01 user nova-compute[72201]:   <domain>kvm</domain>
Aug 01 15:16:01 user nova-compute[72201]:   <machine>pc-i440fx-6.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:   <arch>i686</arch>
Aug 01 15:16:01 user nova-compute[72201]:   <vcpu max='255'/>
Aug 01 15:16:01 user nova-compute[72201]:   <iothreads supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:   <os supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:     <enum name='firmware'/>
Aug 01 15:16:01 user nova-compute[72201]:     <loader supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='type'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>rom</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>pflash</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='readonly'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>yes</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>no</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='secure'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>no</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </loader>
Aug 01 15:16:01 user nova-compute[72201]:   </os>
Aug 01 15:16:01 user nova-compute[72201]:   <cpu>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='host-passthrough' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='hostPassthroughMigratable'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>off</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='maximum' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='maximumMigratable'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>on</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>off</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='host-model' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <vendor>Intel</vendor>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ss'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='vmx'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='pcid'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='hypervisor'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='arat'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='umip'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='md-clear'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='stibp'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ssbd'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ibpb'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ibrs'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='amd-stibp'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='disable' name='erms'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='disable' name='lm'/>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='custom' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>qemu64</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>qemu32</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>phenom</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium3</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium2</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>n270</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>kvm64</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>kvm32</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>coreduo</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>core2duo</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>athlon</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Westmere</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Snowridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>SandyBridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Penryn</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G5</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G4</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G3</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G2</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G1</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Nehalem</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>IvyBridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Icelake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-Rome</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-Milan</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Dhyana</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cooperlake</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Conroe</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>486</model>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:   </cpu>
Aug 01 15:16:01 user nova-compute[72201]:   <memoryBacking supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:     <enum name='sourceType'>
Aug 01 15:16:01 user nova-compute[72201]:       <value>file</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>anonymous</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>memfd</value>
Aug 01 15:16:01 user nova-compute[72201]:     </enum>
Aug 01 15:16:01 user nova-compute[72201]:   </memoryBacking>
Aug 01 15:16:01 user nova-compute[72201]:   <devices>
Aug 01 15:16:01 user nova-compute[72201]:     <disk supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='diskDevice'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>disk</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>cdrom</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>floppy</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>lun</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='bus'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>ide</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>fdc</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>scsi</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>usb</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>sata</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-non-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </disk>
Aug 01 15:16:01 user nova-compute[72201]:     <graphics supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='type'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>sdl</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vnc</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>spice</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>egl-headless</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </graphics>
Aug 01 15:16:01 user nova-compute[72201]:     <video supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='modelType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vga</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>cirrus</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vmvga</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>qxl</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>none</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>bochs</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>ramfb</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </video>
Aug 01 15:16:01 user nova-compute[72201]:     <hostdev supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='mode'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>subsystem</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='startupPolicy'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>default</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>mandatory</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>requisite</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>optional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='subsysType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>usb</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>pci</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>scsi</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='capsType'/>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='pciBackend'/>
Aug 01 15:16:01 user nova-compute[72201]:     </hostdev>
Aug 01 15:16:01 user nova-compute[72201]:     <rng supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-non-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='backendModel'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>random</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>egd</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>builtin</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </rng>
Aug 01 15:16:01 user nova-compute[72201]:     <filesystem supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='driverType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>path</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>handle</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtiofs</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </filesystem>
Aug 01 15:16:01 user nova-compute[72201]:     <tpm supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>tpm-tis</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>tpm-crb</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='backendModel'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>passthrough</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>emulator</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </tpm>
Aug 01 15:16:01 user nova-compute[72201]:   </devices>
Aug 01 15:16:01 user nova-compute[72201]:   <features>
Aug 01 15:16:01 user nova-compute[72201]:     <gic supported='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     <vmcoreinfo supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <genid supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <backingStoreInput supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <backup supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <sev supported='no'/>
Aug 01 15:16:01 user nova-compute[72201]:   </features>
Aug 01 15:16:01 user nova-compute[72201]: </domainCapabilities>
Aug 01 15:16:01 user nova-compute[72201]:  {{(pid=72201) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 01 15:16:01 user nova-compute[72201]: <domainCapabilities>
Aug 01 15:16:01 user nova-compute[72201]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 15:16:01 user nova-compute[72201]:   <domain>kvm</domain>
Aug 01 15:16:01 user nova-compute[72201]:   <machine>pc-q35-6.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:   <arch>i686</arch>
Aug 01 15:16:01 user nova-compute[72201]:   <vcpu max='288'/>
Aug 01 15:16:01 user nova-compute[72201]:   <iothreads supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:   <os supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:     <enum name='firmware'/>
Aug 01 15:16:01 user nova-compute[72201]:     <loader supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='type'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>rom</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>pflash</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='readonly'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>yes</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>no</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='secure'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>no</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </loader>
Aug 01 15:16:01 user nova-compute[72201]:   </os>
Aug 01 15:16:01 user nova-compute[72201]:   <cpu>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='host-passthrough' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='hostPassthroughMigratable'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>off</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='maximum' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='maximumMigratable'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>on</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>off</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='host-model' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <vendor>Intel</vendor>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ss'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='vmx'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='pcid'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='hypervisor'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='arat'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='umip'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='md-clear'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='stibp'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ssbd'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ibpb'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ibrs'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='amd-stibp'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='disable' name='erms'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='disable' name='lm'/>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='custom' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>qemu64</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>qemu32</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>phenom</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium3</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium2</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>n270</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>kvm64</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>kvm32</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>coreduo</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>core2duo</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>athlon</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Westmere</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Snowridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>SandyBridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Penryn</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G5</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G4</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G3</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G2</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G1</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Nehalem</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>IvyBridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Icelake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-Rome</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-Milan</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Dhyana</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cooperlake</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Conroe</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>486</model>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:   </cpu>
Aug 01 15:16:01 user nova-compute[72201]:   <memoryBacking supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:     <enum name='sourceType'>
Aug 01 15:16:01 user nova-compute[72201]:       <value>file</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>anonymous</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>memfd</value>
Aug 01 15:16:01 user nova-compute[72201]:     </enum>
Aug 01 15:16:01 user nova-compute[72201]:   </memoryBacking>
Aug 01 15:16:01 user nova-compute[72201]:   <devices>
Aug 01 15:16:01 user nova-compute[72201]:     <disk supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='diskDevice'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>disk</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>cdrom</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>floppy</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>lun</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='bus'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>fdc</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>scsi</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>usb</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>sata</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-non-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </disk>
Aug 01 15:16:01 user nova-compute[72201]:     <graphics supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='type'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>sdl</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vnc</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>spice</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>egl-headless</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </graphics>
Aug 01 15:16:01 user nova-compute[72201]:     <video supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='modelType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vga</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>cirrus</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vmvga</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>qxl</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>none</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>bochs</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>ramfb</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </video>
Aug 01 15:16:01 user nova-compute[72201]:     <hostdev supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='mode'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>subsystem</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='startupPolicy'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>default</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>mandatory</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>requisite</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>optional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='subsysType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>usb</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>pci</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>scsi</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='capsType'/>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='pciBackend'/>
Aug 01 15:16:01 user nova-compute[72201]:     </hostdev>
Aug 01 15:16:01 user nova-compute[72201]:     <rng supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-non-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='backendModel'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>random</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>egd</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>builtin</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </rng>
Aug 01 15:16:01 user nova-compute[72201]:     <filesystem supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='driverType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>path</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>handle</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtiofs</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </filesystem>
Aug 01 15:16:01 user nova-compute[72201]:     <tpm supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>tpm-tis</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>tpm-crb</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='backendModel'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>passthrough</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>emulator</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </tpm>
Aug 01 15:16:01 user nova-compute[72201]:   </devices>
Aug 01 15:16:01 user nova-compute[72201]:   <features>
Aug 01 15:16:01 user nova-compute[72201]:     <gic supported='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     <vmcoreinfo supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <genid supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <backingStoreInput supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <backup supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <sev supported='no'/>
Aug 01 15:16:01 user nova-compute[72201]:   </features>
Aug 01 15:16:01 user nova-compute[72201]: </domainCapabilities>
Aug 01 15:16:01 user nova-compute[72201]:  {{(pid=72201) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 01 15:16:01 user nova-compute[72201]: <domainCapabilities>
Aug 01 15:16:01 user nova-compute[72201]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 15:16:01 user nova-compute[72201]:   <domain>kvm</domain>
Aug 01 15:16:01 user nova-compute[72201]:   <machine>pc-q35-jammy</machine>
Aug 01 15:16:01 user nova-compute[72201]:   <arch>i686</arch>
Aug 01 15:16:01 user nova-compute[72201]:   <vcpu max='288'/>
Aug 01 15:16:01 user nova-compute[72201]:   <iothreads supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:   <os supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:     <enum name='firmware'/>
Aug 01 15:16:01 user nova-compute[72201]:     <loader supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='type'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>rom</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>pflash</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='readonly'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>yes</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>no</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='secure'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>no</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </loader>
Aug 01 15:16:01 user nova-compute[72201]:   </os>
Aug 01 15:16:01 user nova-compute[72201]:   <cpu>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='host-passthrough' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='hostPassthroughMigratable'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>off</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='maximum' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='maximumMigratable'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>on</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>off</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='host-model' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <vendor>Intel</vendor>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ss'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='vmx'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='pcid'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='hypervisor'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='arat'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='umip'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='md-clear'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='stibp'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ssbd'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ibpb'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ibrs'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='amd-stibp'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='disable' name='erms'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='disable' name='lm'/>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='custom' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>qemu64</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>qemu32</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>phenom</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium3</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium2</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>n270</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>kvm64</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>kvm32</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>coreduo</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>core2duo</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>athlon</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Westmere</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Snowridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>SandyBridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Penryn</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G5</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G4</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G3</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G2</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G1</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Nehalem</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>IvyBridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Icelake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-Rome</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-Milan</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Dhyana</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cooperlake</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Conroe</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>486</model>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:   </cpu>
Aug 01 15:16:01 user nova-compute[72201]:   <memoryBacking supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:     <enum name='sourceType'>
Aug 01 15:16:01 user nova-compute[72201]:       <value>file</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>anonymous</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>memfd</value>
Aug 01 15:16:01 user nova-compute[72201]:     </enum>
Aug 01 15:16:01 user nova-compute[72201]:   </memoryBacking>
Aug 01 15:16:01 user nova-compute[72201]:   <devices>
Aug 01 15:16:01 user nova-compute[72201]:     <disk supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='diskDevice'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>disk</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>cdrom</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>floppy</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>lun</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='bus'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>fdc</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>scsi</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>usb</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>sata</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-non-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </disk>
Aug 01 15:16:01 user nova-compute[72201]:     <graphics supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='type'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>sdl</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vnc</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>spice</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>egl-headless</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </graphics>
Aug 01 15:16:01 user nova-compute[72201]:     <video supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='modelType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vga</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>cirrus</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vmvga</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>qxl</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>none</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>bochs</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>ramfb</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </video>
Aug 01 15:16:01 user nova-compute[72201]:     <hostdev supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='mode'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>subsystem</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='startupPolicy'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>default</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>mandatory</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>requisite</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>optional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='subsysType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>usb</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>pci</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>scsi</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='capsType'/>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='pciBackend'/>
Aug 01 15:16:01 user nova-compute[72201]:     </hostdev>
Aug 01 15:16:01 user nova-compute[72201]:     <rng supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-non-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='backendModel'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>random</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>egd</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>builtin</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </rng>
Aug 01 15:16:01 user nova-compute[72201]:     <filesystem supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='driverType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>path</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>handle</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtiofs</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </filesystem>
Aug 01 15:16:01 user nova-compute[72201]:     <tpm supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>tpm-tis</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>tpm-crb</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='backendModel'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>passthrough</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>emulator</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </tpm>
Aug 01 15:16:01 user nova-compute[72201]:   </devices>
Aug 01 15:16:01 user nova-compute[72201]:   <features>
Aug 01 15:16:01 user nova-compute[72201]:     <gic supported='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     <vmcoreinfo supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <genid supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <backingStoreInput supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <backup supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <sev supported='no'/>
Aug 01 15:16:01 user nova-compute[72201]:   </features>
Aug 01 15:16:01 user nova-compute[72201]: </domainCapabilities>
Aug 01 15:16:01 user nova-compute[72201]:  {{(pid=72201) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 01 15:16:01 user nova-compute[72201]: <domainCapabilities>
Aug 01 15:16:01 user nova-compute[72201]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 15:16:01 user nova-compute[72201]:   <domain>kvm</domain>
Aug 01 15:16:01 user nova-compute[72201]:   <machine>pc-i440fx-jammy</machine>
Aug 01 15:16:01 user nova-compute[72201]:   <arch>i686</arch>
Aug 01 15:16:01 user nova-compute[72201]:   <vcpu max='255'/>
Aug 01 15:16:01 user nova-compute[72201]:   <iothreads supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:   <os supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:     <enum name='firmware'/>
Aug 01 15:16:01 user nova-compute[72201]:     <loader supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='type'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>rom</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>pflash</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='readonly'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>yes</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>no</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='secure'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>no</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </loader>
Aug 01 15:16:01 user nova-compute[72201]:   </os>
Aug 01 15:16:01 user nova-compute[72201]:   <cpu>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='host-passthrough' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='hostPassthroughMigratable'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>off</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='maximum' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='maximumMigratable'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>on</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>off</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='host-model' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <vendor>Intel</vendor>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ss'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='vmx'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='pcid'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='hypervisor'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='arat'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='umip'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='md-clear'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='stibp'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ssbd'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ibpb'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ibrs'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='amd-stibp'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='disable' name='erms'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='disable' name='lm'/>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='custom' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>qemu64</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>qemu32</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>phenom</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium3</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium2</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>n270</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>kvm64</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>kvm32</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>coreduo</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>core2duo</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>athlon</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Westmere</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Snowridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>SandyBridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Penryn</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G5</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G4</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G3</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G2</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G1</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Nehalem</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>IvyBridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Icelake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-Rome</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-Milan</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Dhyana</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cooperlake</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Conroe</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>486</model>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:   </cpu>
Aug 01 15:16:01 user nova-compute[72201]:   <memoryBacking supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:     <enum name='sourceType'>
Aug 01 15:16:01 user nova-compute[72201]:       <value>file</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>anonymous</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>memfd</value>
Aug 01 15:16:01 user nova-compute[72201]:     </enum>
Aug 01 15:16:01 user nova-compute[72201]:   </memoryBacking>
Aug 01 15:16:01 user nova-compute[72201]:   <devices>
Aug 01 15:16:01 user nova-compute[72201]:     <disk supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='diskDevice'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>disk</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>cdrom</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>floppy</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>lun</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='bus'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>ide</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>fdc</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>scsi</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>usb</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>sata</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-non-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </disk>
Aug 01 15:16:01 user nova-compute[72201]:     <graphics supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='type'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>sdl</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vnc</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>spice</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>egl-headless</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </graphics>
Aug 01 15:16:01 user nova-compute[72201]:     <video supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='modelType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vga</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>cirrus</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vmvga</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>qxl</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>none</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>bochs</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>ramfb</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </video>
Aug 01 15:16:01 user nova-compute[72201]:     <hostdev supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='mode'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>subsystem</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='startupPolicy'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>default</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>mandatory</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>requisite</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>optional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='subsysType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>usb</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>pci</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>scsi</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='capsType'/>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='pciBackend'/>
Aug 01 15:16:01 user nova-compute[72201]:     </hostdev>
Aug 01 15:16:01 user nova-compute[72201]:     <rng supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-non-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='backendModel'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>random</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>egd</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>builtin</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </rng>
Aug 01 15:16:01 user nova-compute[72201]:     <filesystem supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='driverType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>path</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>handle</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtiofs</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </filesystem>
Aug 01 15:16:01 user nova-compute[72201]:     <tpm supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>tpm-tis</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>tpm-crb</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='backendModel'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>passthrough</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>emulator</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </tpm>
Aug 01 15:16:01 user nova-compute[72201]:   </devices>
Aug 01 15:16:01 user nova-compute[72201]:   <features>
Aug 01 15:16:01 user nova-compute[72201]:     <gic supported='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     <vmcoreinfo supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <genid supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <backingStoreInput supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <backup supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <sev supported='no'/>
Aug 01 15:16:01 user nova-compute[72201]:   </features>
Aug 01 15:16:01 user nova-compute[72201]: </domainCapabilities>
Aug 01 15:16:01 user nova-compute[72201]:  {{(pid=72201) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 01 15:16:01 user nova-compute[72201]: <domainCapabilities>
Aug 01 15:16:01 user nova-compute[72201]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 15:16:01 user nova-compute[72201]:   <domain>kvm</domain>
Aug 01 15:16:01 user nova-compute[72201]:   <machine>pc-i440fx-6.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:   <arch>x86_64</arch>
Aug 01 15:16:01 user nova-compute[72201]:   <vcpu max='255'/>
Aug 01 15:16:01 user nova-compute[72201]:   <iothreads supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:   <os supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:     <enum name='firmware'>
Aug 01 15:16:01 user nova-compute[72201]:       <value>efi</value>
Aug 01 15:16:01 user nova-compute[72201]:     </enum>
Aug 01 15:16:01 user nova-compute[72201]:     <loader supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='type'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>rom</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>pflash</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='readonly'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>yes</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>no</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='secure'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>no</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </loader>
Aug 01 15:16:01 user nova-compute[72201]:   </os>
Aug 01 15:16:01 user nova-compute[72201]:   <cpu>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='host-passthrough' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='hostPassthroughMigratable'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>on</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>off</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='maximum' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='maximumMigratable'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>on</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>off</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='host-model' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <vendor>Intel</vendor>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ss'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='vmx'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='pcid'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='hypervisor'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='arat'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='umip'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='md-clear'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='stibp'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ssbd'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='invtsc'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ibpb'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ibrs'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='amd-stibp'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='rsba'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='disable' name='erms'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='custom' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>qemu64</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>qemu32</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>phenom</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium3</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium2</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>n270</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>kvm64</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>kvm32</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>coreduo</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>core2duo</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>athlon</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Westmere</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Snowridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>SandyBridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Penryn</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G5</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G4</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G3</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G2</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Opteron_G1</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Nehalem</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>IvyBridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Icelake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-Rome</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-Milan</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Dhyana</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cooperlake</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Conroe</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>486</model>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:   </cpu>
Aug 01 15:16:01 user nova-compute[72201]:   <memoryBacking supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:     <enum name='sourceType'>
Aug 01 15:16:01 user nova-compute[72201]:       <value>file</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>anonymous</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>memfd</value>
Aug 01 15:16:01 user nova-compute[72201]:     </enum>
Aug 01 15:16:01 user nova-compute[72201]:   </memoryBacking>
Aug 01 15:16:01 user nova-compute[72201]:   <devices>
Aug 01 15:16:01 user nova-compute[72201]:     <disk supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='diskDevice'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>disk</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>cdrom</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>floppy</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>lun</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='bus'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>ide</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>fdc</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>scsi</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>usb</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>sata</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-non-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </disk>
Aug 01 15:16:01 user nova-compute[72201]:     <graphics supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='type'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>sdl</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vnc</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>spice</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>egl-headless</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </graphics>
Aug 01 15:16:01 user nova-compute[72201]:     <video supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='modelType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vga</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>cirrus</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vmvga</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>qxl</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>none</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>bochs</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>ramfb</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </video>
Aug 01 15:16:01 user nova-compute[72201]:     <hostdev supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='mode'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>subsystem</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='startupPolicy'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>default</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>mandatory</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>requisite</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>optional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='subsysType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>usb</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>pci</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>scsi</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='capsType'/>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='pciBackend'/>
Aug 01 15:16:01 user nova-compute[72201]:     </hostdev>
Aug 01 15:16:01 user nova-compute[72201]:     <rng supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-non-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='backendModel'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>random</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>egd</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>builtin</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </rng>
Aug 01 15:16:01 user nova-compute[72201]:     <filesystem supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='driverType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>path</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>handle</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtiofs</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </filesystem>
Aug 01 15:16:01 user nova-compute[72201]:     <tpm supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>tpm-tis</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>tpm-crb</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='backendModel'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>passthrough</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>emulator</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </tpm>
Aug 01 15:16:01 user nova-compute[72201]:   </devices>
Aug 01 15:16:01 user nova-compute[72201]:   <features>
Aug 01 15:16:01 user nova-compute[72201]:     <gic supported='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     <vmcoreinfo supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <genid supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <backingStoreInput supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <backup supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <sev supported='no'/>
Aug 01 15:16:01 user nova-compute[72201]:   </features>
Aug 01 15:16:01 user nova-compute[72201]: </domainCapabilities>
Aug 01 15:16:01 user nova-compute[72201]:  {{(pid=72201) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 01 15:16:01 user nova-compute[72201]: <domainCapabilities>
Aug 01 15:16:01 user nova-compute[72201]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 15:16:01 user nova-compute[72201]:   <domain>kvm</domain>
Aug 01 15:16:01 user nova-compute[72201]:   <machine>pc-q35-6.2</machine>
Aug 01 15:16:01 user nova-compute[72201]:   <arch>x86_64</arch>
Aug 01 15:16:01 user nova-compute[72201]:   <vcpu max='288'/>
Aug 01 15:16:01 user nova-compute[72201]:   <iothreads supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:   <os supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:     <enum name='firmware'>
Aug 01 15:16:01 user nova-compute[72201]:       <value>efi</value>
Aug 01 15:16:01 user nova-compute[72201]:     </enum>
Aug 01 15:16:01 user nova-compute[72201]:     <loader supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='type'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>rom</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>pflash</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='readonly'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>yes</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>no</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='secure'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>yes</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>no</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </loader>
Aug 01 15:16:01 user nova-compute[72201]:   </os>
Aug 01 15:16:01 user nova-compute[72201]:   <cpu>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='host-passthrough' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='hostPassthroughMigratable'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>on</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>off</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='maximum' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='maximumMigratable'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>on</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>off</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='host-model' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <vendor>Intel</vendor>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ss'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='vmx'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='pcid'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='hypervisor'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='arat'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='umip'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='md-clear'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='stibp'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ssbd'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='invtsc'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ibpb'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ibrs'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='amd-stibp'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='rsba'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='disable' name='erms'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='custom' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>qemu64</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>qemu32</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>phenom</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium3</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium2</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>n270</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>kvm64</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>kvm32</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>coreduo</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>core2duo</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>athlon</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Westmere</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Snowridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>SandyBridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Penryn</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G5</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G4</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G3</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G2</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Opteron_G1</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Nehalem</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>IvyBridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Icelake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-Rome</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-Milan</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Dhyana</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cooperlake</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Conroe</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>486</model>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:   </cpu>
Aug 01 15:16:01 user nova-compute[72201]:   <memoryBacking supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:     <enum name='sourceType'>
Aug 01 15:16:01 user nova-compute[72201]:       <value>file</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>anonymous</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>memfd</value>
Aug 01 15:16:01 user nova-compute[72201]:     </enum>
Aug 01 15:16:01 user nova-compute[72201]:   </memoryBacking>
Aug 01 15:16:01 user nova-compute[72201]:   <devices>
Aug 01 15:16:01 user nova-compute[72201]:     <disk supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='diskDevice'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>disk</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>cdrom</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>floppy</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>lun</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='bus'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>fdc</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>scsi</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>usb</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>sata</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-non-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </disk>
Aug 01 15:16:01 user nova-compute[72201]:     <graphics supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='type'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>sdl</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vnc</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>spice</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>egl-headless</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </graphics>
Aug 01 15:16:01 user nova-compute[72201]:     <video supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='modelType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vga</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>cirrus</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vmvga</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>qxl</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>none</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>bochs</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>ramfb</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </video>
Aug 01 15:16:01 user nova-compute[72201]:     <hostdev supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='mode'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>subsystem</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='startupPolicy'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>default</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>mandatory</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>requisite</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>optional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='subsysType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>usb</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>pci</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>scsi</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='capsType'/>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='pciBackend'/>
Aug 01 15:16:01 user nova-compute[72201]:     </hostdev>
Aug 01 15:16:01 user nova-compute[72201]:     <rng supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-non-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='backendModel'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>random</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>egd</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>builtin</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </rng>
Aug 01 15:16:01 user nova-compute[72201]:     <filesystem supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='driverType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>path</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>handle</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtiofs</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </filesystem>
Aug 01 15:16:01 user nova-compute[72201]:     <tpm supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>tpm-tis</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>tpm-crb</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='backendModel'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>passthrough</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>emulator</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </tpm>
Aug 01 15:16:01 user nova-compute[72201]:   </devices>
Aug 01 15:16:01 user nova-compute[72201]:   <features>
Aug 01 15:16:01 user nova-compute[72201]:     <gic supported='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     <vmcoreinfo supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <genid supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <backingStoreInput supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <backup supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <sev supported='no'/>
Aug 01 15:16:01 user nova-compute[72201]:   </features>
Aug 01 15:16:01 user nova-compute[72201]: </domainCapabilities>
Aug 01 15:16:01 user nova-compute[72201]:  {{(pid=72201) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 01 15:16:01 user nova-compute[72201]: <domainCapabilities>
Aug 01 15:16:01 user nova-compute[72201]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 15:16:01 user nova-compute[72201]:   <domain>kvm</domain>
Aug 01 15:16:01 user nova-compute[72201]:   <machine>pc-q35-jammy</machine>
Aug 01 15:16:01 user nova-compute[72201]:   <arch>x86_64</arch>
Aug 01 15:16:01 user nova-compute[72201]:   <vcpu max='288'/>
Aug 01 15:16:01 user nova-compute[72201]:   <iothreads supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:   <os supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:     <enum name='firmware'>
Aug 01 15:16:01 user nova-compute[72201]:       <value>efi</value>
Aug 01 15:16:01 user nova-compute[72201]:     </enum>
Aug 01 15:16:01 user nova-compute[72201]:     <loader supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='type'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>rom</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>pflash</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='readonly'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>yes</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>no</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='secure'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>yes</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>no</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </loader>
Aug 01 15:16:01 user nova-compute[72201]:   </os>
Aug 01 15:16:01 user nova-compute[72201]:   <cpu>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='host-passthrough' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='hostPassthroughMigratable'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>on</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>off</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='maximum' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='maximumMigratable'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>on</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>off</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='host-model' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <vendor>Intel</vendor>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ss'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='vmx'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='pcid'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='hypervisor'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='arat'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='umip'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='md-clear'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='stibp'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ssbd'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='invtsc'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ibpb'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ibrs'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='amd-stibp'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='rsba'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='disable' name='erms'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='custom' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>qemu64</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>qemu32</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>phenom</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium3</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium2</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>n270</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>kvm64</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>kvm32</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>coreduo</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>core2duo</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>athlon</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Westmere</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Snowridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>SandyBridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Penryn</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G5</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G4</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G3</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G2</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Opteron_G1</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Nehalem</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>IvyBridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Icelake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-Rome</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-Milan</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Dhyana</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cooperlake</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Conroe</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>486</model>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:   </cpu>
Aug 01 15:16:01 user nova-compute[72201]:   <memoryBacking supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:     <enum name='sourceType'>
Aug 01 15:16:01 user nova-compute[72201]:       <value>file</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>anonymous</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>memfd</value>
Aug 01 15:16:01 user nova-compute[72201]:     </enum>
Aug 01 15:16:01 user nova-compute[72201]:   </memoryBacking>
Aug 01 15:16:01 user nova-compute[72201]:   <devices>
Aug 01 15:16:01 user nova-compute[72201]:     <disk supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='diskDevice'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>disk</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>cdrom</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>floppy</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>lun</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='bus'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>fdc</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>scsi</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>usb</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>sata</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-non-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </disk>
Aug 01 15:16:01 user nova-compute[72201]:     <graphics supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='type'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>sdl</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vnc</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>spice</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>egl-headless</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </graphics>
Aug 01 15:16:01 user nova-compute[72201]:     <video supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='modelType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vga</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>cirrus</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vmvga</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>qxl</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>none</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>bochs</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>ramfb</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </video>
Aug 01 15:16:01 user nova-compute[72201]:     <hostdev supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='mode'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>subsystem</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='startupPolicy'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>default</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>mandatory</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>requisite</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>optional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='subsysType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>usb</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>pci</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>scsi</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='capsType'/>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='pciBackend'/>
Aug 01 15:16:01 user nova-compute[72201]:     </hostdev>
Aug 01 15:16:01 user nova-compute[72201]:     <rng supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-non-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='backendModel'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>random</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>egd</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>builtin</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </rng>
Aug 01 15:16:01 user nova-compute[72201]:     <filesystem supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='driverType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>path</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>handle</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtiofs</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </filesystem>
Aug 01 15:16:01 user nova-compute[72201]:     <tpm supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>tpm-tis</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>tpm-crb</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='backendModel'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>passthrough</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>emulator</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </tpm>
Aug 01 15:16:01 user nova-compute[72201]:   </devices>
Aug 01 15:16:01 user nova-compute[72201]:   <features>
Aug 01 15:16:01 user nova-compute[72201]:     <gic supported='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     <vmcoreinfo supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <genid supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <backingStoreInput supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <backup supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <sev supported='no'/>
Aug 01 15:16:01 user nova-compute[72201]:   </features>
Aug 01 15:16:01 user nova-compute[72201]: </domainCapabilities>
Aug 01 15:16:01 user nova-compute[72201]:  {{(pid=72201) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 01 15:16:01 user nova-compute[72201]: <domainCapabilities>
Aug 01 15:16:01 user nova-compute[72201]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 15:16:01 user nova-compute[72201]:   <domain>kvm</domain>
Aug 01 15:16:01 user nova-compute[72201]:   <machine>pc-i440fx-jammy</machine>
Aug 01 15:16:01 user nova-compute[72201]:   <arch>x86_64</arch>
Aug 01 15:16:01 user nova-compute[72201]:   <vcpu max='255'/>
Aug 01 15:16:01 user nova-compute[72201]:   <iothreads supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:   <os supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:     <enum name='firmware'>
Aug 01 15:16:01 user nova-compute[72201]:       <value>efi</value>
Aug 01 15:16:01 user nova-compute[72201]:     </enum>
Aug 01 15:16:01 user nova-compute[72201]:     <loader supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='type'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>rom</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>pflash</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='readonly'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>yes</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>no</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='secure'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>no</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </loader>
Aug 01 15:16:01 user nova-compute[72201]:   </os>
Aug 01 15:16:01 user nova-compute[72201]:   <cpu>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='host-passthrough' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='hostPassthroughMigratable'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>on</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>off</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='maximum' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='maximumMigratable'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>on</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>off</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='host-model' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <vendor>Intel</vendor>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ss'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='vmx'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='pcid'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='hypervisor'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='arat'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='umip'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='md-clear'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='stibp'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ssbd'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='invtsc'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ibpb'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='ibrs'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='amd-stibp'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='rsba'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='disable' name='erms'/>
Aug 01 15:16:01 user nova-compute[72201]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:     <mode name='custom' supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>qemu64</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>qemu32</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>phenom</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium3</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium2</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>pentium</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>n270</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>kvm64</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>kvm32</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>coreduo</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>core2duo</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>athlon</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Westmere</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Snowridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Skylake-Client</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>SandyBridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Penryn</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G5</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G4</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G3</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Opteron_G2</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Opteron_G1</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Nehalem</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>IvyBridge</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Icelake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Haswell</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-Rome</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-Milan</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>EPYC</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Dhyana</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cooperlake</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>Conroe</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='no'>Broadwell</model>
Aug 01 15:16:01 user nova-compute[72201]:       <model usable='yes'>486</model>
Aug 01 15:16:01 user nova-compute[72201]:     </mode>
Aug 01 15:16:01 user nova-compute[72201]:   </cpu>
Aug 01 15:16:01 user nova-compute[72201]:   <memoryBacking supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:     <enum name='sourceType'>
Aug 01 15:16:01 user nova-compute[72201]:       <value>file</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>anonymous</value>
Aug 01 15:16:01 user nova-compute[72201]:       <value>memfd</value>
Aug 01 15:16:01 user nova-compute[72201]:     </enum>
Aug 01 15:16:01 user nova-compute[72201]:   </memoryBacking>
Aug 01 15:16:01 user nova-compute[72201]:   <devices>
Aug 01 15:16:01 user nova-compute[72201]:     <disk supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='diskDevice'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>disk</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>cdrom</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>floppy</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>lun</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='bus'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>ide</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>fdc</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>scsi</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>usb</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>sata</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-non-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </disk>
Aug 01 15:16:01 user nova-compute[72201]:     <graphics supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='type'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>sdl</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vnc</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>spice</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>egl-headless</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </graphics>
Aug 01 15:16:01 user nova-compute[72201]:     <video supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='modelType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vga</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>cirrus</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>vmvga</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>qxl</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>none</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>bochs</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>ramfb</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </video>
Aug 01 15:16:01 user nova-compute[72201]:     <hostdev supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='mode'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>subsystem</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='startupPolicy'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>default</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>mandatory</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>requisite</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>optional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='subsysType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>usb</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>pci</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>scsi</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='capsType'/>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='pciBackend'/>
Aug 01 15:16:01 user nova-compute[72201]:     </hostdev>
Aug 01 15:16:01 user nova-compute[72201]:     <rng supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtio-non-transitional</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='backendModel'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>random</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>egd</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>builtin</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </rng>
Aug 01 15:16:01 user nova-compute[72201]:     <filesystem supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='driverType'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>path</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>handle</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>virtiofs</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </filesystem>
Aug 01 15:16:01 user nova-compute[72201]:     <tpm supported='yes'>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='model'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>tpm-tis</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>tpm-crb</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:       <enum name='backendModel'>
Aug 01 15:16:01 user nova-compute[72201]:         <value>passthrough</value>
Aug 01 15:16:01 user nova-compute[72201]:         <value>emulator</value>
Aug 01 15:16:01 user nova-compute[72201]:       </enum>
Aug 01 15:16:01 user nova-compute[72201]:     </tpm>
Aug 01 15:16:01 user nova-compute[72201]:   </devices>
Aug 01 15:16:01 user nova-compute[72201]:   <features>
Aug 01 15:16:01 user nova-compute[72201]:     <gic supported='no'/>
Aug 01 15:16:01 user nova-compute[72201]:     <vmcoreinfo supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <genid supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <backingStoreInput supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <backup supported='yes'/>
Aug 01 15:16:01 user nova-compute[72201]:     <sev supported='no'/>
Aug 01 15:16:01 user nova-compute[72201]:   </features>
Aug 01 15:16:01 user nova-compute[72201]: </domainCapabilities>
Aug 01 15:16:01 user nova-compute[72201]:  {{(pid=72201) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72201) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72201) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Checking secure boot support for host arch (x86_64) {{(pid=72201) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Checking secure boot support for host arch (x86_64) {{(pid=72201) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Checking secure boot support for host arch (x86_64) {{(pid=72201) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 01 15:16:01 user nova-compute[72201]: INFO nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Secure Boot support detected
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] cpu compare xml: <cpu match="exact">
Aug 01 15:16:01 user nova-compute[72201]:   <model>Nehalem</model>
Aug 01 15:16:01 user nova-compute[72201]: </cpu>
Aug 01 15:16:01 user nova-compute[72201]:  {{(pid=72201) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 01 15:16:01 user nova-compute[72201]: INFO nova.virt.node [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Generated node identity 4ad5f056-b591-413c-b5b7-aab61bc138ae
Aug 01 15:16:01 user nova-compute[72201]: INFO nova.virt.node [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Wrote node identity 4ad5f056-b591-413c-b5b7-aab61bc138ae to /opt/stack/data/nova/compute_id
Aug 01 15:16:01 user nova-compute[72201]: WARNING nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Compute nodes ['4ad5f056-b591-413c-b5b7-aab61bc138ae'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 01 15:16:01 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 01 15:16:01 user nova-compute[72201]: WARNING nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 01 15:16:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:16:01 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:16:01 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:16:01 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Hypervisor/Node resource view: name=user free_ram=10893MB free_disk=26.310039520263672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:16:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:16:01 user nova-compute[72201]: WARNING nova.compute.resource_tracker [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] No compute node record for user:4ad5f056-b591-413c-b5b7-aab61bc138ae: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 4ad5f056-b591-413c-b5b7-aab61bc138ae could not be found.
Aug 01 15:16:01 user nova-compute[72201]: INFO nova.compute.resource_tracker [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Compute node record created for user:user with uuid: 4ad5f056-b591-413c-b5b7-aab61bc138ae
Aug 01 15:16:02 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:16:02 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:16:02 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [req-d94e09a4-2cc7-4bf2-8568-b27275e33e22] Created resource provider record via placement API for resource provider with UUID 4ad5f056-b591-413c-b5b7-aab61bc138ae and name user.
Aug 01 15:16:02 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72201) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 01 15:16:02 user nova-compute[72201]: INFO nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] kernel doesn't support AMD SEV
Aug 01 15:16:02 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Updating inventory in ProviderTree for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 15:16:02 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:16:02 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Libvirt baseline CPU <cpu>
Aug 01 15:16:02 user nova-compute[72201]:   <arch>x86_64</arch>
Aug 01 15:16:02 user nova-compute[72201]:   <model>Nehalem</model>
Aug 01 15:16:02 user nova-compute[72201]:   <vendor>Intel</vendor>
Aug 01 15:16:02 user nova-compute[72201]:   <topology sockets="6" cores="1" threads="1"/>
Aug 01 15:16:02 user nova-compute[72201]: </cpu>
Aug 01 15:16:02 user nova-compute[72201]:  {{(pid=72201) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 01 15:16:02 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Updated inventory for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 01 15:16:02 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Updating resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae generation from 0 to 1 during operation: update_inventory {{(pid=72201) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 01 15:16:02 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Updating inventory in ProviderTree for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 15:16:02 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Updating resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae generation from 1 to 2 during operation: update_traits {{(pid=72201) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 01 15:16:02 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:16:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.743s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:16:02 user nova-compute[72201]: DEBUG nova.service [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Creating RPC server for service compute {{(pid=72201) start /opt/stack/nova/nova/service.py:182}}
Aug 01 15:16:02 user nova-compute[72201]: DEBUG nova.service [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Join ServiceGroup membership for this service compute {{(pid=72201) start /opt/stack/nova/nova/service.py:199}}
Aug 01 15:16:02 user nova-compute[72201]: DEBUG nova.servicegroup.drivers.db [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72201) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 01 15:16:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:16:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Didn't find any instances for network info cache update. {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:16:53 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:16:53 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:16:53 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=10282MB free_disk=26.213748931884766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:16:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:17:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:17:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:17:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:17:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:17:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:17:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:17:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:17:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:17:53 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:17:53 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:17:53 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:17:53 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=10225MB free_disk=26.25958251953125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:17:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:17:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:17:54 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:17:54 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:17:54 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:17:54 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:17:54 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:17:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:17:54 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:17:54 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:17:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:17:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 15:17:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Didn't find any instances for network info cache update. {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 15:17:54 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:17:54 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:17:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:17:55 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:18:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:18:54 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:18:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:18:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 15:18:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Didn't find any instances for network info cache update. {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 15:18:54 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:18:55 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:18:55 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:18:55 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:18:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:18:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:18:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:18:55 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:18:55 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:18:55 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:18:55 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=10254MB free_disk=26.032855987548828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:18:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:18:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:18:55 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:18:55 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:18:55 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:18:55 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:18:55 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:18:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:18:56 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:18:56 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:18:56 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:18:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:19:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:19:54 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:19:55 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:19:56 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:19:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:19:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 15:19:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Didn't find any instances for network info cache update. {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 15:19:56 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:19:56 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:19:56 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:19:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:19:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:19:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:19:56 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:19:56 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:19:56 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:19:56 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=9458MB free_disk=26.055217742919922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:19:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:19:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:19:56 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:19:56 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:19:56 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:19:56 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:19:56 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:19:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:19:57 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:19:57 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:19:58 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:19:58 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:19:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Acquiring lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:19:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:19:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:19:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:19:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:19:59 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:19:59 user nova-compute[72201]: INFO nova.compute.claims [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Claim successful on node user
Aug 01 15:19:59 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:19:59 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:19:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:19:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:19:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:19:59 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:19:59 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:19:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:19:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:20:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:20:00 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Creating image(s)
Aug 01 15:20:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Acquiring lock "/opt/stack/data/nova/instances/54cee809-6ad0-4a16-85cd-ebf8ef683bbe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "/opt/stack/data/nova/instances/54cee809-6ad0-4a16-85cd-ebf8ef683bbe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "/opt/stack/data/nova/instances/54cee809-6ad0-4a16-85cd-ebf8ef683bbe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba.part --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba.part --force-share --output=json" returned: 0 in 0.184s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:01 user nova-compute[72201]: DEBUG nova.virt.images [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] 73af296a-4f5f-49df-a90d-46b9fdcd9a3f was qcow2, converting to raw {{(pid=72201) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 15:20:01 user nova-compute[72201]: DEBUG nova.privsep.utils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72201) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 15:20:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba.part /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba.converted {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:01 user nova-compute[72201]: DEBUG nova.policy [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '20231bd439f44da69e66c8c467114f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d83c3cd9b64a3d8cb45c3f0d0fb02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:20:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba.part /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba.converted" returned: 0 in 0.602s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba.converted --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.812s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:01 user nova-compute[72201]: INFO oslo.privsep.daemon [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpp2byb621/privsep.sock']
Aug 01 15:20:01 user sudo[81339]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpp2byb621/privsep.sock
Aug 01 15:20:01 user sudo[81339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 15:20:03 user sudo[81339]: pam_unix(sudo:session): session closed for user root
Aug 01 15:20:03 user nova-compute[72201]: INFO oslo.privsep.daemon [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Spawned new privsep daemon via rootwrap
Aug 01 15:20:03 user nova-compute[72201]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 15:20:03 user nova-compute[72201]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 15:20:03 user nova-compute[72201]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 01 15:20:03 user nova-compute[72201]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81347
Aug 01 15:20:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.148s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.144s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/54cee809-6ad0-4a16-85cd-ebf8ef683bbe/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/54cee809-6ad0-4a16-85cd-ebf8ef683bbe/disk 1073741824" returned: 0 in 0.050s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:04 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Checking if we can resize image /opt/stack/data/nova/instances/54cee809-6ad0-4a16-85cd-ebf8ef683bbe/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:20:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54cee809-6ad0-4a16-85cd-ebf8ef683bbe/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54cee809-6ad0-4a16-85cd-ebf8ef683bbe/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:04 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Cannot resize image /opt/stack/data/nova/instances/54cee809-6ad0-4a16-85cd-ebf8ef683bbe/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:20:04 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lazy-loading 'migration_context' on Instance uuid 54cee809-6ad0-4a16-85cd-ebf8ef683bbe {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:20:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:20:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Ensure instance console log exists: /opt/stack/data/nova/instances/54cee809-6ad0-4a16-85cd-ebf8ef683bbe/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:20:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:06 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Successfully created port: c3a09866-55a9-407c-b2d9-7883a411a246 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:20:10 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Successfully updated port: c3a09866-55a9-407c-b2d9-7883a411a246 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:20:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Acquiring lock "refresh_cache-54cee809-6ad0-4a16-85cd-ebf8ef683bbe" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:20:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Acquired lock "refresh_cache-54cee809-6ad0-4a16-85cd-ebf8ef683bbe" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:20:10 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:20:10 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:20:10 user nova-compute[72201]: DEBUG nova.compute.manager [req-a2b7f458-bc0b-4c01-bfd9-828eb35bf413 req-e64f48e5-b088-4a3e-b714-8752bbab6507 service nova] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Received event network-changed-c3a09866-55a9-407c-b2d9-7883a411a246 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:10 user nova-compute[72201]: DEBUG nova.compute.manager [req-a2b7f458-bc0b-4c01-bfd9-828eb35bf413 req-e64f48e5-b088-4a3e-b714-8752bbab6507 service nova] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Refreshing instance network info cache due to event network-changed-c3a09866-55a9-407c-b2d9-7883a411a246. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:20:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a2b7f458-bc0b-4c01-bfd9-828eb35bf413 req-e64f48e5-b088-4a3e-b714-8752bbab6507 service nova] Acquiring lock "refresh_cache-54cee809-6ad0-4a16-85cd-ebf8ef683bbe" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:20:11 user nova-compute[72201]: INFO nova.compute.claims [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Claim successful on node user
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.network.neutron [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:20:11 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Updating instance_info_cache with network_info: [{"id": "c3a09866-55a9-407c-b2d9-7883a411a246", "address": "fa:16:3e:f4:62:2d", "network": {"id": "c773bb9f-5601-48bd-9c67-638c0380bb5b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-340882723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4d83c3cd9b64a3d8cb45c3f0d0fb02b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a09866-55", "ovs_interfaceid": "c3a09866-55a9-407c-b2d9-7883a411a246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Releasing lock "refresh_cache-54cee809-6ad0-4a16-85cd-ebf8ef683bbe" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Instance network_info: |[{"id": "c3a09866-55a9-407c-b2d9-7883a411a246", "address": "fa:16:3e:f4:62:2d", "network": {"id": "c773bb9f-5601-48bd-9c67-638c0380bb5b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-340882723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4d83c3cd9b64a3d8cb45c3f0d0fb02b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a09866-55", "ovs_interfaceid": "c3a09866-55a9-407c-b2d9-7883a411a246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a2b7f458-bc0b-4c01-bfd9-828eb35bf413 req-e64f48e5-b088-4a3e-b714-8752bbab6507 service nova] Acquired lock "refresh_cache-54cee809-6ad0-4a16-85cd-ebf8ef683bbe" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.network.neutron [req-a2b7f458-bc0b-4c01-bfd9-828eb35bf413 req-e64f48e5-b088-4a3e-b714-8752bbab6507 service nova] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Refreshing network info cache for port c3a09866-55a9-407c-b2d9-7883a411a246 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Start _get_guest_xml network_info=[{"id": "c3a09866-55a9-407c-b2d9-7883a411a246", "address": "fa:16:3e:f4:62:2d", "network": {"id": "c773bb9f-5601-48bd-9c67-638c0380bb5b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-340882723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4d83c3cd9b64a3d8cb45c3f0d0fb02b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a09866-55", "ovs_interfaceid": "c3a09866-55a9-407c-b2d9-7883a411a246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:20:11 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:20:11 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.privsep.utils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72201) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:19:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-901535866',display_name='tempest-DeleteServersTestJSON-server-901535866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-901535866',id=1,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4d83c3cd9b64a3d8cb45c3f0d0fb02b',ramdisk_id='',reservation_id='r-7jj7zris',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-565141156',owner_user_name='tempest-DeleteServersTestJSON-565141156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:20:00Z,user_data=None,user_id='20231bd439f44da69e66c8c467114f0b',uuid=54cee809-6ad0-4a16-85cd-ebf8ef683bbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3a09866-55a9-407c-b2d9-7883a411a246", "address": "fa:16:3e:f4:62:2d", "network": {"id": "c773bb9f-5601-48bd-9c67-638c0380bb5b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-340882723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4d83c3cd9b64a3d8cb45c3f0d0fb02b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a09866-55", "ovs_interfaceid": "c3a09866-55a9-407c-b2d9-7883a411a246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Converting VIF {"id": "c3a09866-55a9-407c-b2d9-7883a411a246", "address": "fa:16:3e:f4:62:2d", "network": {"id": "c773bb9f-5601-48bd-9c67-638c0380bb5b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-340882723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4d83c3cd9b64a3d8cb45c3f0d0fb02b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a09866-55", "ovs_interfaceid": "c3a09866-55a9-407c-b2d9-7883a411a246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:62:2d,bridge_name='br-int',has_traffic_filtering=True,id=c3a09866-55a9-407c-b2d9-7883a411a246,network=Network(c773bb9f-5601-48bd-9c67-638c0380bb5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a09866-55') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lazy-loading 'pci_devices' on Instance uuid 54cee809-6ad0-4a16-85cd-ebf8ef683bbe {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:20:11 user nova-compute[72201]:   <uuid>54cee809-6ad0-4a16-85cd-ebf8ef683bbe</uuid>
Aug 01 15:20:11 user nova-compute[72201]:   <name>instance-00000001</name>
Aug 01 15:20:11 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:20:11 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:20:11 user nova-compute[72201]:   <metadata>
Aug 01 15:20:11 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:20:11 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:20:11 user nova-compute[72201]:       <nova:name>tempest-DeleteServersTestJSON-server-901535866</nova:name>
Aug 01 15:20:11 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:20:11</nova:creationTime>
Aug 01 15:20:11 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:20:11 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:20:11 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:20:11 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:20:11 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:20:11 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:20:11 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:20:11 user nova-compute[72201]:       <nova:owner>
Aug 01 15:20:11 user nova-compute[72201]:         <nova:user uuid="20231bd439f44da69e66c8c467114f0b">tempest-DeleteServersTestJSON-565141156-project-member</nova:user>
Aug 01 15:20:11 user nova-compute[72201]:         <nova:project uuid="b4d83c3cd9b64a3d8cb45c3f0d0fb02b">tempest-DeleteServersTestJSON-565141156</nova:project>
Aug 01 15:20:11 user nova-compute[72201]:       </nova:owner>
Aug 01 15:20:11 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:20:11 user nova-compute[72201]:       <nova:ports>
Aug 01 15:20:11 user nova-compute[72201]:         <nova:port uuid="c3a09866-55a9-407c-b2d9-7883a411a246">
Aug 01 15:20:11 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 15:20:11 user nova-compute[72201]:         </nova:port>
Aug 01 15:20:11 user nova-compute[72201]:       </nova:ports>
Aug 01 15:20:11 user nova-compute[72201]:     </nova:instance>
Aug 01 15:20:11 user nova-compute[72201]:   </metadata>
Aug 01 15:20:11 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:20:11 user nova-compute[72201]:     <system>
Aug 01 15:20:11 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:20:11 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:20:11 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:20:11 user nova-compute[72201]:       <entry name="serial">54cee809-6ad0-4a16-85cd-ebf8ef683bbe</entry>
Aug 01 15:20:11 user nova-compute[72201]:       <entry name="uuid">54cee809-6ad0-4a16-85cd-ebf8ef683bbe</entry>
Aug 01 15:20:11 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:20:11 user nova-compute[72201]:     </system>
Aug 01 15:20:11 user nova-compute[72201]:   </sysinfo>
Aug 01 15:20:11 user nova-compute[72201]:   <os>
Aug 01 15:20:11 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:20:11 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:20:11 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:20:11 user nova-compute[72201]:   </os>
Aug 01 15:20:11 user nova-compute[72201]:   <features>
Aug 01 15:20:11 user nova-compute[72201]:     <acpi/>
Aug 01 15:20:11 user nova-compute[72201]:     <apic/>
Aug 01 15:20:11 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:20:11 user nova-compute[72201]:   </features>
Aug 01 15:20:11 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:20:11 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:20:11 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:20:11 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:20:11 user nova-compute[72201]:   </clock>
Aug 01 15:20:11 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:20:11 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:20:11 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:20:11 user nova-compute[72201]:   </cpu>
Aug 01 15:20:11 user nova-compute[72201]:   <devices>
Aug 01 15:20:11 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:20:11 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:20:11 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/54cee809-6ad0-4a16-85cd-ebf8ef683bbe/disk"/>
Aug 01 15:20:11 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:20:11 user nova-compute[72201]:     </disk>
Aug 01 15:20:11 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:20:11 user nova-compute[72201]:       <mac address="fa:16:3e:f4:62:2d"/>
Aug 01 15:20:11 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:20:11 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:20:11 user nova-compute[72201]:       <target dev="tapc3a09866-55"/>
Aug 01 15:20:11 user nova-compute[72201]:     </interface>
Aug 01 15:20:11 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:20:11 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/54cee809-6ad0-4a16-85cd-ebf8ef683bbe/console.log" append="off"/>
Aug 01 15:20:11 user nova-compute[72201]:     </serial>
Aug 01 15:20:11 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:20:11 user nova-compute[72201]:     <video>
Aug 01 15:20:11 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:20:11 user nova-compute[72201]:     </video>
Aug 01 15:20:11 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:20:11 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:20:11 user nova-compute[72201]:     </rng>
Aug 01 15:20:11 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:20:11 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:20:11 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:20:11 user nova-compute[72201]:     </memballoon>
Aug 01 15:20:11 user nova-compute[72201]:   </devices>
Aug 01 15:20:11 user nova-compute[72201]: </domain>
Aug 01 15:20:11 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:19:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-901535866',display_name='tempest-DeleteServersTestJSON-server-901535866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-901535866',id=1,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4d83c3cd9b64a3d8cb45c3f0d0fb02b',ramdisk_id='',reservation_id='r-7jj7zris',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-565141156',owner_user_name='tempest-DeleteServersTestJSON-565141156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:20:00Z,user_data=None,user_id='20231bd439f44da69e66c8c467114f0b',uuid=54cee809-6ad0-4a16-85cd-ebf8ef683bbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3a09866-55a9-407c-b2d9-7883a411a246", "address": "fa:16:3e:f4:62:2d", "network": {"id": "c773bb9f-5601-48bd-9c67-638c0380bb5b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-340882723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4d83c3cd9b64a3d8cb45c3f0d0fb02b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a09866-55", "ovs_interfaceid": "c3a09866-55a9-407c-b2d9-7883a411a246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Converting VIF {"id": "c3a09866-55a9-407c-b2d9-7883a411a246", "address": "fa:16:3e:f4:62:2d", "network": {"id": "c773bb9f-5601-48bd-9c67-638c0380bb5b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-340882723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4d83c3cd9b64a3d8cb45c3f0d0fb02b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a09866-55", "ovs_interfaceid": "c3a09866-55a9-407c-b2d9-7883a411a246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:62:2d,bridge_name='br-int',has_traffic_filtering=True,id=c3a09866-55a9-407c-b2d9-7883a411a246,network=Network(c773bb9f-5601-48bd-9c67-638c0380bb5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a09866-55') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:20:11 user nova-compute[72201]: DEBUG os_vif [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:62:2d,bridge_name='br-int',has_traffic_filtering=True,id=c3a09866-55a9-407c-b2d9-7883a411a246,network=Network(c773bb9f-5601-48bd-9c67-638c0380bb5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a09866-55') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Created schema index Interface.name {{(pid=72201) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Created schema index Port.name {{(pid=72201) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Created schema index Bridge.name {{(pid=72201) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [POLLOUT] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "e2ca19ea-868c-40ad-a453-f6e348cfac15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG nova.policy [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31a432c1165e4ff4a9a10b4d71ddc513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f130c48f19cf4ab7803c1169b759ccb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:20:12 user nova-compute[72201]: INFO oslo.privsep.daemon [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp9ta_pyyu/privsep.sock']
Aug 01 15:20:12 user sudo[81382]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp9ta_pyyu/privsep.sock
Aug 01 15:20:12 user sudo[81382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 15:20:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:20:12 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Creating image(s)
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "/opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "/opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "/opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:20:12 user nova-compute[72201]: INFO nova.compute.claims [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Claim successful on node user
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.157s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.146s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk 1073741824" returned: 0 in 0.048s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.146s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Cannot resize image /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG nova.objects.instance [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'migration_context' on Instance uuid b64f1cfb-64f2-4493-8721-fc63fcd93bb6 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Ensure instance console log exists: /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:20:12 user nova-compute[72201]: DEBUG nova.network.neutron [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:20:13 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:20:13 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:20:13 user nova-compute[72201]: INFO nova.compute.claims [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Claim successful on node user
Aug 01 15:20:13 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:20:13 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Creating image(s)
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "/opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "/opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.132s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG nova.policy [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ccd18b99219749fe8febdc0da8fc4388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85c7d5f159c4ff2896b5549cf73b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.127s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk 1073741824" returned: 0 in 0.054s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:20:13 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:20:13 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.129s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:20:13 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Creating image(s)
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "/opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "/opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Cannot resize image /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG nova.objects.instance [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lazy-loading 'migration_context' on Instance uuid e2ca19ea-868c-40ad-a453-f6e348cfac15 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Ensure instance console log exists: /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG nova.policy [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31a432c1165e4ff4a9a10b4d71ddc513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f130c48f19cf4ab7803c1169b759ccb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:20:13 user sudo[81382]: pam_unix(sudo:session): session closed for user root
Aug 01 15:20:13 user nova-compute[72201]: INFO oslo.privsep.daemon [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Spawned new privsep daemon via rootwrap
Aug 01 15:20:13 user nova-compute[72201]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 15:20:13 user nova-compute[72201]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 15:20:13 user nova-compute[72201]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 01 15:20:13 user nova-compute[72201]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81411
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.150s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG nova.network.neutron [req-a2b7f458-bc0b-4c01-bfd9-828eb35bf413 req-e64f48e5-b088-4a3e-b714-8752bbab6507 service nova] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Updated VIF entry in instance network info cache for port c3a09866-55a9-407c-b2d9-7883a411a246. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG nova.network.neutron [req-a2b7f458-bc0b-4c01-bfd9-828eb35bf413 req-e64f48e5-b088-4a3e-b714-8752bbab6507 service nova] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Updating instance_info_cache with network_info: [{"id": "c3a09866-55a9-407c-b2d9-7883a411a246", "address": "fa:16:3e:f4:62:2d", "network": {"id": "c773bb9f-5601-48bd-9c67-638c0380bb5b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-340882723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4d83c3cd9b64a3d8cb45c3f0d0fb02b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a09866-55", "ovs_interfaceid": "c3a09866-55a9-407c-b2d9-7883a411a246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:20:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a2b7f458-bc0b-4c01-bfd9-828eb35bf413 req-e64f48e5-b088-4a3e-b714-8752bbab6507 service nova] Releasing lock "refresh_cache-54cee809-6ad0-4a16-85cd-ebf8ef683bbe" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.129s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk 1073741824" returned: 0 in 0.058s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG nova.network.neutron [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Successfully created port: ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Cannot resize image /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'migration_context' on Instance uuid 0f059ccc-f609-4cf3-a644-c3d1305ae26e {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3a09866-55, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc3a09866-55, col_values=(('external_ids', {'iface-id': 'c3a09866-55a9-407c-b2d9-7883a411a246', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:62:2d', 'vm-uuid': '54cee809-6ad0-4a16-85cd-ebf8ef683bbe'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Ensure instance console log exists: /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:14 user nova-compute[72201]: INFO os_vif [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:62:2d,bridge_name='br-int',has_traffic_filtering=True,id=c3a09866-55a9-407c-b2d9-7883a411a246,network=Network(c773bb9f-5601-48bd-9c67-638c0380bb5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a09866-55')
Aug 01 15:20:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] No VIF found with MAC fa:16:3e:f4:62:2d, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:20:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:15 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Successfully created port: eb1fc053-fd35-4b5e-a557-4be5052de15d {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:20:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-b5dd54b4-b63c-4afc-9769-b4464694a2d3 req-8e14c466-68a1-422f-932e-001f6f29fac2 service nova] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Received event network-vif-plugged-c3a09866-55a9-407c-b2d9-7883a411a246 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b5dd54b4-b63c-4afc-9769-b4464694a2d3 req-8e14c466-68a1-422f-932e-001f6f29fac2 service nova] Acquiring lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b5dd54b4-b63c-4afc-9769-b4464694a2d3 req-8e14c466-68a1-422f-932e-001f6f29fac2 service nova] Lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b5dd54b4-b63c-4afc-9769-b4464694a2d3 req-8e14c466-68a1-422f-932e-001f6f29fac2 service nova] Lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-b5dd54b4-b63c-4afc-9769-b4464694a2d3 req-8e14c466-68a1-422f-932e-001f6f29fac2 service nova] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] No waiting events found dispatching network-vif-plugged-c3a09866-55a9-407c-b2d9-7883a411a246 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:20:16 user nova-compute[72201]: WARNING nova.compute.manager [req-b5dd54b4-b63c-4afc-9769-b4464694a2d3 req-8e14c466-68a1-422f-932e-001f6f29fac2 service nova] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Received unexpected event network-vif-plugged-c3a09866-55a9-407c-b2d9-7883a411a246 for instance with vm_state building and task_state spawning.
Aug 01 15:20:17 user nova-compute[72201]: DEBUG nova.network.neutron [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Successfully created port: bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:20:17 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903217.5109537, 54cee809-6ad0-4a16-85cd-ebf8ef683bbe => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:20:17 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] VM Resumed (Lifecycle Event)
Aug 01 15:20:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:20:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:20:17 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Instance spawned successfully.
Aug 01 15:20:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:20:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:20:17 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:20:17 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903217.5169866, 54cee809-6ad0-4a16-85cd-ebf8ef683bbe => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:20:17 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] VM Started (Lifecycle Event)
Aug 01 15:20:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:20:17 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:20:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:17 user nova-compute[72201]: INFO nova.compute.manager [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Took 17.92 seconds to spawn the instance on the hypervisor.
Aug 01 15:20:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:18 user nova-compute[72201]: INFO nova.compute.manager [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Took 18.85 seconds to build instance.
Aug 01 15:20:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a60a46c9-f85d-41dd-bf9c-2c92f2651d80 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.064s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:18 user nova-compute[72201]: DEBUG nova.network.neutron [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Successfully updated port: ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:20:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "refresh_cache-b64f1cfb-64f2-4493-8721-fc63fcd93bb6" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:20:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquired lock "refresh_cache-b64f1cfb-64f2-4493-8721-fc63fcd93bb6" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:20:18 user nova-compute[72201]: DEBUG nova.network.neutron [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:20:18 user nova-compute[72201]: DEBUG nova.network.neutron [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:20:18 user nova-compute[72201]: DEBUG nova.compute.manager [req-5255643b-fa55-4145-ad4c-c66eedfd793f req-397dd681-b562-4ca7-90da-d290fb57329a service nova] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Received event network-vif-plugged-c3a09866-55a9-407c-b2d9-7883a411a246 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5255643b-fa55-4145-ad4c-c66eedfd793f req-397dd681-b562-4ca7-90da-d290fb57329a service nova] Acquiring lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5255643b-fa55-4145-ad4c-c66eedfd793f req-397dd681-b562-4ca7-90da-d290fb57329a service nova] Lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5255643b-fa55-4145-ad4c-c66eedfd793f req-397dd681-b562-4ca7-90da-d290fb57329a service nova] Lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:18 user nova-compute[72201]: DEBUG nova.compute.manager [req-5255643b-fa55-4145-ad4c-c66eedfd793f req-397dd681-b562-4ca7-90da-d290fb57329a service nova] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] No waiting events found dispatching network-vif-plugged-c3a09866-55a9-407c-b2d9-7883a411a246 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:20:18 user nova-compute[72201]: WARNING nova.compute.manager [req-5255643b-fa55-4145-ad4c-c66eedfd793f req-397dd681-b562-4ca7-90da-d290fb57329a service nova] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Received unexpected event network-vif-plugged-c3a09866-55a9-407c-b2d9-7883a411a246 for instance with vm_state active and task_state None.
Aug 01 15:20:18 user nova-compute[72201]: DEBUG nova.compute.manager [req-5255643b-fa55-4145-ad4c-c66eedfd793f req-397dd681-b562-4ca7-90da-d290fb57329a service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received event network-changed-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:18 user nova-compute[72201]: DEBUG nova.compute.manager [req-5255643b-fa55-4145-ad4c-c66eedfd793f req-397dd681-b562-4ca7-90da-d290fb57329a service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Refreshing instance network info cache due to event network-changed-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:20:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5255643b-fa55-4145-ad4c-c66eedfd793f req-397dd681-b562-4ca7-90da-d290fb57329a service nova] Acquiring lock "refresh_cache-b64f1cfb-64f2-4493-8721-fc63fcd93bb6" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Successfully updated port: eb1fc053-fd35-4b5e-a557-4be5052de15d {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "refresh_cache-0f059ccc-f609-4cf3-a644-c3d1305ae26e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquired lock "refresh_cache-0f059ccc-f609-4cf3-a644-c3d1305ae26e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.network.neutron [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Updating instance_info_cache with network_info: [{"id": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "address": "fa:16:3e:5d:24:e6", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8b84b-6b", "ovs_interfaceid": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Releasing lock "refresh_cache-b64f1cfb-64f2-4493-8721-fc63fcd93bb6" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Instance network_info: |[{"id": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "address": "fa:16:3e:5d:24:e6", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8b84b-6b", "ovs_interfaceid": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5255643b-fa55-4145-ad4c-c66eedfd793f req-397dd681-b562-4ca7-90da-d290fb57329a service nova] Acquired lock "refresh_cache-b64f1cfb-64f2-4493-8721-fc63fcd93bb6" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.network.neutron [req-5255643b-fa55-4145-ad4c-c66eedfd793f req-397dd681-b562-4ca7-90da-d290fb57329a service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Refreshing network info cache for port ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Start _get_guest_xml network_info=[{"id": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "address": "fa:16:3e:5d:24:e6", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8b84b-6b", "ovs_interfaceid": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:20:19 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:20:19 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1810047219',display_name='tempest-ServerRescueNegativeTestJSON-server-1810047219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1810047219',id=2,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f130c48f19cf4ab7803c1169b759ccb6',ramdisk_id='',reservation_id='r-9or02wpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-773079660',owner_user_name='tempest-ServerRescueNegativeTestJSON-773079660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:20:12Z,user_data=None,user_id='31a432c1165e4ff4a9a10b4d71ddc513',uuid=b64f1cfb-64f2-4493-8721-fc63fcd93bb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "address": "fa:16:3e:5d:24:e6", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8b84b-6b", "ovs_interfaceid": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converting VIF {"id": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "address": "fa:16:3e:5d:24:e6", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8b84b-6b", "ovs_interfaceid": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:24:e6,bridge_name='br-int',has_traffic_filtering=True,id=ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc8b84b-6b') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.objects.instance [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'pci_devices' on Instance uuid b64f1cfb-64f2-4493-8721-fc63fcd93bb6 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:20:19 user nova-compute[72201]:   <uuid>b64f1cfb-64f2-4493-8721-fc63fcd93bb6</uuid>
Aug 01 15:20:19 user nova-compute[72201]:   <name>instance-00000002</name>
Aug 01 15:20:19 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:20:19 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:20:19 user nova-compute[72201]:   <metadata>
Aug 01 15:20:19 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:20:19 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:20:19 user nova-compute[72201]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1810047219</nova:name>
Aug 01 15:20:19 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:20:19</nova:creationTime>
Aug 01 15:20:19 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:20:19 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:20:19 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:20:19 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:20:19 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:20:19 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:20:19 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:20:19 user nova-compute[72201]:       <nova:owner>
Aug 01 15:20:19 user nova-compute[72201]:         <nova:user uuid="31a432c1165e4ff4a9a10b4d71ddc513">tempest-ServerRescueNegativeTestJSON-773079660-project-member</nova:user>
Aug 01 15:20:19 user nova-compute[72201]:         <nova:project uuid="f130c48f19cf4ab7803c1169b759ccb6">tempest-ServerRescueNegativeTestJSON-773079660</nova:project>
Aug 01 15:20:19 user nova-compute[72201]:       </nova:owner>
Aug 01 15:20:19 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:20:19 user nova-compute[72201]:       <nova:ports>
Aug 01 15:20:19 user nova-compute[72201]:         <nova:port uuid="ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583">
Aug 01 15:20:19 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 15:20:19 user nova-compute[72201]:         </nova:port>
Aug 01 15:20:19 user nova-compute[72201]:       </nova:ports>
Aug 01 15:20:19 user nova-compute[72201]:     </nova:instance>
Aug 01 15:20:19 user nova-compute[72201]:   </metadata>
Aug 01 15:20:19 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:20:19 user nova-compute[72201]:     <system>
Aug 01 15:20:19 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:20:19 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:20:19 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:20:19 user nova-compute[72201]:       <entry name="serial">b64f1cfb-64f2-4493-8721-fc63fcd93bb6</entry>
Aug 01 15:20:19 user nova-compute[72201]:       <entry name="uuid">b64f1cfb-64f2-4493-8721-fc63fcd93bb6</entry>
Aug 01 15:20:19 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:20:19 user nova-compute[72201]:     </system>
Aug 01 15:20:19 user nova-compute[72201]:   </sysinfo>
Aug 01 15:20:19 user nova-compute[72201]:   <os>
Aug 01 15:20:19 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:20:19 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:20:19 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:20:19 user nova-compute[72201]:   </os>
Aug 01 15:20:19 user nova-compute[72201]:   <features>
Aug 01 15:20:19 user nova-compute[72201]:     <acpi/>
Aug 01 15:20:19 user nova-compute[72201]:     <apic/>
Aug 01 15:20:19 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:20:19 user nova-compute[72201]:   </features>
Aug 01 15:20:19 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:20:19 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:20:19 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:20:19 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:20:19 user nova-compute[72201]:   </clock>
Aug 01 15:20:19 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:20:19 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:20:19 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:20:19 user nova-compute[72201]:   </cpu>
Aug 01 15:20:19 user nova-compute[72201]:   <devices>
Aug 01 15:20:19 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:20:19 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:20:19 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk"/>
Aug 01 15:20:19 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:20:19 user nova-compute[72201]:     </disk>
Aug 01 15:20:19 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:20:19 user nova-compute[72201]:       <mac address="fa:16:3e:5d:24:e6"/>
Aug 01 15:20:19 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:20:19 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:20:19 user nova-compute[72201]:       <target dev="tapebc8b84b-6b"/>
Aug 01 15:20:19 user nova-compute[72201]:     </interface>
Aug 01 15:20:19 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:20:19 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/console.log" append="off"/>
Aug 01 15:20:19 user nova-compute[72201]:     </serial>
Aug 01 15:20:19 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:20:19 user nova-compute[72201]:     <video>
Aug 01 15:20:19 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:20:19 user nova-compute[72201]:     </video>
Aug 01 15:20:19 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:20:19 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:20:19 user nova-compute[72201]:     </rng>
Aug 01 15:20:19 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:20:19 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:20:19 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:20:19 user nova-compute[72201]:     </memballoon>
Aug 01 15:20:19 user nova-compute[72201]:   </devices>
Aug 01 15:20:19 user nova-compute[72201]: </domain>
Aug 01 15:20:19 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1810047219',display_name='tempest-ServerRescueNegativeTestJSON-server-1810047219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1810047219',id=2,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f130c48f19cf4ab7803c1169b759ccb6',ramdisk_id='',reservation_id='r-9or02wpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-773079660',owner_user_name='tempest-ServerRescueNegativeTestJSON-773079660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:20:12Z,user_data=None,user_id='31a432c1165e4ff4a9a10b4d71ddc513',uuid=b64f1cfb-64f2-4493-8721-fc63fcd93bb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "address": "fa:16:3e:5d:24:e6", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8b84b-6b", "ovs_interfaceid": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converting VIF {"id": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "address": "fa:16:3e:5d:24:e6", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8b84b-6b", "ovs_interfaceid": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:24:e6,bridge_name='br-int',has_traffic_filtering=True,id=ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc8b84b-6b') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG os_vif [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:24:e6,bridge_name='br-int',has_traffic_filtering=True,id=ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc8b84b-6b') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebc8b84b-6b, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapebc8b84b-6b, col_values=(('external_ids', {'iface-id': 'ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:24:e6', 'vm-uuid': 'b64f1cfb-64f2-4493-8721-fc63fcd93bb6'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:19 user nova-compute[72201]: INFO os_vif [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:24:e6,bridge_name='br-int',has_traffic_filtering=True,id=ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc8b84b-6b')
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] No VIF found with MAC fa:16:3e:5d:24:e6, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:20:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:20 user nova-compute[72201]: DEBUG nova.compute.manager [req-251a310e-635b-452c-9fb0-0f07760cc586 req-53819b9c-d3c4-403f-91e0-3d5245b8b401 service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Received event network-changed-eb1fc053-fd35-4b5e-a557-4be5052de15d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:20 user nova-compute[72201]: DEBUG nova.compute.manager [req-251a310e-635b-452c-9fb0-0f07760cc586 req-53819b9c-d3c4-403f-91e0-3d5245b8b401 service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Refreshing instance network info cache due to event network-changed-eb1fc053-fd35-4b5e-a557-4be5052de15d. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:20:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-251a310e-635b-452c-9fb0-0f07760cc586 req-53819b9c-d3c4-403f-91e0-3d5245b8b401 service nova] Acquiring lock "refresh_cache-0f059ccc-f609-4cf3-a644-c3d1305ae26e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:20:20 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:20:20 user nova-compute[72201]: DEBUG nova.network.neutron [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Successfully updated port: bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:20:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "refresh_cache-e2ca19ea-868c-40ad-a453-f6e348cfac15" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:20:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquired lock "refresh_cache-e2ca19ea-868c-40ad-a453-f6e348cfac15" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:20:20 user nova-compute[72201]: DEBUG nova.network.neutron [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:20:20 user nova-compute[72201]: DEBUG nova.network.neutron [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:20:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-ee6ed87f-f3fe-4adc-aa46-01670d759726 req-b96ca5f6-aeff-4b23-999c-4f1b3ccfa724 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Received event network-changed-bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-ee6ed87f-f3fe-4adc-aa46-01670d759726 req-b96ca5f6-aeff-4b23-999c-4f1b3ccfa724 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Refreshing instance network info cache due to event network-changed-bc611803-5aa5-4b8b-961b-cd6c43317b21. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:20:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ee6ed87f-f3fe-4adc-aa46-01670d759726 req-b96ca5f6-aeff-4b23-999c-4f1b3ccfa724 service nova] Acquiring lock "refresh_cache-e2ca19ea-868c-40ad-a453-f6e348cfac15" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:20:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:21 user nova-compute[72201]: DEBUG nova.network.neutron [req-5255643b-fa55-4145-ad4c-c66eedfd793f req-397dd681-b562-4ca7-90da-d290fb57329a service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Updated VIF entry in instance network info cache for port ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:20:21 user nova-compute[72201]: DEBUG nova.network.neutron [req-5255643b-fa55-4145-ad4c-c66eedfd793f req-397dd681-b562-4ca7-90da-d290fb57329a service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Updating instance_info_cache with network_info: [{"id": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "address": "fa:16:3e:5d:24:e6", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8b84b-6b", "ovs_interfaceid": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:20:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5255643b-fa55-4145-ad4c-c66eedfd793f req-397dd681-b562-4ca7-90da-d290fb57329a service nova] Releasing lock "refresh_cache-b64f1cfb-64f2-4493-8721-fc63fcd93bb6" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.network.neutron [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Updating instance_info_cache with network_info: [{"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Releasing lock "refresh_cache-e2ca19ea-868c-40ad-a453-f6e348cfac15" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Instance network_info: |[{"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ee6ed87f-f3fe-4adc-aa46-01670d759726 req-b96ca5f6-aeff-4b23-999c-4f1b3ccfa724 service nova] Acquired lock "refresh_cache-e2ca19ea-868c-40ad-a453-f6e348cfac15" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.network.neutron [req-ee6ed87f-f3fe-4adc-aa46-01670d759726 req-b96ca5f6-aeff-4b23-999c-4f1b3ccfa724 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Refreshing network info cache for port bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Start _get_guest_xml network_info=[{"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:20:22 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:20:22 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:20:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-259126896',display_name='tempest-ServerActionsTestOtherA-server-259126896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-259126896',id=3,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj9M7ZGdr6vvGAAN6LlX0Yd4KFWs7o7dSiIrZzG0de25MryOgdU0IQWkOsGcYGYZLChUKVpEI60JU+ZGbYHXhk4M5ia3Yx+QGjlFCbCEmncodiyKPCipVQmd8JPh2FoTg==',key_name='tempest-keypair-1499887671',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e85c7d5f159c4ff2896b5549cf73b977',ramdisk_id='',reservation_id='r-a8sv6s0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-765053637',owner_user_name='tempest-ServerActionsTestOtherA-765053637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:20:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ccd18b99219749fe8febdc0da8fc4388',uuid=e2ca19ea-868c-40ad-a453-f6e348cfac15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converting VIF {"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:a8:af,bridge_name='br-int',has_traffic_filtering=True,id=bc611803-5aa5-4b8b-961b-cd6c43317b21,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc611803-5a') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.objects.instance [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lazy-loading 'pci_devices' on Instance uuid e2ca19ea-868c-40ad-a453-f6e348cfac15 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:20:22 user nova-compute[72201]:   <uuid>e2ca19ea-868c-40ad-a453-f6e348cfac15</uuid>
Aug 01 15:20:22 user nova-compute[72201]:   <name>instance-00000003</name>
Aug 01 15:20:22 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:20:22 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:20:22 user nova-compute[72201]:   <metadata>
Aug 01 15:20:22 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:20:22 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:20:22 user nova-compute[72201]:       <nova:name>tempest-ServerActionsTestOtherA-server-259126896</nova:name>
Aug 01 15:20:22 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:20:22</nova:creationTime>
Aug 01 15:20:22 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:20:22 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:20:22 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:20:22 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:20:22 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:20:22 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:20:22 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:20:22 user nova-compute[72201]:       <nova:owner>
Aug 01 15:20:22 user nova-compute[72201]:         <nova:user uuid="ccd18b99219749fe8febdc0da8fc4388">tempest-ServerActionsTestOtherA-765053637-project-member</nova:user>
Aug 01 15:20:22 user nova-compute[72201]:         <nova:project uuid="e85c7d5f159c4ff2896b5549cf73b977">tempest-ServerActionsTestOtherA-765053637</nova:project>
Aug 01 15:20:22 user nova-compute[72201]:       </nova:owner>
Aug 01 15:20:22 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:20:22 user nova-compute[72201]:       <nova:ports>
Aug 01 15:20:22 user nova-compute[72201]:         <nova:port uuid="bc611803-5aa5-4b8b-961b-cd6c43317b21">
Aug 01 15:20:22 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 15:20:22 user nova-compute[72201]:         </nova:port>
Aug 01 15:20:22 user nova-compute[72201]:       </nova:ports>
Aug 01 15:20:22 user nova-compute[72201]:     </nova:instance>
Aug 01 15:20:22 user nova-compute[72201]:   </metadata>
Aug 01 15:20:22 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:20:22 user nova-compute[72201]:     <system>
Aug 01 15:20:22 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:20:22 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:20:22 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:20:22 user nova-compute[72201]:       <entry name="serial">e2ca19ea-868c-40ad-a453-f6e348cfac15</entry>
Aug 01 15:20:22 user nova-compute[72201]:       <entry name="uuid">e2ca19ea-868c-40ad-a453-f6e348cfac15</entry>
Aug 01 15:20:22 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:20:22 user nova-compute[72201]:     </system>
Aug 01 15:20:22 user nova-compute[72201]:   </sysinfo>
Aug 01 15:20:22 user nova-compute[72201]:   <os>
Aug 01 15:20:22 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:20:22 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:20:22 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:20:22 user nova-compute[72201]:   </os>
Aug 01 15:20:22 user nova-compute[72201]:   <features>
Aug 01 15:20:22 user nova-compute[72201]:     <acpi/>
Aug 01 15:20:22 user nova-compute[72201]:     <apic/>
Aug 01 15:20:22 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:20:22 user nova-compute[72201]:   </features>
Aug 01 15:20:22 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:20:22 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:20:22 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:20:22 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:20:22 user nova-compute[72201]:   </clock>
Aug 01 15:20:22 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:20:22 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:20:22 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:20:22 user nova-compute[72201]:   </cpu>
Aug 01 15:20:22 user nova-compute[72201]:   <devices>
Aug 01 15:20:22 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:20:22 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:20:22 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk"/>
Aug 01 15:20:22 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:20:22 user nova-compute[72201]:     </disk>
Aug 01 15:20:22 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:20:22 user nova-compute[72201]:       <mac address="fa:16:3e:50:a8:af"/>
Aug 01 15:20:22 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:20:22 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:20:22 user nova-compute[72201]:       <target dev="tapbc611803-5a"/>
Aug 01 15:20:22 user nova-compute[72201]:     </interface>
Aug 01 15:20:22 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:20:22 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/console.log" append="off"/>
Aug 01 15:20:22 user nova-compute[72201]:     </serial>
Aug 01 15:20:22 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:20:22 user nova-compute[72201]:     <video>
Aug 01 15:20:22 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:20:22 user nova-compute[72201]:     </video>
Aug 01 15:20:22 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:20:22 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:20:22 user nova-compute[72201]:     </rng>
Aug 01 15:20:22 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:20:22 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:20:22 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:20:22 user nova-compute[72201]:     </memballoon>
Aug 01 15:20:22 user nova-compute[72201]:   </devices>
Aug 01 15:20:22 user nova-compute[72201]: </domain>
Aug 01 15:20:22 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:20:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-259126896',display_name='tempest-ServerActionsTestOtherA-server-259126896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-259126896',id=3,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj9M7ZGdr6vvGAAN6LlX0Yd4KFWs7o7dSiIrZzG0de25MryOgdU0IQWkOsGcYGYZLChUKVpEI60JU+ZGbYHXhk4M5ia3Yx+QGjlFCbCEmncodiyKPCipVQmd8JPh2FoTg==',key_name='tempest-keypair-1499887671',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e85c7d5f159c4ff2896b5549cf73b977',ramdisk_id='',reservation_id='r-a8sv6s0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-765053637',owner_user_name='tempest-ServerActionsTestOtherA-765053637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:20:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ccd18b99219749fe8febdc0da8fc4388',uuid=e2ca19ea-868c-40ad-a453-f6e348cfac15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converting VIF {"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:a8:af,bridge_name='br-int',has_traffic_filtering=True,id=bc611803-5aa5-4b8b-961b-cd6c43317b21,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc611803-5a') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG os_vif [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:a8:af,bridge_name='br-int',has_traffic_filtering=True,id=bc611803-5aa5-4b8b-961b-cd6c43317b21,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc611803-5a') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc611803-5a, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbc611803-5a, col_values=(('external_ids', {'iface-id': 'bc611803-5aa5-4b8b-961b-cd6c43317b21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:a8:af', 'vm-uuid': 'e2ca19ea-868c-40ad-a453-f6e348cfac15'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:22 user nova-compute[72201]: INFO os_vif [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:a8:af,bridge_name='br-int',has_traffic_filtering=True,id=bc611803-5aa5-4b8b-961b-cd6c43317b21,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc611803-5a')
Aug 01 15:20:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] No VIF found with MAC fa:16:3e:50:a8:af, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Updating instance_info_cache with network_info: [{"id": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "address": "fa:16:3e:2d:e0:8c", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1fc053-fd", "ovs_interfaceid": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Releasing lock "refresh_cache-0f059ccc-f609-4cf3-a644-c3d1305ae26e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Instance network_info: |[{"id": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "address": "fa:16:3e:2d:e0:8c", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1fc053-fd", "ovs_interfaceid": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-251a310e-635b-452c-9fb0-0f07760cc586 req-53819b9c-d3c4-403f-91e0-3d5245b8b401 service nova] Acquired lock "refresh_cache-0f059ccc-f609-4cf3-a644-c3d1305ae26e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.network.neutron [req-251a310e-635b-452c-9fb0-0f07760cc586 req-53819b9c-d3c4-403f-91e0-3d5245b8b401 service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Refreshing network info cache for port eb1fc053-fd35-4b5e-a557-4be5052de15d {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Start _get_guest_xml network_info=[{"id": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "address": "fa:16:3e:2d:e0:8c", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1fc053-fd", "ovs_interfaceid": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:20:22 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:20:22 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:20:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:20:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1512947866',display_name='tempest-ServerRescueNegativeTestJSON-server-1512947866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1512947866',id=4,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f130c48f19cf4ab7803c1169b759ccb6',ramdisk_id='',reservation_id='r-oa7fpdsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-773079660',owner_user_name='tempest-ServerRescueNegativeTestJSON-773079660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:20:14Z,user_data=None,user_id='31a432c1165e4ff4a9a10b4d71ddc513',uuid=0f059ccc-f609-4cf3-a644-c3d1305ae26e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "address": "fa:16:3e:2d:e0:8c", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1fc053-fd", "ovs_interfaceid": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converting VIF {"id": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "address": "fa:16:3e:2d:e0:8c", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1fc053-fd", "ovs_interfaceid": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:e0:8c,bridge_name='br-int',has_traffic_filtering=True,id=eb1fc053-fd35-4b5e-a557-4be5052de15d,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb1fc053-fd') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f059ccc-f609-4cf3-a644-c3d1305ae26e {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:20:23 user nova-compute[72201]:   <uuid>0f059ccc-f609-4cf3-a644-c3d1305ae26e</uuid>
Aug 01 15:20:23 user nova-compute[72201]:   <name>instance-00000004</name>
Aug 01 15:20:23 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:20:23 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:20:23 user nova-compute[72201]:   <metadata>
Aug 01 15:20:23 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:20:23 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:20:23 user nova-compute[72201]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1512947866</nova:name>
Aug 01 15:20:23 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:20:22</nova:creationTime>
Aug 01 15:20:23 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:20:23 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:20:23 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:20:23 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:20:23 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:20:23 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:20:23 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:20:23 user nova-compute[72201]:       <nova:owner>
Aug 01 15:20:23 user nova-compute[72201]:         <nova:user uuid="31a432c1165e4ff4a9a10b4d71ddc513">tempest-ServerRescueNegativeTestJSON-773079660-project-member</nova:user>
Aug 01 15:20:23 user nova-compute[72201]:         <nova:project uuid="f130c48f19cf4ab7803c1169b759ccb6">tempest-ServerRescueNegativeTestJSON-773079660</nova:project>
Aug 01 15:20:23 user nova-compute[72201]:       </nova:owner>
Aug 01 15:20:23 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:20:23 user nova-compute[72201]:       <nova:ports>
Aug 01 15:20:23 user nova-compute[72201]:         <nova:port uuid="eb1fc053-fd35-4b5e-a557-4be5052de15d">
Aug 01 15:20:23 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 15:20:23 user nova-compute[72201]:         </nova:port>
Aug 01 15:20:23 user nova-compute[72201]:       </nova:ports>
Aug 01 15:20:23 user nova-compute[72201]:     </nova:instance>
Aug 01 15:20:23 user nova-compute[72201]:   </metadata>
Aug 01 15:20:23 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:20:23 user nova-compute[72201]:     <system>
Aug 01 15:20:23 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:20:23 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:20:23 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:20:23 user nova-compute[72201]:       <entry name="serial">0f059ccc-f609-4cf3-a644-c3d1305ae26e</entry>
Aug 01 15:20:23 user nova-compute[72201]:       <entry name="uuid">0f059ccc-f609-4cf3-a644-c3d1305ae26e</entry>
Aug 01 15:20:23 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:20:23 user nova-compute[72201]:     </system>
Aug 01 15:20:23 user nova-compute[72201]:   </sysinfo>
Aug 01 15:20:23 user nova-compute[72201]:   <os>
Aug 01 15:20:23 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:20:23 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:20:23 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:20:23 user nova-compute[72201]:   </os>
Aug 01 15:20:23 user nova-compute[72201]:   <features>
Aug 01 15:20:23 user nova-compute[72201]:     <acpi/>
Aug 01 15:20:23 user nova-compute[72201]:     <apic/>
Aug 01 15:20:23 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:20:23 user nova-compute[72201]:   </features>
Aug 01 15:20:23 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:20:23 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:20:23 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:20:23 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:20:23 user nova-compute[72201]:   </clock>
Aug 01 15:20:23 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:20:23 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:20:23 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:20:23 user nova-compute[72201]:   </cpu>
Aug 01 15:20:23 user nova-compute[72201]:   <devices>
Aug 01 15:20:23 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:20:23 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:20:23 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk"/>
Aug 01 15:20:23 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:20:23 user nova-compute[72201]:     </disk>
Aug 01 15:20:23 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:20:23 user nova-compute[72201]:       <mac address="fa:16:3e:2d:e0:8c"/>
Aug 01 15:20:23 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:20:23 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:20:23 user nova-compute[72201]:       <target dev="tapeb1fc053-fd"/>
Aug 01 15:20:23 user nova-compute[72201]:     </interface>
Aug 01 15:20:23 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:20:23 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/console.log" append="off"/>
Aug 01 15:20:23 user nova-compute[72201]:     </serial>
Aug 01 15:20:23 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:20:23 user nova-compute[72201]:     <video>
Aug 01 15:20:23 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:20:23 user nova-compute[72201]:     </video>
Aug 01 15:20:23 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:20:23 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:20:23 user nova-compute[72201]:     </rng>
Aug 01 15:20:23 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:20:23 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:20:23 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:20:23 user nova-compute[72201]:     </memballoon>
Aug 01 15:20:23 user nova-compute[72201]:   </devices>
Aug 01 15:20:23 user nova-compute[72201]: </domain>
Aug 01 15:20:23 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:20:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1512947866',display_name='tempest-ServerRescueNegativeTestJSON-server-1512947866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1512947866',id=4,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f130c48f19cf4ab7803c1169b759ccb6',ramdisk_id='',reservation_id='r-oa7fpdsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-773079660',owner_user_name='tempest-ServerRescueNegativeTestJSON-773079660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:20:14Z,user_data=None,user_id='31a432c1165e4ff4a9a10b4d71ddc513',uuid=0f059ccc-f609-4cf3-a644-c3d1305ae26e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "address": "fa:16:3e:2d:e0:8c", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1fc053-fd", "ovs_interfaceid": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converting VIF {"id": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "address": "fa:16:3e:2d:e0:8c", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1fc053-fd", "ovs_interfaceid": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:e0:8c,bridge_name='br-int',has_traffic_filtering=True,id=eb1fc053-fd35-4b5e-a557-4be5052de15d,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb1fc053-fd') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG os_vif [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:e0:8c,bridge_name='br-int',has_traffic_filtering=True,id=eb1fc053-fd35-4b5e-a557-4be5052de15d,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb1fc053-fd') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb1fc053-fd, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeb1fc053-fd, col_values=(('external_ids', {'iface-id': 'eb1fc053-fd35-4b5e-a557-4be5052de15d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:e0:8c', 'vm-uuid': '0f059ccc-f609-4cf3-a644-c3d1305ae26e'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:23 user nova-compute[72201]: INFO os_vif [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:e0:8c,bridge_name='br-int',has_traffic_filtering=True,id=eb1fc053-fd35-4b5e-a557-4be5052de15d,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb1fc053-fd')
Aug 01 15:20:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] No VIF found with MAC fa:16:3e:2d:e0:8c, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-5da0c24f-51d3-4a11-b1e5-1780785462c9 req-cef823a3-db9f-4a11-a5f0-7d6fd6dad9a8 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received event network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5da0c24f-51d3-4a11-b1e5-1780785462c9 req-cef823a3-db9f-4a11-a5f0-7d6fd6dad9a8 service nova] Acquiring lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5da0c24f-51d3-4a11-b1e5-1780785462c9 req-cef823a3-db9f-4a11-a5f0-7d6fd6dad9a8 service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5da0c24f-51d3-4a11-b1e5-1780785462c9 req-cef823a3-db9f-4a11-a5f0-7d6fd6dad9a8 service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-5da0c24f-51d3-4a11-b1e5-1780785462c9 req-cef823a3-db9f-4a11-a5f0-7d6fd6dad9a8 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] No waiting events found dispatching network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:20:23 user nova-compute[72201]: WARNING nova.compute.manager [req-5da0c24f-51d3-4a11-b1e5-1780785462c9 req-cef823a3-db9f-4a11-a5f0-7d6fd6dad9a8 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received unexpected event network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 for instance with vm_state building and task_state spawning.
Aug 01 15:20:24 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903224.0720634, b64f1cfb-64f2-4493-8721-fc63fcd93bb6 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:20:24 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] VM Resumed (Lifecycle Event)
Aug 01 15:20:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:20:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:20:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:24 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Instance spawned successfully.
Aug 01 15:20:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:20:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:20:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:24 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:20:24 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903224.0721748, b64f1cfb-64f2-4493-8721-fc63fcd93bb6 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:20:24 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] VM Started (Lifecycle Event)
Aug 01 15:20:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:20:24 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:20:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:24 user nova-compute[72201]: INFO nova.compute.manager [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Took 12.09 seconds to spawn the instance on the hypervisor.
Aug 01 15:20:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:24 user nova-compute[72201]: INFO nova.compute.manager [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Took 12.97 seconds to build instance.
Aug 01 15:20:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0acfc3d5-d544-4094-97e6-8dfe959d0caf tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.076s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:25 user nova-compute[72201]: DEBUG nova.network.neutron [req-ee6ed87f-f3fe-4adc-aa46-01670d759726 req-b96ca5f6-aeff-4b23-999c-4f1b3ccfa724 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Updated VIF entry in instance network info cache for port bc611803-5aa5-4b8b-961b-cd6c43317b21. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:20:25 user nova-compute[72201]: DEBUG nova.network.neutron [req-ee6ed87f-f3fe-4adc-aa46-01670d759726 req-b96ca5f6-aeff-4b23-999c-4f1b3ccfa724 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Updating instance_info_cache with network_info: [{"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:20:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ee6ed87f-f3fe-4adc-aa46-01670d759726 req-b96ca5f6-aeff-4b23-999c-4f1b3ccfa724 service nova] Releasing lock "refresh_cache-e2ca19ea-868c-40ad-a453-f6e348cfac15" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:20:25 user nova-compute[72201]: DEBUG nova.network.neutron [req-251a310e-635b-452c-9fb0-0f07760cc586 req-53819b9c-d3c4-403f-91e0-3d5245b8b401 service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Updated VIF entry in instance network info cache for port eb1fc053-fd35-4b5e-a557-4be5052de15d. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:20:25 user nova-compute[72201]: DEBUG nova.network.neutron [req-251a310e-635b-452c-9fb0-0f07760cc586 req-53819b9c-d3c4-403f-91e0-3d5245b8b401 service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Updating instance_info_cache with network_info: [{"id": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "address": "fa:16:3e:2d:e0:8c", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1fc053-fd", "ovs_interfaceid": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:20:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-251a310e-635b-452c-9fb0-0f07760cc586 req-53819b9c-d3c4-403f-91e0-3d5245b8b401 service nova] Releasing lock "refresh_cache-0f059ccc-f609-4cf3-a644-c3d1305ae26e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:20:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-58c12d4d-ba5d-4180-af66-1404434efe0d req-4ecd0860-8cd9-4632-8e7e-0ec4ba0b763b service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received event network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-58c12d4d-ba5d-4180-af66-1404434efe0d req-4ecd0860-8cd9-4632-8e7e-0ec4ba0b763b service nova] Acquiring lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-58c12d4d-ba5d-4180-af66-1404434efe0d req-4ecd0860-8cd9-4632-8e7e-0ec4ba0b763b service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-58c12d4d-ba5d-4180-af66-1404434efe0d req-4ecd0860-8cd9-4632-8e7e-0ec4ba0b763b service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-58c12d4d-ba5d-4180-af66-1404434efe0d req-4ecd0860-8cd9-4632-8e7e-0ec4ba0b763b service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] No waiting events found dispatching network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:20:25 user nova-compute[72201]: WARNING nova.compute.manager [req-58c12d4d-ba5d-4180-af66-1404434efe0d req-4ecd0860-8cd9-4632-8e7e-0ec4ba0b763b service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received unexpected event network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 for instance with vm_state active and task_state None.
Aug 01 15:20:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:27 user nova-compute[72201]: DEBUG nova.compute.manager [req-a0cef550-65d1-4ecb-b04a-0c4b28f13299 req-1a1ff522-fc43-4aac-a670-1effd0332fe9 service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Received event network-vif-plugged-eb1fc053-fd35-4b5e-a557-4be5052de15d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a0cef550-65d1-4ecb-b04a-0c4b28f13299 req-1a1ff522-fc43-4aac-a670-1effd0332fe9 service nova] Acquiring lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a0cef550-65d1-4ecb-b04a-0c4b28f13299 req-1a1ff522-fc43-4aac-a670-1effd0332fe9 service nova] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a0cef550-65d1-4ecb-b04a-0c4b28f13299 req-1a1ff522-fc43-4aac-a670-1effd0332fe9 service nova] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:27 user nova-compute[72201]: DEBUG nova.compute.manager [req-a0cef550-65d1-4ecb-b04a-0c4b28f13299 req-1a1ff522-fc43-4aac-a670-1effd0332fe9 service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] No waiting events found dispatching network-vif-plugged-eb1fc053-fd35-4b5e-a557-4be5052de15d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:20:27 user nova-compute[72201]: WARNING nova.compute.manager [req-a0cef550-65d1-4ecb-b04a-0c4b28f13299 req-1a1ff522-fc43-4aac-a670-1effd0332fe9 service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Received unexpected event network-vif-plugged-eb1fc053-fd35-4b5e-a557-4be5052de15d for instance with vm_state building and task_state spawning.
Aug 01 15:20:27 user nova-compute[72201]: DEBUG nova.compute.manager [req-a0cef550-65d1-4ecb-b04a-0c4b28f13299 req-1a1ff522-fc43-4aac-a670-1effd0332fe9 service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Received event network-vif-plugged-eb1fc053-fd35-4b5e-a557-4be5052de15d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a0cef550-65d1-4ecb-b04a-0c4b28f13299 req-1a1ff522-fc43-4aac-a670-1effd0332fe9 service nova] Acquiring lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a0cef550-65d1-4ecb-b04a-0c4b28f13299 req-1a1ff522-fc43-4aac-a670-1effd0332fe9 service nova] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a0cef550-65d1-4ecb-b04a-0c4b28f13299 req-1a1ff522-fc43-4aac-a670-1effd0332fe9 service nova] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:27 user nova-compute[72201]: DEBUG nova.compute.manager [req-a0cef550-65d1-4ecb-b04a-0c4b28f13299 req-1a1ff522-fc43-4aac-a670-1effd0332fe9 service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] No waiting events found dispatching network-vif-plugged-eb1fc053-fd35-4b5e-a557-4be5052de15d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:20:27 user nova-compute[72201]: WARNING nova.compute.manager [req-a0cef550-65d1-4ecb-b04a-0c4b28f13299 req-1a1ff522-fc43-4aac-a670-1effd0332fe9 service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Received unexpected event network-vif-plugged-eb1fc053-fd35-4b5e-a557-4be5052de15d for instance with vm_state building and task_state spawning.
Aug 01 15:20:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:28 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903228.8288343, e2ca19ea-868c-40ad-a453-f6e348cfac15 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:20:28 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] VM Resumed (Lifecycle Event)
Aug 01 15:20:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:20:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:20:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:20:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:20:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:28 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Instance spawned successfully.
Aug 01 15:20:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:20:28 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Instance spawned successfully.
Aug 01 15:20:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:20:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:20:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:29 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:20:29 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903228.8291621, e2ca19ea-868c-40ad-a453-f6e348cfac15 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:20:29 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] VM Started (Lifecycle Event)
Aug 01 15:20:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:20:29 user nova-compute[72201]: INFO nova.compute.manager [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Took 16.07 seconds to spawn the instance on the hypervisor.
Aug 01 15:20:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:29 user nova-compute[72201]: INFO nova.compute.manager [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Took 15.52 seconds to spawn the instance on the hypervisor.
Aug 01 15:20:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:29 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:20:29 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903228.8514326, 0f059ccc-f609-4cf3-a644-c3d1305ae26e => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:20:29 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] VM Resumed (Lifecycle Event)
Aug 01 15:20:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:20:29 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:20:29 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903228.8526099, 0f059ccc-f609-4cf3-a644-c3d1305ae26e => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:20:29 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] VM Started (Lifecycle Event)
Aug 01 15:20:29 user nova-compute[72201]: INFO nova.compute.manager [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Took 16.43 seconds to build instance.
Aug 01 15:20:29 user nova-compute[72201]: INFO nova.compute.manager [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Took 17.23 seconds to build instance.
Aug 01 15:20:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:20:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ebce3eea-4dae-4604-8f86-124043935b43 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.588s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0c4baaca-dcae-4ff6-8639-d2e5265695da tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.485s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-c187fce6-38af-4bf5-8f2a-a08ecb74653c req-d6f09b21-288b-4a7f-919e-e158e9f9aae7 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Received event network-vif-plugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c187fce6-38af-4bf5-8f2a-a08ecb74653c req-d6f09b21-288b-4a7f-919e-e158e9f9aae7 service nova] Acquiring lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c187fce6-38af-4bf5-8f2a-a08ecb74653c req-d6f09b21-288b-4a7f-919e-e158e9f9aae7 service nova] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c187fce6-38af-4bf5-8f2a-a08ecb74653c req-d6f09b21-288b-4a7f-919e-e158e9f9aae7 service nova] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-c187fce6-38af-4bf5-8f2a-a08ecb74653c req-d6f09b21-288b-4a7f-919e-e158e9f9aae7 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] No waiting events found dispatching network-vif-plugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:20:29 user nova-compute[72201]: WARNING nova.compute.manager [req-c187fce6-38af-4bf5-8f2a-a08ecb74653c req-d6f09b21-288b-4a7f-919e-e158e9f9aae7 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Received unexpected event network-vif-plugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 for instance with vm_state active and task_state None.
Aug 01 15:20:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-c187fce6-38af-4bf5-8f2a-a08ecb74653c req-d6f09b21-288b-4a7f-919e-e158e9f9aae7 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Received event network-vif-plugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c187fce6-38af-4bf5-8f2a-a08ecb74653c req-d6f09b21-288b-4a7f-919e-e158e9f9aae7 service nova] Acquiring lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c187fce6-38af-4bf5-8f2a-a08ecb74653c req-d6f09b21-288b-4a7f-919e-e158e9f9aae7 service nova] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c187fce6-38af-4bf5-8f2a-a08ecb74653c req-d6f09b21-288b-4a7f-919e-e158e9f9aae7 service nova] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-c187fce6-38af-4bf5-8f2a-a08ecb74653c req-d6f09b21-288b-4a7f-919e-e158e9f9aae7 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] No waiting events found dispatching network-vif-plugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:20:29 user nova-compute[72201]: WARNING nova.compute.manager [req-c187fce6-38af-4bf5-8f2a-a08ecb74653c req-d6f09b21-288b-4a7f-919e-e158e9f9aae7 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Received unexpected event network-vif-plugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 for instance with vm_state active and task_state None.
Aug 01 15:20:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Acquiring lock "cb684e00-1740-402d-b3c5-c14eaf7e8054" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Lock "cb684e00-1740-402d-b3c5-c14eaf7e8054" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:36 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:20:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:37 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:20:37 user nova-compute[72201]: INFO nova.compute.claims [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Claim successful on node user
Aug 01 15:20:37 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:20:37 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:20:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:37 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:20:37 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:20:37 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:20:37 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:20:37 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:20:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:37 user nova-compute[72201]: DEBUG nova.policy [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '225522eaf2aa474792143e7e4c6a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc7e3cf771f4b0f8c6245914bcf6c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:20:37 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:20:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:20:37 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Creating image(s)
Aug 01 15:20:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Lock "/opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Lock "/opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "02d227b0-2b25-467f-a318-ab46aa391a31" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "02d227b0-2b25-467f-a318-ab46aa391a31" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.201s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.021s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:20:38 user nova-compute[72201]: INFO nova.compute.claims [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Claim successful on node user
Aug 01 15:20:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.230s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054/disk 1073741824" returned: 0 in 0.096s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.330s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.155s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Cannot resize image /opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Lazy-loading 'migration_context' on Instance uuid cb684e00-1740-402d-b3c5-c14eaf7e8054 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Ensure instance console log exists: /opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.626s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:20:38 user nova-compute[72201]: DEBUG nova.network.neutron [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:20:39 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:20:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:20:39 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Successfully created port: b1af805e-79e9-469b-a431-6938abe1b0e5 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:20:39 user nova-compute[72201]: DEBUG nova.policy [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c3e96bf4fb645898f1fc7987f4f0ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cae4f1529be4369af543b05169568cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:20:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:20:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:20:39 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Creating image(s)
Aug 01 15:20:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "/opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "/opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "/opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.198s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk 1073741824" returned: 0 in 0.060s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.220s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:39 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:20:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:40 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Cannot resize image /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:20:40 user nova-compute[72201]: DEBUG nova.objects.instance [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lazy-loading 'migration_context' on Instance uuid 02d227b0-2b25-467f-a318-ab46aa391a31 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:20:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:20:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Ensure instance console log exists: /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:20:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:40 user nova-compute[72201]: DEBUG nova.network.neutron [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Successfully created port: 4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:20:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Acquiring lock "e2846f03-5074-495b-831f-734dd477dc18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "e2846f03-5074-495b-831f-734dd477dc18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:40 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:20:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:20:40 user nova-compute[72201]: INFO nova.compute.claims [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Claim successful on node user
Aug 01 15:20:41 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Successfully updated port: b1af805e-79e9-469b-a431-6938abe1b0e5 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Acquiring lock "refresh_cache-cb684e00-1740-402d-b3c5-c14eaf7e8054" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Acquired lock "refresh_cache-cb684e00-1740-402d-b3c5-c14eaf7e8054" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-f852d8ef-42d5-420a-a57c-1b4e79be1f6f req-16b0fca3-86fe-4897-97cb-28ff157aa739 service nova] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Received event network-changed-b1af805e-79e9-469b-a431-6938abe1b0e5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-f852d8ef-42d5-420a-a57c-1b4e79be1f6f req-16b0fca3-86fe-4897-97cb-28ff157aa739 service nova] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Refreshing instance network info cache due to event network-changed-b1af805e-79e9-469b-a431-6938abe1b0e5. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f852d8ef-42d5-420a-a57c-1b4e79be1f6f req-16b0fca3-86fe-4897-97cb-28ff157aa739 service nova] Acquiring lock "refresh_cache-cb684e00-1740-402d-b3c5-c14eaf7e8054" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:20:41 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 01 15:20:41 user nova-compute[72201]: DEBUG nova.network.neutron [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Successfully updated port: 4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "refresh_cache-02d227b0-2b25-467f-a318-ab46aa391a31" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquired lock "refresh_cache-02d227b0-2b25-467f-a318-ab46aa391a31" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG nova.network.neutron [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-e54c0fe8-46e4-4fbf-8391-73d4724a5df3 req-2dd61b9b-4e26-4e65-a36e-baaa2124fb7a service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Received event network-changed-4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-e54c0fe8-46e4-4fbf-8391-73d4724a5df3 req-2dd61b9b-4e26-4e65-a36e-baaa2124fb7a service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Refreshing instance network info cache due to event network-changed-4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e54c0fe8-46e4-4fbf-8391-73d4724a5df3 req-2dd61b9b-4e26-4e65-a36e-baaa2124fb7a service nova] Acquiring lock "refresh_cache-02d227b0-2b25-467f-a318-ab46aa391a31" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG nova.network.neutron [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG nova.policy [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d80e50103134cc9908a7ad6763460af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470dd7d54793417288d2ba2fd8f06dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:20:41 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Creating image(s)
Aug 01 15:20:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "/opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "/opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Acquiring lock "49942ec1b8d36fcab05004dc20bcf09b01255950" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "49942ec1b8d36fcab05004dc20bcf09b01255950" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Updating instance_info_cache with network_info: [{"id": "b1af805e-79e9-469b-a431-6938abe1b0e5", "address": "fa:16:3e:84:48:12", "network": {"id": "72ebf2cb-4850-4634-b582-23fe6abdc8ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301879152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccc7e3cf771f4b0f8c6245914bcf6c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af805e-79", "ovs_interfaceid": "b1af805e-79e9-469b-a431-6938abe1b0e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Releasing lock "refresh_cache-cb684e00-1740-402d-b3c5-c14eaf7e8054" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Instance network_info: |[{"id": "b1af805e-79e9-469b-a431-6938abe1b0e5", "address": "fa:16:3e:84:48:12", "network": {"id": "72ebf2cb-4850-4634-b582-23fe6abdc8ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301879152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccc7e3cf771f4b0f8c6245914bcf6c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af805e-79", "ovs_interfaceid": "b1af805e-79e9-469b-a431-6938abe1b0e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f852d8ef-42d5-420a-a57c-1b4e79be1f6f req-16b0fca3-86fe-4897-97cb-28ff157aa739 service nova] Acquired lock "refresh_cache-cb684e00-1740-402d-b3c5-c14eaf7e8054" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.network.neutron [req-f852d8ef-42d5-420a-a57c-1b4e79be1f6f req-16b0fca3-86fe-4897-97cb-28ff157aa739 service nova] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Refreshing network info cache for port b1af805e-79e9-469b-a431-6938abe1b0e5 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Start _get_guest_xml network_info=[{"id": "b1af805e-79e9-469b-a431-6938abe1b0e5", "address": "fa:16:3e:84:48:12", "network": {"id": "72ebf2cb-4850-4634-b582-23fe6abdc8ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301879152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccc7e3cf771f4b0f8c6245914bcf6c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af805e-79", "ovs_interfaceid": "b1af805e-79e9-469b-a431-6938abe1b0e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49942ec1b8d36fcab05004dc20bcf09b01255950.part --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.network.neutron [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Updating instance_info_cache with network_info: [{"id": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "address": "fa:16:3e:dc:2e:04", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd9ef98-ad", "ovs_interfaceid": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Acquiring lock "c918ea78-9bf8-421c-9a31-0da4104cd032" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:42 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:20:42 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Releasing lock "refresh_cache-02d227b0-2b25-467f-a318-ab46aa391a31" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.compute.manager [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Instance network_info: |[{"id": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "address": "fa:16:3e:dc:2e:04", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd9ef98-ad", "ovs_interfaceid": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e54c0fe8-46e4-4fbf-8391-73d4724a5df3 req-2dd61b9b-4e26-4e65-a36e-baaa2124fb7a service nova] Acquired lock "refresh_cache-02d227b0-2b25-467f-a318-ab46aa391a31" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.network.neutron [req-e54c0fe8-46e4-4fbf-8391-73d4724a5df3 req-2dd61b9b-4e26-4e65-a36e-baaa2124fb7a service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Refreshing network info cache for port 4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Start _get_guest_xml network_info=[{"id": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "address": "fa:16:3e:dc:2e:04", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd9ef98-ad", "ovs_interfaceid": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:20:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-111241312',display_name='tempest-VolumesActionsTest-instance-111241312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-111241312',id=5,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccc7e3cf771f4b0f8c6245914bcf6c1a',ramdisk_id='',reservation_id='r-ryudup0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1082766106',owner_user_name='tempest-VolumesActionsTest-1082766106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:20:38Z,user_data=None,user_id='225522eaf2aa474792143e7e4c6a5bc9',uuid=cb684e00-1740-402d-b3c5-c14eaf7e8054,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1af805e-79e9-469b-a431-6938abe1b0e5", "address": "fa:16:3e:84:48:12", "network": {"id": "72ebf2cb-4850-4634-b582-23fe6abdc8ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301879152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccc7e3cf771f4b0f8c6245914bcf6c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af805e-79", "ovs_interfaceid": "b1af805e-79e9-469b-a431-6938abe1b0e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Converting VIF {"id": "b1af805e-79e9-469b-a431-6938abe1b0e5", "address": "fa:16:3e:84:48:12", "network": {"id": "72ebf2cb-4850-4634-b582-23fe6abdc8ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301879152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccc7e3cf771f4b0f8c6245914bcf6c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af805e-79", "ovs_interfaceid": "b1af805e-79e9-469b-a431-6938abe1b0e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:48:12,bridge_name='br-int',has_traffic_filtering=True,id=b1af805e-79e9-469b-a431-6938abe1b0e5,network=Network(72ebf2cb-4850-4634-b582-23fe6abdc8ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1af805e-79') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Lazy-loading 'pci_devices' on Instance uuid cb684e00-1740-402d-b3c5-c14eaf7e8054 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:20:42 user nova-compute[72201]:   <uuid>cb684e00-1740-402d-b3c5-c14eaf7e8054</uuid>
Aug 01 15:20:42 user nova-compute[72201]:   <name>instance-00000005</name>
Aug 01 15:20:42 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:20:42 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:20:42 user nova-compute[72201]:   <metadata>
Aug 01 15:20:42 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:20:42 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:20:42 user nova-compute[72201]:       <nova:name>tempest-VolumesActionsTest-instance-111241312</nova:name>
Aug 01 15:20:42 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:20:42</nova:creationTime>
Aug 01 15:20:42 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:20:42 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:20:42 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:20:42 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:20:42 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:20:42 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:20:42 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:20:42 user nova-compute[72201]:       <nova:owner>
Aug 01 15:20:42 user nova-compute[72201]:         <nova:user uuid="225522eaf2aa474792143e7e4c6a5bc9">tempest-VolumesActionsTest-1082766106-project-member</nova:user>
Aug 01 15:20:42 user nova-compute[72201]:         <nova:project uuid="ccc7e3cf771f4b0f8c6245914bcf6c1a">tempest-VolumesActionsTest-1082766106</nova:project>
Aug 01 15:20:42 user nova-compute[72201]:       </nova:owner>
Aug 01 15:20:42 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:20:42 user nova-compute[72201]:       <nova:ports>
Aug 01 15:20:42 user nova-compute[72201]:         <nova:port uuid="b1af805e-79e9-469b-a431-6938abe1b0e5">
Aug 01 15:20:42 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 15:20:42 user nova-compute[72201]:         </nova:port>
Aug 01 15:20:42 user nova-compute[72201]:       </nova:ports>
Aug 01 15:20:42 user nova-compute[72201]:     </nova:instance>
Aug 01 15:20:42 user nova-compute[72201]:   </metadata>
Aug 01 15:20:42 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:20:42 user nova-compute[72201]:     <system>
Aug 01 15:20:42 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:20:42 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:20:42 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:20:42 user nova-compute[72201]:       <entry name="serial">cb684e00-1740-402d-b3c5-c14eaf7e8054</entry>
Aug 01 15:20:42 user nova-compute[72201]:       <entry name="uuid">cb684e00-1740-402d-b3c5-c14eaf7e8054</entry>
Aug 01 15:20:42 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:20:42 user nova-compute[72201]:     </system>
Aug 01 15:20:42 user nova-compute[72201]:   </sysinfo>
Aug 01 15:20:42 user nova-compute[72201]:   <os>
Aug 01 15:20:42 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:20:42 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:20:42 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:20:42 user nova-compute[72201]:   </os>
Aug 01 15:20:42 user nova-compute[72201]:   <features>
Aug 01 15:20:42 user nova-compute[72201]:     <acpi/>
Aug 01 15:20:42 user nova-compute[72201]:     <apic/>
Aug 01 15:20:42 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:20:42 user nova-compute[72201]:   </features>
Aug 01 15:20:42 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:20:42 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:20:42 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:20:42 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:20:42 user nova-compute[72201]:   </clock>
Aug 01 15:20:42 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:20:42 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:20:42 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:20:42 user nova-compute[72201]:   </cpu>
Aug 01 15:20:42 user nova-compute[72201]:   <devices>
Aug 01 15:20:42 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:20:42 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:20:42 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054/disk"/>
Aug 01 15:20:42 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:20:42 user nova-compute[72201]:     </disk>
Aug 01 15:20:42 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:20:42 user nova-compute[72201]:       <mac address="fa:16:3e:84:48:12"/>
Aug 01 15:20:42 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:20:42 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:20:42 user nova-compute[72201]:       <target dev="tapb1af805e-79"/>
Aug 01 15:20:42 user nova-compute[72201]:     </interface>
Aug 01 15:20:42 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:20:42 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054/console.log" append="off"/>
Aug 01 15:20:42 user nova-compute[72201]:     </serial>
Aug 01 15:20:42 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:20:42 user nova-compute[72201]:     <video>
Aug 01 15:20:42 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:20:42 user nova-compute[72201]:     </video>
Aug 01 15:20:42 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:20:42 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:20:42 user nova-compute[72201]:     </rng>
Aug 01 15:20:42 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:20:42 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:20:42 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:20:42 user nova-compute[72201]:     </memballoon>
Aug 01 15:20:42 user nova-compute[72201]:   </devices>
Aug 01 15:20:42 user nova-compute[72201]: </domain>
Aug 01 15:20:42 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:20:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-111241312',display_name='tempest-VolumesActionsTest-instance-111241312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-111241312',id=5,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccc7e3cf771f4b0f8c6245914bcf6c1a',ramdisk_id='',reservation_id='r-ryudup0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1082766106',owner_user_name='tempest-VolumesActionsTest-1082766106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:20:38Z,user_data=None,user_id='225522eaf2aa474792143e7e4c6a5bc9',uuid=cb684e00-1740-402d-b3c5-c14eaf7e8054,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1af805e-79e9-469b-a431-6938abe1b0e5", "address": "fa:16:3e:84:48:12", "network": {"id": "72ebf2cb-4850-4634-b582-23fe6abdc8ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301879152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccc7e3cf771f4b0f8c6245914bcf6c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af805e-79", "ovs_interfaceid": "b1af805e-79e9-469b-a431-6938abe1b0e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Converting VIF {"id": "b1af805e-79e9-469b-a431-6938abe1b0e5", "address": "fa:16:3e:84:48:12", "network": {"id": "72ebf2cb-4850-4634-b582-23fe6abdc8ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301879152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccc7e3cf771f4b0f8c6245914bcf6c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af805e-79", "ovs_interfaceid": "b1af805e-79e9-469b-a431-6938abe1b0e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:48:12,bridge_name='br-int',has_traffic_filtering=True,id=b1af805e-79e9-469b-a431-6938abe1b0e5,network=Network(72ebf2cb-4850-4634-b582-23fe6abdc8ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1af805e-79') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG os_vif [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:48:12,bridge_name='br-int',has_traffic_filtering=True,id=b1af805e-79e9-469b-a431-6938abe1b0e5,network=Network(72ebf2cb-4850-4634-b582-23fe6abdc8ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1af805e-79') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1af805e-79, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1af805e-79, col_values=(('external_ids', {'iface-id': 'b1af805e-79e9-469b-a431-6938abe1b0e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:48:12', 'vm-uuid': 'cb684e00-1740-402d-b3c5-c14eaf7e8054'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:42 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:20:42 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:20:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:42 user nova-compute[72201]: INFO os_vif [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:48:12,bridge_name='br-int',has_traffic_filtering=True,id=b1af805e-79e9-469b-a431-6938abe1b0e5,network=Network(72ebf2cb-4850-4634-b582-23fe6abdc8ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1af805e-79')
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:20:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:20:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-158991302',display_name='tempest-VolumesAdminNegativeTest-server-158991302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-158991302',id=6,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAZ1nQBQA6WVs89gLbsde1Wvri3fBIr1QgbpNmYheEze2DzNk/okxjbjhBR1UiYTsR1KXKyp9qEI1pUSaphVsxea7ITU2HdAT7gdbKf47T22gt1n5pqEMjoAc8z4SQtXg==',key_name='tempest-keypair-809009234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cae4f1529be4369af543b05169568cc',ramdisk_id='',reservation_id='r-mti5puey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1786819113',owner_user_name='tempest-VolumesAdminNegativeTest-1786819113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:20:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c3e96bf4fb645898f1fc7987f4f0ccc',uuid=02d227b0-2b25-467f-a318-ab46aa391a31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "address": "fa:16:3e:dc:2e:04", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd9ef98-ad", "ovs_interfaceid": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Converting VIF {"id": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "address": "fa:16:3e:dc:2e:04", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd9ef98-ad", "ovs_interfaceid": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2e:04,bridge_name='br-int',has_traffic_filtering=True,id=4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9,network=Network(a3eccf4e-95d7-49ef-a540-4ce7e9a490b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bd9ef98-ad') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.objects.instance [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lazy-loading 'pci_devices' on Instance uuid 02d227b0-2b25-467f-a318-ab46aa391a31 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49942ec1b8d36fcab05004dc20bcf09b01255950.part --force-share --output=json" returned: 0 in 0.353s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.virt.images [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] dec6d2d9-190f-4dee-8bdf-e0f5edb3c58f was qcow2, converting to raw {{(pid=72201) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.privsep.utils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72201) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/49942ec1b8d36fcab05004dc20bcf09b01255950.part /opt/stack/data/nova/instances/_base/49942ec1b8d36fcab05004dc20bcf09b01255950.converted {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:20:43 user nova-compute[72201]:   <uuid>02d227b0-2b25-467f-a318-ab46aa391a31</uuid>
Aug 01 15:20:43 user nova-compute[72201]:   <name>instance-00000006</name>
Aug 01 15:20:43 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:20:43 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:20:43 user nova-compute[72201]:   <metadata>
Aug 01 15:20:43 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:20:43 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:20:43 user nova-compute[72201]:       <nova:name>tempest-VolumesAdminNegativeTest-server-158991302</nova:name>
Aug 01 15:20:43 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:20:42</nova:creationTime>
Aug 01 15:20:43 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:20:43 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:20:43 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:20:43 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:20:43 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:20:43 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:20:43 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:20:43 user nova-compute[72201]:       <nova:owner>
Aug 01 15:20:43 user nova-compute[72201]:         <nova:user uuid="8c3e96bf4fb645898f1fc7987f4f0ccc">tempest-VolumesAdminNegativeTest-1786819113-project-member</nova:user>
Aug 01 15:20:43 user nova-compute[72201]:         <nova:project uuid="1cae4f1529be4369af543b05169568cc">tempest-VolumesAdminNegativeTest-1786819113</nova:project>
Aug 01 15:20:43 user nova-compute[72201]:       </nova:owner>
Aug 01 15:20:43 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:20:43 user nova-compute[72201]:       <nova:ports>
Aug 01 15:20:43 user nova-compute[72201]:         <nova:port uuid="4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9">
Aug 01 15:20:43 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 15:20:43 user nova-compute[72201]:         </nova:port>
Aug 01 15:20:43 user nova-compute[72201]:       </nova:ports>
Aug 01 15:20:43 user nova-compute[72201]:     </nova:instance>
Aug 01 15:20:43 user nova-compute[72201]:   </metadata>
Aug 01 15:20:43 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:20:43 user nova-compute[72201]:     <system>
Aug 01 15:20:43 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:20:43 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:20:43 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:20:43 user nova-compute[72201]:       <entry name="serial">02d227b0-2b25-467f-a318-ab46aa391a31</entry>
Aug 01 15:20:43 user nova-compute[72201]:       <entry name="uuid">02d227b0-2b25-467f-a318-ab46aa391a31</entry>
Aug 01 15:20:43 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:20:43 user nova-compute[72201]:     </system>
Aug 01 15:20:43 user nova-compute[72201]:   </sysinfo>
Aug 01 15:20:43 user nova-compute[72201]:   <os>
Aug 01 15:20:43 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:20:43 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:20:43 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:20:43 user nova-compute[72201]:   </os>
Aug 01 15:20:43 user nova-compute[72201]:   <features>
Aug 01 15:20:43 user nova-compute[72201]:     <acpi/>
Aug 01 15:20:43 user nova-compute[72201]:     <apic/>
Aug 01 15:20:43 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:20:43 user nova-compute[72201]:   </features>
Aug 01 15:20:43 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:20:43 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:20:43 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:20:43 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:20:43 user nova-compute[72201]:   </clock>
Aug 01 15:20:43 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:20:43 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:20:43 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:20:43 user nova-compute[72201]:   </cpu>
Aug 01 15:20:43 user nova-compute[72201]:   <devices>
Aug 01 15:20:43 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:20:43 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:20:43 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk"/>
Aug 01 15:20:43 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:20:43 user nova-compute[72201]:     </disk>
Aug 01 15:20:43 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:20:43 user nova-compute[72201]:       <mac address="fa:16:3e:dc:2e:04"/>
Aug 01 15:20:43 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:20:43 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:20:43 user nova-compute[72201]:       <target dev="tap4bd9ef98-ad"/>
Aug 01 15:20:43 user nova-compute[72201]:     </interface>
Aug 01 15:20:43 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:20:43 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/console.log" append="off"/>
Aug 01 15:20:43 user nova-compute[72201]:     </serial>
Aug 01 15:20:43 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:20:43 user nova-compute[72201]:     <video>
Aug 01 15:20:43 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:20:43 user nova-compute[72201]:     </video>
Aug 01 15:20:43 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:20:43 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:20:43 user nova-compute[72201]:     </rng>
Aug 01 15:20:43 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:20:43 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:20:43 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:20:43 user nova-compute[72201]:     </memballoon>
Aug 01 15:20:43 user nova-compute[72201]:   </devices>
Aug 01 15:20:43 user nova-compute[72201]: </domain>
Aug 01 15:20:43 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:20:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-158991302',display_name='tempest-VolumesAdminNegativeTest-server-158991302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-158991302',id=6,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAZ1nQBQA6WVs89gLbsde1Wvri3fBIr1QgbpNmYheEze2DzNk/okxjbjhBR1UiYTsR1KXKyp9qEI1pUSaphVsxea7ITU2HdAT7gdbKf47T22gt1n5pqEMjoAc8z4SQtXg==',key_name='tempest-keypair-809009234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cae4f1529be4369af543b05169568cc',ramdisk_id='',reservation_id='r-mti5puey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1786819113',owner_user_name='tempest-VolumesAdminNegativeTest-1786819113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:20:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c3e96bf4fb645898f1fc7987f4f0ccc',uuid=02d227b0-2b25-467f-a318-ab46aa391a31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "address": "fa:16:3e:dc:2e:04", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd9ef98-ad", "ovs_interfaceid": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Converting VIF {"id": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "address": "fa:16:3e:dc:2e:04", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd9ef98-ad", "ovs_interfaceid": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2e:04,bridge_name='br-int',has_traffic_filtering=True,id=4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9,network=Network(a3eccf4e-95d7-49ef-a540-4ce7e9a490b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bd9ef98-ad') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG os_vif [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2e:04,bridge_name='br-int',has_traffic_filtering=True,id=4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9,network=Network(a3eccf4e-95d7-49ef-a540-4ce7e9a490b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bd9ef98-ad') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Successfully created port: 511788fe-0c9e-486f-a19f-88012fe9005a {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4bd9ef98-ad, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4bd9ef98-ad, col_values=(('external_ids', {'iface-id': '4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:2e:04', 'vm-uuid': '02d227b0-2b25-467f-a318-ab46aa391a31'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] No VIF found with MAC fa:16:3e:84:48:12, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:43 user nova-compute[72201]: INFO os_vif [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2e:04,bridge_name='br-int',has_traffic_filtering=True,id=4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9,network=Network(a3eccf4e-95d7-49ef-a540-4ce7e9a490b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bd9ef98-ad')
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:20:43 user nova-compute[72201]: INFO nova.compute.claims [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Claim successful on node user
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] No VIF found with MAC fa:16:3e:dc:2e:04, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/49942ec1b8d36fcab05004dc20bcf09b01255950.part /opt/stack/data/nova/instances/_base/49942ec1b8d36fcab05004dc20bcf09b01255950.converted" returned: 0 in 0.337s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49942ec1b8d36fcab05004dc20bcf09b01255950.converted --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.network.neutron [req-f852d8ef-42d5-420a-a57c-1b4e79be1f6f req-16b0fca3-86fe-4897-97cb-28ff157aa739 service nova] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Updated VIF entry in instance network info cache for port b1af805e-79e9-469b-a431-6938abe1b0e5. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.network.neutron [req-f852d8ef-42d5-420a-a57c-1b4e79be1f6f req-16b0fca3-86fe-4897-97cb-28ff157aa739 service nova] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Updating instance_info_cache with network_info: [{"id": "b1af805e-79e9-469b-a431-6938abe1b0e5", "address": "fa:16:3e:84:48:12", "network": {"id": "72ebf2cb-4850-4634-b582-23fe6abdc8ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301879152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccc7e3cf771f4b0f8c6245914bcf6c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af805e-79", "ovs_interfaceid": "b1af805e-79e9-469b-a431-6938abe1b0e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f852d8ef-42d5-420a-a57c-1b4e79be1f6f req-16b0fca3-86fe-4897-97cb-28ff157aa739 service nova] Releasing lock "refresh_cache-cb684e00-1740-402d-b3c5-c14eaf7e8054" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49942ec1b8d36fcab05004dc20bcf09b01255950.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "49942ec1b8d36fcab05004dc20bcf09b01255950" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.752s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49942ec1b8d36fcab05004dc20bcf09b01255950 --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49942ec1b8d36fcab05004dc20bcf09b01255950 --force-share --output=json" returned: 0 in 0.198s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Acquiring lock "49942ec1b8d36fcab05004dc20bcf09b01255950" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "49942ec1b8d36fcab05004dc20bcf09b01255950" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49942ec1b8d36fcab05004dc20bcf09b01255950 --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.670s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.network.neutron [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:20:43 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:20:43 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49942ec1b8d36fcab05004dc20bcf09b01255950 --force-share --output=json" returned: 0 in 0.167s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/49942ec1b8d36fcab05004dc20bcf09b01255950,backing_fmt=raw /opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/49942ec1b8d36fcab05004dc20bcf09b01255950,backing_fmt=raw /opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk 1073741824" returned: 0 in 0.083s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "49942ec1b8d36fcab05004dc20bcf09b01255950" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49942ec1b8d36fcab05004dc20bcf09b01255950 --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:20:44 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Creating image(s)
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Acquiring lock "/opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "/opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "/opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Successfully updated port: 511788fe-0c9e-486f-a19f-88012fe9005a {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49942ec1b8d36fcab05004dc20bcf09b01255950 --force-share --output=json" returned: 0 in 0.204s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Acquiring lock "refresh_cache-e2846f03-5074-495b-831f-734dd477dc18" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Acquired lock "refresh_cache-e2846f03-5074-495b-831f-734dd477dc18" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-b58a9ea7-61f1-4a6d-ac36-a8e67b1f49f5 req-c9fc6962-605e-4fc6-a7b2-c694cfcc9e59 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] Received event network-changed-511788fe-0c9e-486f-a19f-88012fe9005a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-b58a9ea7-61f1-4a6d-ac36-a8e67b1f49f5 req-c9fc6962-605e-4fc6-a7b2-c694cfcc9e59 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] Refreshing instance network info cache due to event network-changed-511788fe-0c9e-486f-a19f-88012fe9005a. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b58a9ea7-61f1-4a6d-ac36-a8e67b1f49f5 req-c9fc6962-605e-4fc6-a7b2-c694cfcc9e59 service nova] Acquiring lock "refresh_cache-e2846f03-5074-495b-831f-734dd477dc18" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.219s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG nova.policy [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '061c5fc508834521bad235359e96006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72226dbcf9349bbbedd3303f48f5182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Cannot resize image /opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lazy-loading 'migration_context' on Instance uuid e2846f03-5074-495b-831f-734dd477dc18 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Ensure instance console log exists: /opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.165s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk 1073741824" returned: 0 in 0.060s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG nova.network.neutron [req-e54c0fe8-46e4-4fbf-8391-73d4724a5df3 req-2dd61b9b-4e26-4e65-a36e-baaa2124fb7a service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Updated VIF entry in instance network info cache for port 4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG nova.network.neutron [req-e54c0fe8-46e4-4fbf-8391-73d4724a5df3 req-2dd61b9b-4e26-4e65-a36e-baaa2124fb7a service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Updating instance_info_cache with network_info: [{"id": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "address": "fa:16:3e:dc:2e:04", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd9ef98-ad", "ovs_interfaceid": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e54c0fe8-46e4-4fbf-8391-73d4724a5df3 req-2dd61b9b-4e26-4e65-a36e-baaa2124fb7a service nova] Releasing lock "refresh_cache-02d227b0-2b25-467f-a318-ab46aa391a31" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.162s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Cannot resize image /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG nova.objects.instance [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lazy-loading 'migration_context' on Instance uuid c918ea78-9bf8-421c-9a31-0da4104cd032 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Ensure instance console log exists: /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:44 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Updating instance_info_cache with network_info: [{"id": "511788fe-0c9e-486f-a19f-88012fe9005a", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "b7744e37-5b24-4946-90ab-b6481a3ba3e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-948989826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "470dd7d54793417288d2ba2fd8f06dbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511788fe-0c", "ovs_interfaceid": "511788fe-0c9e-486f-a19f-88012fe9005a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Releasing lock "refresh_cache-e2846f03-5074-495b-831f-734dd477dc18" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Instance network_info: |[{"id": "511788fe-0c9e-486f-a19f-88012fe9005a", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "b7744e37-5b24-4946-90ab-b6481a3ba3e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-948989826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "470dd7d54793417288d2ba2fd8f06dbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511788fe-0c", "ovs_interfaceid": "511788fe-0c9e-486f-a19f-88012fe9005a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b58a9ea7-61f1-4a6d-ac36-a8e67b1f49f5 req-c9fc6962-605e-4fc6-a7b2-c694cfcc9e59 service nova] Acquired lock "refresh_cache-e2846f03-5074-495b-831f-734dd477dc18" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.network.neutron [req-b58a9ea7-61f1-4a6d-ac36-a8e67b1f49f5 req-c9fc6962-605e-4fc6-a7b2-c694cfcc9e59 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] Refreshing network info cache for port 511788fe-0c9e-486f-a19f-88012fe9005a {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Start _get_guest_xml network_info=[{"id": "511788fe-0c9e-486f-a19f-88012fe9005a", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "b7744e37-5b24-4946-90ab-b6481a3ba3e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-948989826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "470dd7d54793417288d2ba2fd8f06dbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511788fe-0c", "ovs_interfaceid": "511788fe-0c9e-486f-a19f-88012fe9005a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:20:32Z,direct_url=<?>,disk_format='qcow2',id=dec6d2d9-190f-4dee-8bdf-e0f5edb3c58f,min_disk=0,min_ram=0,name='',owner='ac00ee9a31ef4d829c996b6ec35419c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:20:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/sda', 'size': 0, 'disk_bus': 'scsi', 'encryption_format': None, 'guest_format': None, 'image_id': 'dec6d2d9-190f-4dee-8bdf-e0f5edb3c58f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:20:45 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:20:45 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:20:32Z,direct_url=<?>,disk_format='qcow2',id=dec6d2d9-190f-4dee-8bdf-e0f5edb3c58f,min_disk=0,min_ram=0,name='',owner='ac00ee9a31ef4d829c996b6ec35419c7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:20:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-76910196',display_name='tempest-AttachSCSIVolumeTestJSON-server-76910196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-76910196',id=7,image_ref='dec6d2d9-190f-4dee-8bdf-e0f5edb3c58f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAohWxp5tcF4Nc5AIyB3GvB3SxwThNHKjwr9PclyRJVCuuhMlNDhU9t1XjJsPdRHv2p8dtNXzEfk98XNhfmzdQFn8nEleCpqHr3HkFeg/cZdDBqM9HdkPZa1LW4PgG+yRQ==',key_name='tempest-keypair-695897665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='470dd7d54793417288d2ba2fd8f06dbf',ramdisk_id='',reservation_id='r-hhv4m63t',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dec6d2d9-190f-4dee-8bdf-e0f5edb3c58f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-353984061',owner_user_name='tempest-AttachSCSIVolumeTestJSON-353984061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:20:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d80e50103134cc9908a7ad6763460af',uuid=e2846f03-5074-495b-831f-734dd477dc18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "511788fe-0c9e-486f-a19f-88012fe9005a", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "b7744e37-5b24-4946-90ab-b6481a3ba3e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-948989826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "470dd7d54793417288d2ba2fd8f06dbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511788fe-0c", "ovs_interfaceid": "511788fe-0c9e-486f-a19f-88012fe9005a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Converting VIF {"id": "511788fe-0c9e-486f-a19f-88012fe9005a", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "b7744e37-5b24-4946-90ab-b6481a3ba3e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-948989826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "470dd7d54793417288d2ba2fd8f06dbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511788fe-0c", "ovs_interfaceid": "511788fe-0c9e-486f-a19f-88012fe9005a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c8:2b,bridge_name='br-int',has_traffic_filtering=True,id=511788fe-0c9e-486f-a19f-88012fe9005a,network=Network(b7744e37-5b24-4946-90ab-b6481a3ba3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511788fe-0c') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lazy-loading 'pci_devices' on Instance uuid e2846f03-5074-495b-831f-734dd477dc18 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:20:45 user nova-compute[72201]:   <uuid>e2846f03-5074-495b-831f-734dd477dc18</uuid>
Aug 01 15:20:45 user nova-compute[72201]:   <name>instance-00000007</name>
Aug 01 15:20:45 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:20:45 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:20:45 user nova-compute[72201]:   <metadata>
Aug 01 15:20:45 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:20:45 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:20:45 user nova-compute[72201]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-76910196</nova:name>
Aug 01 15:20:45 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:20:45</nova:creationTime>
Aug 01 15:20:45 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:20:45 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:20:45 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:20:45 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:20:45 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:20:45 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:20:45 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:20:45 user nova-compute[72201]:       <nova:owner>
Aug 01 15:20:45 user nova-compute[72201]:         <nova:user uuid="1d80e50103134cc9908a7ad6763460af">tempest-AttachSCSIVolumeTestJSON-353984061-project-member</nova:user>
Aug 01 15:20:45 user nova-compute[72201]:         <nova:project uuid="470dd7d54793417288d2ba2fd8f06dbf">tempest-AttachSCSIVolumeTestJSON-353984061</nova:project>
Aug 01 15:20:45 user nova-compute[72201]:       </nova:owner>
Aug 01 15:20:45 user nova-compute[72201]:       <nova:root type="image" uuid="dec6d2d9-190f-4dee-8bdf-e0f5edb3c58f"/>
Aug 01 15:20:45 user nova-compute[72201]:       <nova:ports>
Aug 01 15:20:45 user nova-compute[72201]:         <nova:port uuid="511788fe-0c9e-486f-a19f-88012fe9005a">
Aug 01 15:20:45 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 15:20:45 user nova-compute[72201]:         </nova:port>
Aug 01 15:20:45 user nova-compute[72201]:       </nova:ports>
Aug 01 15:20:45 user nova-compute[72201]:     </nova:instance>
Aug 01 15:20:45 user nova-compute[72201]:   </metadata>
Aug 01 15:20:45 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:20:45 user nova-compute[72201]:     <system>
Aug 01 15:20:45 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:20:45 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:20:45 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:20:45 user nova-compute[72201]:       <entry name="serial">e2846f03-5074-495b-831f-734dd477dc18</entry>
Aug 01 15:20:45 user nova-compute[72201]:       <entry name="uuid">e2846f03-5074-495b-831f-734dd477dc18</entry>
Aug 01 15:20:45 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:20:45 user nova-compute[72201]:     </system>
Aug 01 15:20:45 user nova-compute[72201]:   </sysinfo>
Aug 01 15:20:45 user nova-compute[72201]:   <os>
Aug 01 15:20:45 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:20:45 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:20:45 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:20:45 user nova-compute[72201]:   </os>
Aug 01 15:20:45 user nova-compute[72201]:   <features>
Aug 01 15:20:45 user nova-compute[72201]:     <acpi/>
Aug 01 15:20:45 user nova-compute[72201]:     <apic/>
Aug 01 15:20:45 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:20:45 user nova-compute[72201]:   </features>
Aug 01 15:20:45 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:20:45 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:20:45 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:20:45 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:20:45 user nova-compute[72201]:   </clock>
Aug 01 15:20:45 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:20:45 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:20:45 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:20:45 user nova-compute[72201]:   </cpu>
Aug 01 15:20:45 user nova-compute[72201]:   <devices>
Aug 01 15:20:45 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:20:45 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:20:45 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk"/>
Aug 01 15:20:45 user nova-compute[72201]:       <target dev="sda" bus="scsi"/>
Aug 01 15:20:45 user nova-compute[72201]:       <address type="drive" controller="0" unit="0"/>
Aug 01 15:20:45 user nova-compute[72201]:     </disk>
Aug 01 15:20:45 user nova-compute[72201]:     <disk type="file" device="cdrom">
Aug 01 15:20:45 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 15:20:45 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk.config"/>
Aug 01 15:20:45 user nova-compute[72201]:       <target dev="sdb" bus="scsi"/>
Aug 01 15:20:45 user nova-compute[72201]:       <address type="drive" controller="0" unit="1"/>
Aug 01 15:20:45 user nova-compute[72201]:     </disk>
Aug 01 15:20:45 user nova-compute[72201]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 01 15:20:45 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:20:45 user nova-compute[72201]:       <mac address="fa:16:3e:2e:c8:2b"/>
Aug 01 15:20:45 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:20:45 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:20:45 user nova-compute[72201]:       <target dev="tap511788fe-0c"/>
Aug 01 15:20:45 user nova-compute[72201]:     </interface>
Aug 01 15:20:45 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:20:45 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/console.log" append="off"/>
Aug 01 15:20:45 user nova-compute[72201]:     </serial>
Aug 01 15:20:45 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:20:45 user nova-compute[72201]:     <video>
Aug 01 15:20:45 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:20:45 user nova-compute[72201]:     </video>
Aug 01 15:20:45 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:20:45 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:20:45 user nova-compute[72201]:     </rng>
Aug 01 15:20:45 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:20:45 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:20:45 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:20:45 user nova-compute[72201]:     </memballoon>
Aug 01 15:20:45 user nova-compute[72201]:   </devices>
Aug 01 15:20:45 user nova-compute[72201]: </domain>
Aug 01 15:20:45 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-76910196',display_name='tempest-AttachSCSIVolumeTestJSON-server-76910196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-76910196',id=7,image_ref='dec6d2d9-190f-4dee-8bdf-e0f5edb3c58f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAohWxp5tcF4Nc5AIyB3GvB3SxwThNHKjwr9PclyRJVCuuhMlNDhU9t1XjJsPdRHv2p8dtNXzEfk98XNhfmzdQFn8nEleCpqHr3HkFeg/cZdDBqM9HdkPZa1LW4PgG+yRQ==',key_name='tempest-keypair-695897665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='470dd7d54793417288d2ba2fd8f06dbf',ramdisk_id='',reservation_id='r-hhv4m63t',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dec6d2d9-190f-4dee-8bdf-e0f5edb3c58f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-353984061',owner_user_name='tempest-AttachSCSIVolumeTestJSON-353984061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:20:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d80e50103134cc9908a7ad6763460af',uuid=e2846f03-5074-495b-831f-734dd477dc18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "511788fe-0c9e-486f-a19f-88012fe9005a", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "b7744e37-5b24-4946-90ab-b6481a3ba3e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-948989826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "470dd7d54793417288d2ba2fd8f06dbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511788fe-0c", "ovs_interfaceid": "511788fe-0c9e-486f-a19f-88012fe9005a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Converting VIF {"id": "511788fe-0c9e-486f-a19f-88012fe9005a", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "b7744e37-5b24-4946-90ab-b6481a3ba3e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-948989826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "470dd7d54793417288d2ba2fd8f06dbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511788fe-0c", "ovs_interfaceid": "511788fe-0c9e-486f-a19f-88012fe9005a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c8:2b,bridge_name='br-int',has_traffic_filtering=True,id=511788fe-0c9e-486f-a19f-88012fe9005a,network=Network(b7744e37-5b24-4946-90ab-b6481a3ba3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511788fe-0c') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG os_vif [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c8:2b,bridge_name='br-int',has_traffic_filtering=True,id=511788fe-0c9e-486f-a19f-88012fe9005a,network=Network(b7744e37-5b24-4946-90ab-b6481a3ba3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511788fe-0c') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap511788fe-0c, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap511788fe-0c, col_values=(('external_ids', {'iface-id': '511788fe-0c9e-486f-a19f-88012fe9005a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:c8:2b', 'vm-uuid': 'e2846f03-5074-495b-831f-734dd477dc18'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:45 user nova-compute[72201]: INFO os_vif [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c8:2b,bridge_name='br-int',has_traffic_filtering=True,id=511788fe-0c9e-486f-a19f-88012fe9005a,network=Network(b7744e37-5b24-4946-90ab-b6481a3ba3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511788fe-0c')
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] No BDM found with device name sda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] No VIF found with MAC fa:16:3e:2e:c8:2b, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:20:45 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Using config drive
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.network.neutron [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Successfully created port: 9fa0e19a-91cd-4217-805e-f16384cdc202 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:20:45 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Creating config drive at /opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk.config
Aug 01 15:20:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9fr5w1ux {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9fr5w1ux" returned: 0 in 0.064s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.network.neutron [req-b58a9ea7-61f1-4a6d-ac36-a8e67b1f49f5 req-c9fc6962-605e-4fc6-a7b2-c694cfcc9e59 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] Updated VIF entry in instance network info cache for port 511788fe-0c9e-486f-a19f-88012fe9005a. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG nova.network.neutron [req-b58a9ea7-61f1-4a6d-ac36-a8e67b1f49f5 req-c9fc6962-605e-4fc6-a7b2-c694cfcc9e59 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] Updating instance_info_cache with network_info: [{"id": "511788fe-0c9e-486f-a19f-88012fe9005a", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "b7744e37-5b24-4946-90ab-b6481a3ba3e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-948989826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "470dd7d54793417288d2ba2fd8f06dbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511788fe-0c", "ovs_interfaceid": "511788fe-0c9e-486f-a19f-88012fe9005a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b58a9ea7-61f1-4a6d-ac36-a8e67b1f49f5 req-c9fc6962-605e-4fc6-a7b2-c694cfcc9e59 service nova] Releasing lock "refresh_cache-e2846f03-5074-495b-831f-734dd477dc18" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquiring lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:20:46 user nova-compute[72201]: INFO nova.compute.claims [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Claim successful on node user
Aug 01 15:20:46 user nova-compute[72201]: DEBUG nova.compute.manager [req-d0288d39-23d5-497a-9104-3b1fe852f228 req-5e12c9de-c929-437e-9d49-2da9e2f11419 service nova] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Received event network-vif-plugged-b1af805e-79e9-469b-a431-6938abe1b0e5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d0288d39-23d5-497a-9104-3b1fe852f228 req-5e12c9de-c929-437e-9d49-2da9e2f11419 service nova] Acquiring lock "cb684e00-1740-402d-b3c5-c14eaf7e8054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d0288d39-23d5-497a-9104-3b1fe852f228 req-5e12c9de-c929-437e-9d49-2da9e2f11419 service nova] Lock "cb684e00-1740-402d-b3c5-c14eaf7e8054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d0288d39-23d5-497a-9104-3b1fe852f228 req-5e12c9de-c929-437e-9d49-2da9e2f11419 service nova] Lock "cb684e00-1740-402d-b3c5-c14eaf7e8054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG nova.compute.manager [req-d0288d39-23d5-497a-9104-3b1fe852f228 req-5e12c9de-c929-437e-9d49-2da9e2f11419 service nova] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] No waiting events found dispatching network-vif-plugged-b1af805e-79e9-469b-a431-6938abe1b0e5 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:20:46 user nova-compute[72201]: WARNING nova.compute.manager [req-d0288d39-23d5-497a-9104-3b1fe852f228 req-5e12c9de-c929-437e-9d49-2da9e2f11419 service nova] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Received unexpected event network-vif-plugged-b1af805e-79e9-469b-a431-6938abe1b0e5 for instance with vm_state building and task_state spawning.
Aug 01 15:20:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG nova.network.neutron [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Successfully updated port: 9fa0e19a-91cd-4217-805e-f16384cdc202 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Acquiring lock "refresh_cache-c918ea78-9bf8-421c-9a31-0da4104cd032" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Acquired lock "refresh_cache-c918ea78-9bf8-421c-9a31-0da4104cd032" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG nova.network.neutron [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG nova.network.neutron [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:20:46 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:20:46 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:20:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.policy [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecc1134a7e7a4eca98878addce19027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec3967bfce4075a5b38e1f0ec13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:20:47 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Creating image(s)
Aug 01 15:20:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquiring lock "/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.network.neutron [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Updating instance_info_cache with network_info: [{"id": "9fa0e19a-91cd-4217-805e-f16384cdc202", "address": "fa:16:3e:ed:51:e0", "network": {"id": "e2b28e3d-396a-4811-9197-38a25d473000", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1150356177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72226dbcf9349bbbedd3303f48f5182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa0e19a-91", "ovs_interfaceid": "9fa0e19a-91cd-4217-805e-f16384cdc202", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Releasing lock "refresh_cache-c918ea78-9bf8-421c-9a31-0da4104cd032" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Instance network_info: |[{"id": "9fa0e19a-91cd-4217-805e-f16384cdc202", "address": "fa:16:3e:ed:51:e0", "network": {"id": "e2b28e3d-396a-4811-9197-38a25d473000", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1150356177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72226dbcf9349bbbedd3303f48f5182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa0e19a-91", "ovs_interfaceid": "9fa0e19a-91cd-4217-805e-f16384cdc202", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Start _get_guest_xml network_info=[{"id": "9fa0e19a-91cd-4217-805e-f16384cdc202", "address": "fa:16:3e:ed:51:e0", "network": {"id": "e2b28e3d-396a-4811-9197-38a25d473000", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1150356177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72226dbcf9349bbbedd3303f48f5182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa0e19a-91", "ovs_interfaceid": "9fa0e19a-91cd-4217-805e-f16384cdc202", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:20:47 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:20:47 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2063844553',display_name='tempest-TestVolumeSwap-server-2063844553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2063844553',id=8,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG31zKdjA+nV3aViiy/kA7pD76euxim7XGL8RdaM7NlJPaMI82FEiG2z4hgiDpepdhdpGZD/NLDfQyGKa+MJFH//JHaXb7ubOrH464F7FjIz8ZPJ7vVujz70wKWIEiLMQw==',key_name='tempest-keypair-1763906668',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a72226dbcf9349bbbedd3303f48f5182',ramdisk_id='',reservation_id='r-0dcz74z5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1195353484',owner_user_name='tempest-TestVolumeSwap-1195353484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061c5fc508834521bad235359e96006b',uuid=c918ea78-9bf8-421c-9a31-0da4104cd032,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fa0e19a-91cd-4217-805e-f16384cdc202", "address": "fa:16:3e:ed:51:e0", "network": {"id": "e2b28e3d-396a-4811-9197-38a25d473000", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1150356177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72226dbcf9349bbbedd3303f48f5182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa0e19a-91", "ovs_interfaceid": "9fa0e19a-91cd-4217-805e-f16384cdc202", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Converting VIF {"id": "9fa0e19a-91cd-4217-805e-f16384cdc202", "address": "fa:16:3e:ed:51:e0", "network": {"id": "e2b28e3d-396a-4811-9197-38a25d473000", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1150356177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72226dbcf9349bbbedd3303f48f5182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa0e19a-91", "ovs_interfaceid": "9fa0e19a-91cd-4217-805e-f16384cdc202", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:51:e0,bridge_name='br-int',has_traffic_filtering=True,id=9fa0e19a-91cd-4217-805e-f16384cdc202,network=Network(e2b28e3d-396a-4811-9197-38a25d473000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa0e19a-91') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.objects.instance [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lazy-loading 'pci_devices' on Instance uuid c918ea78-9bf8-421c-9a31-0da4104cd032 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.151s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:20:47 user nova-compute[72201]:   <uuid>c918ea78-9bf8-421c-9a31-0da4104cd032</uuid>
Aug 01 15:20:47 user nova-compute[72201]:   <name>instance-00000008</name>
Aug 01 15:20:47 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:20:47 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:20:47 user nova-compute[72201]:   <metadata>
Aug 01 15:20:47 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:20:47 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:20:47 user nova-compute[72201]:       <nova:name>tempest-TestVolumeSwap-server-2063844553</nova:name>
Aug 01 15:20:47 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:20:47</nova:creationTime>
Aug 01 15:20:47 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:20:47 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:20:47 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:20:47 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:20:47 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:20:47 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:20:47 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:20:47 user nova-compute[72201]:       <nova:owner>
Aug 01 15:20:47 user nova-compute[72201]:         <nova:user uuid="061c5fc508834521bad235359e96006b">tempest-TestVolumeSwap-1195353484-project-member</nova:user>
Aug 01 15:20:47 user nova-compute[72201]:         <nova:project uuid="a72226dbcf9349bbbedd3303f48f5182">tempest-TestVolumeSwap-1195353484</nova:project>
Aug 01 15:20:47 user nova-compute[72201]:       </nova:owner>
Aug 01 15:20:47 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:20:47 user nova-compute[72201]:       <nova:ports>
Aug 01 15:20:47 user nova-compute[72201]:         <nova:port uuid="9fa0e19a-91cd-4217-805e-f16384cdc202">
Aug 01 15:20:47 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 15:20:47 user nova-compute[72201]:         </nova:port>
Aug 01 15:20:47 user nova-compute[72201]:       </nova:ports>
Aug 01 15:20:47 user nova-compute[72201]:     </nova:instance>
Aug 01 15:20:47 user nova-compute[72201]:   </metadata>
Aug 01 15:20:47 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:20:47 user nova-compute[72201]:     <system>
Aug 01 15:20:47 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:20:47 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:20:47 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:20:47 user nova-compute[72201]:       <entry name="serial">c918ea78-9bf8-421c-9a31-0da4104cd032</entry>
Aug 01 15:20:47 user nova-compute[72201]:       <entry name="uuid">c918ea78-9bf8-421c-9a31-0da4104cd032</entry>
Aug 01 15:20:47 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:20:47 user nova-compute[72201]:     </system>
Aug 01 15:20:47 user nova-compute[72201]:   </sysinfo>
Aug 01 15:20:47 user nova-compute[72201]:   <os>
Aug 01 15:20:47 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:20:47 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:20:47 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:20:47 user nova-compute[72201]:   </os>
Aug 01 15:20:47 user nova-compute[72201]:   <features>
Aug 01 15:20:47 user nova-compute[72201]:     <acpi/>
Aug 01 15:20:47 user nova-compute[72201]:     <apic/>
Aug 01 15:20:47 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:20:47 user nova-compute[72201]:   </features>
Aug 01 15:20:47 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:20:47 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:20:47 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:20:47 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:20:47 user nova-compute[72201]:   </clock>
Aug 01 15:20:47 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:20:47 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:20:47 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:20:47 user nova-compute[72201]:   </cpu>
Aug 01 15:20:47 user nova-compute[72201]:   <devices>
Aug 01 15:20:47 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:20:47 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:20:47 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk"/>
Aug 01 15:20:47 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:20:47 user nova-compute[72201]:     </disk>
Aug 01 15:20:47 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:20:47 user nova-compute[72201]:       <mac address="fa:16:3e:ed:51:e0"/>
Aug 01 15:20:47 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:20:47 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:20:47 user nova-compute[72201]:       <target dev="tap9fa0e19a-91"/>
Aug 01 15:20:47 user nova-compute[72201]:     </interface>
Aug 01 15:20:47 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:20:47 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/console.log" append="off"/>
Aug 01 15:20:47 user nova-compute[72201]:     </serial>
Aug 01 15:20:47 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:20:47 user nova-compute[72201]:     <video>
Aug 01 15:20:47 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:20:47 user nova-compute[72201]:     </video>
Aug 01 15:20:47 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:20:47 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:20:47 user nova-compute[72201]:     </rng>
Aug 01 15:20:47 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:20:47 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:20:47 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:20:47 user nova-compute[72201]:     </memballoon>
Aug 01 15:20:47 user nova-compute[72201]:   </devices>
Aug 01 15:20:47 user nova-compute[72201]: </domain>
Aug 01 15:20:47 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2063844553',display_name='tempest-TestVolumeSwap-server-2063844553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2063844553',id=8,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG31zKdjA+nV3aViiy/kA7pD76euxim7XGL8RdaM7NlJPaMI82FEiG2z4hgiDpepdhdpGZD/NLDfQyGKa+MJFH//JHaXb7ubOrH464F7FjIz8ZPJ7vVujz70wKWIEiLMQw==',key_name='tempest-keypair-1763906668',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a72226dbcf9349bbbedd3303f48f5182',ramdisk_id='',reservation_id='r-0dcz74z5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1195353484',owner_user_name='tempest-TestVolumeSwap-1195353484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061c5fc508834521bad235359e96006b',uuid=c918ea78-9bf8-421c-9a31-0da4104cd032,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fa0e19a-91cd-4217-805e-f16384cdc202", "address": "fa:16:3e:ed:51:e0", "network": {"id": "e2b28e3d-396a-4811-9197-38a25d473000", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1150356177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72226dbcf9349bbbedd3303f48f5182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa0e19a-91", "ovs_interfaceid": "9fa0e19a-91cd-4217-805e-f16384cdc202", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Converting VIF {"id": "9fa0e19a-91cd-4217-805e-f16384cdc202", "address": "fa:16:3e:ed:51:e0", "network": {"id": "e2b28e3d-396a-4811-9197-38a25d473000", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1150356177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72226dbcf9349bbbedd3303f48f5182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa0e19a-91", "ovs_interfaceid": "9fa0e19a-91cd-4217-805e-f16384cdc202", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:51:e0,bridge_name='br-int',has_traffic_filtering=True,id=9fa0e19a-91cd-4217-805e-f16384cdc202,network=Network(e2b28e3d-396a-4811-9197-38a25d473000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa0e19a-91') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG os_vif [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:51:e0,bridge_name='br-int',has_traffic_filtering=True,id=9fa0e19a-91cd-4217-805e-f16384cdc202,network=Network(e2b28e3d-396a-4811-9197-38a25d473000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa0e19a-91') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fa0e19a-91, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9fa0e19a-91, col_values=(('external_ids', {'iface-id': '9fa0e19a-91cd-4217-805e-f16384cdc202', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:51:e0', 'vm-uuid': 'c918ea78-9bf8-421c-9a31-0da4104cd032'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:47 user nova-compute[72201]: INFO os_vif [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:51:e0,bridge_name='br-int',has_traffic_filtering=True,id=9fa0e19a-91cd-4217-805e-f16384cdc202,network=Network(e2b28e3d-396a-4811-9197-38a25d473000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa0e19a-91')
Aug 01 15:20:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.181s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk 1073741824" returned: 0 in 0.084s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] No VIF found with MAC fa:16:3e:ed:51:e0, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.159s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Successfully created port: 1740420d-31a4-494e-a19f-965960ba2b7c {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Cannot resize image /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lazy-loading 'migration_context' on Instance uuid 0331ddd6-3aa1-47df-b1a3-4d539d26c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Ensure instance console log exists: /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:48 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Successfully updated port: 1740420d-31a4-494e-a19f-965960ba2b7c {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:20:48 user nova-compute[72201]: DEBUG nova.compute.manager [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Received event network-changed-9fa0e19a-91cd-4217-805e-f16384cdc202 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:48 user nova-compute[72201]: DEBUG nova.compute.manager [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Refreshing instance network info cache due to event network-changed-9fa0e19a-91cd-4217-805e-f16384cdc202. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:20:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] Acquiring lock "refresh_cache-c918ea78-9bf8-421c-9a31-0da4104cd032" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:20:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] Acquired lock "refresh_cache-c918ea78-9bf8-421c-9a31-0da4104cd032" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:20:48 user nova-compute[72201]: DEBUG nova.network.neutron [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Refreshing network info cache for port 9fa0e19a-91cd-4217-805e-f16384cdc202 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:20:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquiring lock "refresh_cache-0331ddd6-3aa1-47df-b1a3-4d539d26c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:20:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquired lock "refresh_cache-0331ddd6-3aa1-47df-b1a3-4d539d26c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:20:48 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:20:48 user nova-compute[72201]: DEBUG nova.compute.manager [req-37f33027-ad77-4727-95c6-98ca1910b627 req-758069f1-99cd-43e0-baa5-14f7c3a120dd service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Received event network-changed-1740420d-31a4-494e-a19f-965960ba2b7c {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:48 user nova-compute[72201]: DEBUG nova.compute.manager [req-37f33027-ad77-4727-95c6-98ca1910b627 req-758069f1-99cd-43e0-baa5-14f7c3a120dd service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Refreshing instance network info cache due to event network-changed-1740420d-31a4-494e-a19f-965960ba2b7c. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:20:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-37f33027-ad77-4727-95c6-98ca1910b627 req-758069f1-99cd-43e0-baa5-14f7c3a120dd service nova] Acquiring lock "refresh_cache-0331ddd6-3aa1-47df-b1a3-4d539d26c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:20:48 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Updating instance_info_cache with network_info: [{"id": "1740420d-31a4-494e-a19f-965960ba2b7c", "address": "fa:16:3e:b4:92:64", "network": {"id": "acf9d14a-8412-4dc0-80f9-ddfe2774470e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2056245363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1740420d-31", "ovs_interfaceid": "1740420d-31a4-494e-a19f-965960ba2b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Releasing lock "refresh_cache-0331ddd6-3aa1-47df-b1a3-4d539d26c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Instance network_info: |[{"id": "1740420d-31a4-494e-a19f-965960ba2b7c", "address": "fa:16:3e:b4:92:64", "network": {"id": "acf9d14a-8412-4dc0-80f9-ddfe2774470e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2056245363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1740420d-31", "ovs_interfaceid": "1740420d-31a4-494e-a19f-965960ba2b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-37f33027-ad77-4727-95c6-98ca1910b627 req-758069f1-99cd-43e0-baa5-14f7c3a120dd service nova] Acquired lock "refresh_cache-0331ddd6-3aa1-47df-b1a3-4d539d26c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.network.neutron [req-37f33027-ad77-4727-95c6-98ca1910b627 req-758069f1-99cd-43e0-baa5-14f7c3a120dd service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Refreshing network info cache for port 1740420d-31a4-494e-a19f-965960ba2b7c {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Start _get_guest_xml network_info=[{"id": "1740420d-31a4-494e-a19f-965960ba2b7c", "address": "fa:16:3e:b4:92:64", "network": {"id": "acf9d14a-8412-4dc0-80f9-ddfe2774470e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2056245363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1740420d-31", "ovs_interfaceid": "1740420d-31a4-494e-a19f-965960ba2b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:20:49 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:20:49 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550987008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550987008',id=9,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKW0L2BXVsQ16XJ1IgW7J0+ugbX8pR23c/F0Bw5rv53o6+cDAxLCYwwmfBY+G8LBeeB3d6298OqDBKDi82m1vX50J7S1dTl4hFC+o+fm8gp01ukaYRBYhLpJ7oFuNVTSw==',key_name='tempest-keypair-1696360347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1ec3967bfce4075a5b38e1f0ec13907',ramdisk_id='',reservation_id='r-7ql6n7s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1871630489',owner_user_name='tempest-TaggedAttachmentsTest-1871630489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:20:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecc1134a7e7a4eca98878addce19027b',uuid=0331ddd6-3aa1-47df-b1a3-4d539d26c708,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1740420d-31a4-494e-a19f-965960ba2b7c", "address": "fa:16:3e:b4:92:64", "network": {"id": "acf9d14a-8412-4dc0-80f9-ddfe2774470e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2056245363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1740420d-31", "ovs_interfaceid": "1740420d-31a4-494e-a19f-965960ba2b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Converting VIF {"id": "1740420d-31a4-494e-a19f-965960ba2b7c", "address": "fa:16:3e:b4:92:64", "network": {"id": "acf9d14a-8412-4dc0-80f9-ddfe2774470e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2056245363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1740420d-31", "ovs_interfaceid": "1740420d-31a4-494e-a19f-965960ba2b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:92:64,bridge_name='br-int',has_traffic_filtering=True,id=1740420d-31a4-494e-a19f-965960ba2b7c,network=Network(acf9d14a-8412-4dc0-80f9-ddfe2774470e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1740420d-31') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lazy-loading 'pci_devices' on Instance uuid 0331ddd6-3aa1-47df-b1a3-4d539d26c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:20:49 user nova-compute[72201]:   <uuid>0331ddd6-3aa1-47df-b1a3-4d539d26c708</uuid>
Aug 01 15:20:49 user nova-compute[72201]:   <name>instance-00000009</name>
Aug 01 15:20:49 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:20:49 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:20:49 user nova-compute[72201]:   <metadata>
Aug 01 15:20:49 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:20:49 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:20:49 user nova-compute[72201]:       <nova:name>tempest-device-tagging-server-550987008</nova:name>
Aug 01 15:20:49 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:20:49</nova:creationTime>
Aug 01 15:20:49 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:20:49 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:20:49 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:20:49 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:20:49 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:20:49 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:20:49 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:20:49 user nova-compute[72201]:       <nova:owner>
Aug 01 15:20:49 user nova-compute[72201]:         <nova:user uuid="ecc1134a7e7a4eca98878addce19027b">tempest-TaggedAttachmentsTest-1871630489-project-member</nova:user>
Aug 01 15:20:49 user nova-compute[72201]:         <nova:project uuid="a1ec3967bfce4075a5b38e1f0ec13907">tempest-TaggedAttachmentsTest-1871630489</nova:project>
Aug 01 15:20:49 user nova-compute[72201]:       </nova:owner>
Aug 01 15:20:49 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:20:49 user nova-compute[72201]:       <nova:ports>
Aug 01 15:20:49 user nova-compute[72201]:         <nova:port uuid="1740420d-31a4-494e-a19f-965960ba2b7c">
Aug 01 15:20:49 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 15:20:49 user nova-compute[72201]:         </nova:port>
Aug 01 15:20:49 user nova-compute[72201]:       </nova:ports>
Aug 01 15:20:49 user nova-compute[72201]:     </nova:instance>
Aug 01 15:20:49 user nova-compute[72201]:   </metadata>
Aug 01 15:20:49 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:20:49 user nova-compute[72201]:     <system>
Aug 01 15:20:49 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:20:49 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:20:49 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:20:49 user nova-compute[72201]:       <entry name="serial">0331ddd6-3aa1-47df-b1a3-4d539d26c708</entry>
Aug 01 15:20:49 user nova-compute[72201]:       <entry name="uuid">0331ddd6-3aa1-47df-b1a3-4d539d26c708</entry>
Aug 01 15:20:49 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:20:49 user nova-compute[72201]:     </system>
Aug 01 15:20:49 user nova-compute[72201]:   </sysinfo>
Aug 01 15:20:49 user nova-compute[72201]:   <os>
Aug 01 15:20:49 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:20:49 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:20:49 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:20:49 user nova-compute[72201]:   </os>
Aug 01 15:20:49 user nova-compute[72201]:   <features>
Aug 01 15:20:49 user nova-compute[72201]:     <acpi/>
Aug 01 15:20:49 user nova-compute[72201]:     <apic/>
Aug 01 15:20:49 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:20:49 user nova-compute[72201]:   </features>
Aug 01 15:20:49 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:20:49 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:20:49 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:20:49 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:20:49 user nova-compute[72201]:   </clock>
Aug 01 15:20:49 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:20:49 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:20:49 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:20:49 user nova-compute[72201]:   </cpu>
Aug 01 15:20:49 user nova-compute[72201]:   <devices>
Aug 01 15:20:49 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:20:49 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:20:49 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk"/>
Aug 01 15:20:49 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:20:49 user nova-compute[72201]:     </disk>
Aug 01 15:20:49 user nova-compute[72201]:     <disk type="file" device="cdrom">
Aug 01 15:20:49 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 15:20:49 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk.config"/>
Aug 01 15:20:49 user nova-compute[72201]:       <target dev="hda" bus="ide"/>
Aug 01 15:20:49 user nova-compute[72201]:     </disk>
Aug 01 15:20:49 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:20:49 user nova-compute[72201]:       <mac address="fa:16:3e:b4:92:64"/>
Aug 01 15:20:49 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:20:49 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:20:49 user nova-compute[72201]:       <target dev="tap1740420d-31"/>
Aug 01 15:20:49 user nova-compute[72201]:     </interface>
Aug 01 15:20:49 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:20:49 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/console.log" append="off"/>
Aug 01 15:20:49 user nova-compute[72201]:     </serial>
Aug 01 15:20:49 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:20:49 user nova-compute[72201]:     <video>
Aug 01 15:20:49 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:20:49 user nova-compute[72201]:     </video>
Aug 01 15:20:49 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:20:49 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:20:49 user nova-compute[72201]:     </rng>
Aug 01 15:20:49 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:20:49 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:20:49 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:20:49 user nova-compute[72201]:     </memballoon>
Aug 01 15:20:49 user nova-compute[72201]:   </devices>
Aug 01 15:20:49 user nova-compute[72201]: </domain>
Aug 01 15:20:49 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550987008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550987008',id=9,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKW0L2BXVsQ16XJ1IgW7J0+ugbX8pR23c/F0Bw5rv53o6+cDAxLCYwwmfBY+G8LBeeB3d6298OqDBKDi82m1vX50J7S1dTl4hFC+o+fm8gp01ukaYRBYhLpJ7oFuNVTSw==',key_name='tempest-keypair-1696360347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1ec3967bfce4075a5b38e1f0ec13907',ramdisk_id='',reservation_id='r-7ql6n7s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1871630489',owner_user_name='tempest-TaggedAttachmentsTest-1871630489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:20:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecc1134a7e7a4eca98878addce19027b',uuid=0331ddd6-3aa1-47df-b1a3-4d539d26c708,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1740420d-31a4-494e-a19f-965960ba2b7c", "address": "fa:16:3e:b4:92:64", "network": {"id": "acf9d14a-8412-4dc0-80f9-ddfe2774470e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2056245363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1740420d-31", "ovs_interfaceid": "1740420d-31a4-494e-a19f-965960ba2b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Converting VIF {"id": "1740420d-31a4-494e-a19f-965960ba2b7c", "address": "fa:16:3e:b4:92:64", "network": {"id": "acf9d14a-8412-4dc0-80f9-ddfe2774470e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2056245363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1740420d-31", "ovs_interfaceid": "1740420d-31a4-494e-a19f-965960ba2b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:92:64,bridge_name='br-int',has_traffic_filtering=True,id=1740420d-31a4-494e-a19f-965960ba2b7c,network=Network(acf9d14a-8412-4dc0-80f9-ddfe2774470e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1740420d-31') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG os_vif [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:92:64,bridge_name='br-int',has_traffic_filtering=True,id=1740420d-31a4-494e-a19f-965960ba2b7c,network=Network(acf9d14a-8412-4dc0-80f9-ddfe2774470e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1740420d-31') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1740420d-31, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1740420d-31, col_values=(('external_ids', {'iface-id': '1740420d-31a4-494e-a19f-965960ba2b7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:92:64', 'vm-uuid': '0331ddd6-3aa1-47df-b1a3-4d539d26c708'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:49 user nova-compute[72201]: INFO os_vif [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:92:64,bridge_name='br-int',has_traffic_filtering=True,id=1740420d-31a4-494e-a19f-965960ba2b7c,network=Network(acf9d14a-8412-4dc0-80f9-ddfe2774470e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1740420d-31')
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.network.neutron [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Updated VIF entry in instance network info cache for port 9fa0e19a-91cd-4217-805e-f16384cdc202. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.network.neutron [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Updating instance_info_cache with network_info: [{"id": "9fa0e19a-91cd-4217-805e-f16384cdc202", "address": "fa:16:3e:ed:51:e0", "network": {"id": "e2b28e3d-396a-4811-9197-38a25d473000", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1150356177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72226dbcf9349bbbedd3303f48f5182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa0e19a-91", "ovs_interfaceid": "9fa0e19a-91cd-4217-805e-f16384cdc202", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] Releasing lock "refresh_cache-c918ea78-9bf8-421c-9a31-0da4104cd032" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.compute.manager [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Received event network-vif-plugged-b1af805e-79e9-469b-a431-6938abe1b0e5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] Acquiring lock "cb684e00-1740-402d-b3c5-c14eaf7e8054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] Lock "cb684e00-1740-402d-b3c5-c14eaf7e8054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] Lock "cb684e00-1740-402d-b3c5-c14eaf7e8054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.compute.manager [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] No waiting events found dispatching network-vif-plugged-b1af805e-79e9-469b-a431-6938abe1b0e5 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:20:49 user nova-compute[72201]: WARNING nova.compute.manager [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Received unexpected event network-vif-plugged-b1af805e-79e9-469b-a431-6938abe1b0e5 for instance with vm_state building and task_state spawning.
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.compute.manager [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Received event network-vif-plugged-4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] Acquiring lock "02d227b0-2b25-467f-a318-ab46aa391a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] Lock "02d227b0-2b25-467f-a318-ab46aa391a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] Lock "02d227b0-2b25-467f-a318-ab46aa391a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.compute.manager [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] No waiting events found dispatching network-vif-plugged-4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:20:49 user nova-compute[72201]: WARNING nova.compute.manager [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Received unexpected event network-vif-plugged-4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9 for instance with vm_state building and task_state spawning.
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.compute.manager [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Received event network-vif-plugged-4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] Acquiring lock "02d227b0-2b25-467f-a318-ab46aa391a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] Lock "02d227b0-2b25-467f-a318-ab46aa391a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] Lock "02d227b0-2b25-467f-a318-ab46aa391a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.compute.manager [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] No waiting events found dispatching network-vif-plugged-4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:20:49 user nova-compute[72201]: WARNING nova.compute.manager [req-82e8b60d-5ca3-4abf-8ef7-5fd438baffd2 req-86e96e16-1da3-42af-bcab-432e0daee716 service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Received unexpected event network-vif-plugged-4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9 for instance with vm_state building and task_state spawning.
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] No BDM found with device name hda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] No VIF found with MAC fa:16:3e:b4:92:64, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:20:49 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Using config drive
Aug 01 15:20:49 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Creating config drive at /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk.config
Aug 01 15:20:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnmwjlrnv {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnmwjlrnv" returned: 0 in 0.055s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.network.neutron [req-37f33027-ad77-4727-95c6-98ca1910b627 req-758069f1-99cd-43e0-baa5-14f7c3a120dd service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Updated VIF entry in instance network info cache for port 1740420d-31a4-494e-a19f-965960ba2b7c. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG nova.network.neutron [req-37f33027-ad77-4727-95c6-98ca1910b627 req-758069f1-99cd-43e0-baa5-14f7c3a120dd service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Updating instance_info_cache with network_info: [{"id": "1740420d-31a4-494e-a19f-965960ba2b7c", "address": "fa:16:3e:b4:92:64", "network": {"id": "acf9d14a-8412-4dc0-80f9-ddfe2774470e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2056245363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1740420d-31", "ovs_interfaceid": "1740420d-31a4-494e-a19f-965960ba2b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-37f33027-ad77-4727-95c6-98ca1910b627 req-758069f1-99cd-43e0-baa5-14f7c3a120dd service nova] Releasing lock "refresh_cache-0331ddd6-3aa1-47df-b1a3-4d539d26c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] Received event network-vif-plugged-511788fe-0c9e-486f-a19f-88012fe9005a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] Acquiring lock "e2846f03-5074-495b-831f-734dd477dc18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] Lock "e2846f03-5074-495b-831f-734dd477dc18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] Lock "e2846f03-5074-495b-831f-734dd477dc18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] No waiting events found dispatching network-vif-plugged-511788fe-0c9e-486f-a19f-88012fe9005a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:20:50 user nova-compute[72201]: WARNING nova.compute.manager [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] Received unexpected event network-vif-plugged-511788fe-0c9e-486f-a19f-88012fe9005a for instance with vm_state building and task_state spawning.
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] Received event network-vif-plugged-511788fe-0c9e-486f-a19f-88012fe9005a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] Acquiring lock "e2846f03-5074-495b-831f-734dd477dc18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] Lock "e2846f03-5074-495b-831f-734dd477dc18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] Lock "e2846f03-5074-495b-831f-734dd477dc18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] No waiting events found dispatching network-vif-plugged-511788fe-0c9e-486f-a19f-88012fe9005a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:20:50 user nova-compute[72201]: WARNING nova.compute.manager [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] Received unexpected event network-vif-plugged-511788fe-0c9e-486f-a19f-88012fe9005a for instance with vm_state building and task_state spawning.
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Received event network-vif-plugged-9fa0e19a-91cd-4217-805e-f16384cdc202 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] Acquiring lock "c918ea78-9bf8-421c-9a31-0da4104cd032-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] No waiting events found dispatching network-vif-plugged-9fa0e19a-91cd-4217-805e-f16384cdc202 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:20:50 user nova-compute[72201]: WARNING nova.compute.manager [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Received unexpected event network-vif-plugged-9fa0e19a-91cd-4217-805e-f16384cdc202 for instance with vm_state building and task_state spawning.
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Received event network-vif-plugged-9fa0e19a-91cd-4217-805e-f16384cdc202 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] Acquiring lock "c918ea78-9bf8-421c-9a31-0da4104cd032-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] No waiting events found dispatching network-vif-plugged-9fa0e19a-91cd-4217-805e-f16384cdc202 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:20:50 user nova-compute[72201]: WARNING nova.compute.manager [req-841540fc-22a2-43c9-94e7-868a4934a1b3 req-64908280-c9d3-4658-90dd-b9f1439a51b4 service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Received unexpected event network-vif-plugged-9fa0e19a-91cd-4217-805e-f16384cdc202 for instance with vm_state building and task_state spawning.
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903250.6203492, cb684e00-1740-402d-b3c5-c14eaf7e8054 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:20:50 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] VM Resumed (Lifecycle Event)
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:20:50 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Instance spawned successfully.
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:50 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903250.6259959, cb684e00-1740-402d-b3c5-c14eaf7e8054 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:20:50 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] VM Started (Lifecycle Event)
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:20:50 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:20:50 user nova-compute[72201]: INFO nova.compute.manager [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Took 12.91 seconds to spawn the instance on the hypervisor.
Aug 01 15:20:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:50 user nova-compute[72201]: INFO nova.compute.manager [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Took 14.13 seconds to build instance.
Aug 01 15:20:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f13b219d-8fff-4ad5-8d86-661be1d39d1c tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Lock "cb684e00-1740-402d-b3c5-c14eaf7e8054" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.448s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:52 user nova-compute[72201]: DEBUG nova.compute.manager [req-0a2eafed-beb4-4f07-9ddf-ff960f811135 req-8a0b4098-eac2-45e0-9ece-2b9e28ba58ea service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Received event network-vif-plugged-1740420d-31a4-494e-a19f-965960ba2b7c {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0a2eafed-beb4-4f07-9ddf-ff960f811135 req-8a0b4098-eac2-45e0-9ece-2b9e28ba58ea service nova] Acquiring lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0a2eafed-beb4-4f07-9ddf-ff960f811135 req-8a0b4098-eac2-45e0-9ece-2b9e28ba58ea service nova] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0a2eafed-beb4-4f07-9ddf-ff960f811135 req-8a0b4098-eac2-45e0-9ece-2b9e28ba58ea service nova] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:52 user nova-compute[72201]: DEBUG nova.compute.manager [req-0a2eafed-beb4-4f07-9ddf-ff960f811135 req-8a0b4098-eac2-45e0-9ece-2b9e28ba58ea service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] No waiting events found dispatching network-vif-plugged-1740420d-31a4-494e-a19f-965960ba2b7c {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:20:52 user nova-compute[72201]: WARNING nova.compute.manager [req-0a2eafed-beb4-4f07-9ddf-ff960f811135 req-8a0b4098-eac2-45e0-9ece-2b9e28ba58ea service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Received unexpected event network-vif-plugged-1740420d-31a4-494e-a19f-965960ba2b7c for instance with vm_state building and task_state spawning.
Aug 01 15:20:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] There are 0 instances to clean {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72201) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903253.205828, 02d227b0-2b25-467f-a318-ab46aa391a31 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:20:53 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] VM Resumed (Lifecycle Event)
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:20:53 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Instance spawned successfully.
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:20:53 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903253.2059546, 02d227b0-2b25-467f-a318-ab46aa391a31 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:20:53 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] VM Started (Lifecycle Event)
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:20:53 user nova-compute[72201]: INFO nova.compute.manager [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Took 14.10 seconds to spawn the instance on the hypervisor.
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:53 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:20:53 user nova-compute[72201]: INFO nova.compute.manager [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Took 15.22 seconds to build instance.
Aug 01 15:20:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82b4fa54-b5d0-4dc6-b658-8d39f727e06f tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "02d227b0-2b25-467f-a318-ab46aa391a31" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.427s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903253.7128353, e2846f03-5074-495b-831f-734dd477dc18 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:20:53 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2846f03-5074-495b-831f-734dd477dc18] VM Resumed (Lifecycle Event)
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:20:53 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: e2846f03-5074-495b-831f-734dd477dc18] Instance spawned successfully.
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2846f03-5074-495b-831f-734dd477dc18] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2846f03-5074-495b-831f-734dd477dc18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:20:53 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2846f03-5074-495b-831f-734dd477dc18] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903253.7157834, e2846f03-5074-495b-831f-734dd477dc18 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:20:53 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2846f03-5074-495b-831f-734dd477dc18] VM Started (Lifecycle Event)
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2846f03-5074-495b-831f-734dd477dc18] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2846f03-5074-495b-831f-734dd477dc18] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:20:53 user nova-compute[72201]: INFO nova.compute.manager [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Took 12.06 seconds to spawn the instance on the hypervisor.
Aug 01 15:20:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:53 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2846f03-5074-495b-831f-734dd477dc18] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903254.013372, c918ea78-9bf8-421c-9a31-0da4104cd032 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:20:54 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] VM Resumed (Lifecycle Event)
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:20:54 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Instance spawned successfully.
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:54 user nova-compute[72201]: INFO nova.compute.manager [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Took 13.20 seconds to build instance.
Aug 01 15:20:54 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903254.0293732, c918ea78-9bf8-421c-9a31-0da4104cd032 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:20:54 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] VM Started (Lifecycle Event)
Aug 01 15:20:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ce2b7be8-2e42-4086-90f3-c06902daaab5 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "e2846f03-5074-495b-831f-734dd477dc18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.480s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:20:54 user nova-compute[72201]: INFO nova.compute.manager [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Took 10.10 seconds to spawn the instance on the hypervisor.
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:54 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:20:54 user nova-compute[72201]: INFO nova.compute.manager [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Took 11.24 seconds to build instance.
Aug 01 15:20:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a413eaf-684c-412d-9040-7b4153d7148e tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.642s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903254.6849196, 0331ddd6-3aa1-47df-b1a3-4d539d26c708 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:20:54 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] VM Resumed (Lifecycle Event)
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:54 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Instance spawned successfully.
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:20:54 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903254.6886518, 0331ddd6-3aa1-47df-b1a3-4d539d26c708 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:20:54 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] VM Started (Lifecycle Event)
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.compute.manager [req-bca22ab8-43c0-4959-af5e-53b69d598327 req-a3049141-9deb-4f74-a71d-e309ab5c5f60 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Received event network-vif-plugged-1740420d-31a4-494e-a19f-965960ba2b7c {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bca22ab8-43c0-4959-af5e-53b69d598327 req-a3049141-9deb-4f74-a71d-e309ab5c5f60 service nova] Acquiring lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bca22ab8-43c0-4959-af5e-53b69d598327 req-a3049141-9deb-4f74-a71d-e309ab5c5f60 service nova] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bca22ab8-43c0-4959-af5e-53b69d598327 req-a3049141-9deb-4f74-a71d-e309ab5c5f60 service nova] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.compute.manager [req-bca22ab8-43c0-4959-af5e-53b69d598327 req-a3049141-9deb-4f74-a71d-e309ab5c5f60 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] No waiting events found dispatching network-vif-plugged-1740420d-31a4-494e-a19f-965960ba2b7c {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:20:54 user nova-compute[72201]: WARNING nova.compute.manager [req-bca22ab8-43c0-4959-af5e-53b69d598327 req-a3049141-9deb-4f74-a71d-e309ab5c5f60 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Received unexpected event network-vif-plugged-1740420d-31a4-494e-a19f-965960ba2b7c for instance with vm_state building and task_state spawning.
Aug 01 15:20:54 user nova-compute[72201]: INFO nova.compute.manager [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Took 7.76 seconds to spawn the instance on the hypervisor.
Aug 01 15:20:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:20:54 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:20:54 user nova-compute[72201]: INFO nova.compute.manager [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Took 8.66 seconds to build instance.
Aug 01 15:20:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a5213ccc-259e-4934-87d6-6104f6dd9104 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.794s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:56 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:20:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:20:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 15:20:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-54cee809-6ad0-4a16-85cd-ebf8ef683bbe" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:20:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-54cee809-6ad0-4a16-85cd-ebf8ef683bbe" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:20:56 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:20:56 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid 54cee809-6ad0-4a16-85cd-ebf8ef683bbe {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:20:56 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Updating instance_info_cache with network_info: [{"id": "c3a09866-55a9-407c-b2d9-7883a411a246", "address": "fa:16:3e:f4:62:2d", "network": {"id": "c773bb9f-5601-48bd-9c67-638c0380bb5b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-340882723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4d83c3cd9b64a3d8cb45c3f0d0fb02b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a09866-55", "ovs_interfaceid": "c3a09866-55a9-407c-b2d9-7883a411a246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:20:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-54cee809-6ad0-4a16-85cd-ebf8ef683bbe" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:20:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:20:56 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:20:57 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:20:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:58 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:20:58 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:20:58 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:20:58 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:20:58 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:20:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:20:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:20:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:20:58 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:20:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:20:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:20:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:20:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54cee809-6ad0-4a16-85cd-ebf8ef683bbe/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54cee809-6ad0-4a16-85cd-ebf8ef683bbe/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54cee809-6ad0-4a16-85cd-ebf8ef683bbe/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54cee809-6ad0-4a16-85cd-ebf8ef683bbe/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:03 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:21:03 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:21:03 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=7669MB free_disk=25.806034088134766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:21:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:03 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 54cee809-6ad0-4a16-85cd-ebf8ef683bbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:21:03 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance b64f1cfb-64f2-4493-8721-fc63fcd93bb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:21:03 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e2ca19ea-868c-40ad-a453-f6e348cfac15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:21:03 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 0f059ccc-f609-4cf3-a644-c3d1305ae26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:21:03 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance cb684e00-1740-402d-b3c5-c14eaf7e8054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:21:03 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 02d227b0-2b25-467f-a318-ab46aa391a31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:21:03 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e2846f03-5074-495b-831f-734dd477dc18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:21:03 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance c918ea78-9bf8-421c-9a31-0da4104cd032 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:21:03 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 0331ddd6-3aa1-47df-b1a3-4d539d26c708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:21:03 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:21:03 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:21:03 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing inventories for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 15:21:03 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating ProviderTree inventory for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 15:21:03 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating inventory in ProviderTree for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 15:21:03 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing aggregate associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, aggregates: None {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 15:21:03 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing trait associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 15:21:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:04 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:21:04 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:21:04 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:21:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.389s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:21:05 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:21:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "45a40359-7496-44f6-ae86-a77f991e5106" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:26 user nova-compute[72201]: DEBUG nova.compute.manager [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:21:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:26 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:21:26 user nova-compute[72201]: INFO nova.compute.claims [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Claim successful on node user
Aug 01 15:21:26 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:21:26 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:21:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:21:26 user nova-compute[72201]: DEBUG nova.compute.manager [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:21:26 user nova-compute[72201]: DEBUG nova.compute.manager [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:21:26 user nova-compute[72201]: DEBUG nova.network.neutron [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:21:26 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:21:26 user nova-compute[72201]: DEBUG nova.compute.manager [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:21:27 user nova-compute[72201]: INFO nova.virt.block_device [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Booting with volume 0409930c-64ac-4079-ba24-2beb3dd73e57 at /dev/vda
Aug 01 15:21:27 user nova-compute[72201]: DEBUG os_brick.utils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:21:27 user nova-compute[72201]: INFO oslo.privsep.daemon [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpdukol5xz/privsep.sock']
Aug 01 15:21:27 user sudo[83287]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpdukol5xz/privsep.sock
Aug 01 15:21:27 user sudo[83287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 15:21:27 user nova-compute[72201]: DEBUG nova.policy [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffd657fbfccc4fc2a7f58a60bcada3df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e55bd6f4fa84c4da104a5a782bad7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:21:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:28 user nova-compute[72201]: DEBUG nova.network.neutron [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Successfully created port: 12cc53e2-1a6d-455c-9737-dd4a14957fa0 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:21:28 user sudo[83287]: pam_unix(sudo:session): session closed for user root
Aug 01 15:21:28 user nova-compute[72201]: INFO oslo.privsep.daemon [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Spawned new privsep daemon via rootwrap
Aug 01 15:21:28 user nova-compute[72201]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 15:21:28 user nova-compute[72201]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 15:21:28 user nova-compute[72201]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 01 15:21:28 user nova-compute[72201]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83290
Aug 01 15:21:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e842e4fc-6949-44ca-9e5b-6621b6b8e749]: (2,) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ebed1b-de62-4a39-92fd-5fa893620b03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:28 user nova-compute[72201]: WARNING os_brick.initiator.connectors.nvmeof [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 01 15:21:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:29 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c268d16a-5ab8-4d3d-99c8-fc21eaaf4380]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:29 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5600a33d-4e8a-4647-b698-442808f7b70b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:29 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09c7534-6654-491a-89fa-5259accfb7d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:21:29 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:21:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:21:29 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:21:29 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[145ee4b8-e75b-4254-a7a5-4c273bbdf613]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:29 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:21:29 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:21:29 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:21:29 user nova-compute[72201]: DEBUG os_brick.utils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] <== get_connector_properties: return (1977ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:21:29 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Updating existing volume attachment record: 01b37948-1871-468d-8f91-3a7bc70e2556 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:21:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:29 user nova-compute[72201]: DEBUG nova.network.neutron [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Successfully created port: ef3cbe0f-91fd-488c-80d1-48609530c75e {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:21:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:30 user nova-compute[72201]: DEBUG nova.network.neutron [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Successfully created port: 4cc347a8-bb63-452b-a81a-eb6a87afac30 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:21:31 user nova-compute[72201]: DEBUG nova.network.neutron [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Successfully created port: 8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:21:32 user nova-compute[72201]: DEBUG nova.network.neutron [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Successfully created port: f3dbdee9-e9a5-4859-b066-ccbb35f2df30 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:21:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:32 user nova-compute[72201]: DEBUG nova.network.neutron [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Successfully updated port: 12cc53e2-1a6d-455c-9737-dd4a14957fa0 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:21:32 user nova-compute[72201]: DEBUG nova.compute.manager [req-088e6763-ff75-45fe-8568-d889c7c0449a req-3906f97b-74a5-429f-97a4-2f9564087fa8 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-changed-12cc53e2-1a6d-455c-9737-dd4a14957fa0 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:21:32 user nova-compute[72201]: DEBUG nova.compute.manager [req-088e6763-ff75-45fe-8568-d889c7c0449a req-3906f97b-74a5-429f-97a4-2f9564087fa8 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Refreshing instance network info cache due to event network-changed-12cc53e2-1a6d-455c-9737-dd4a14957fa0. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:21:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-088e6763-ff75-45fe-8568-d889c7c0449a req-3906f97b-74a5-429f-97a4-2f9564087fa8 service nova] Acquiring lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:21:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-088e6763-ff75-45fe-8568-d889c7c0449a req-3906f97b-74a5-429f-97a4-2f9564087fa8 service nova] Acquired lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:21:32 user nova-compute[72201]: DEBUG nova.network.neutron [req-088e6763-ff75-45fe-8568-d889c7c0449a req-3906f97b-74a5-429f-97a4-2f9564087fa8 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Refreshing network info cache for port 12cc53e2-1a6d-455c-9737-dd4a14957fa0 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:21:33 user nova-compute[72201]: DEBUG nova.network.neutron [req-088e6763-ff75-45fe-8568-d889c7c0449a req-3906f97b-74a5-429f-97a4-2f9564087fa8 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:21:33 user nova-compute[72201]: DEBUG nova.network.neutron [req-088e6763-ff75-45fe-8568-d889c7c0449a req-3906f97b-74a5-429f-97a4-2f9564087fa8 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:21:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-088e6763-ff75-45fe-8568-d889c7c0449a req-3906f97b-74a5-429f-97a4-2f9564087fa8 service nova] Releasing lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:21:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:34 user nova-compute[72201]: DEBUG nova.network.neutron [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Successfully updated port: 6e420509-edf8-4398-892b-ee3e4ebb450d {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:21:35 user nova-compute[72201]: DEBUG nova.compute.manager [req-2237ac46-d51a-49d7-9c51-df9e9a2966a8 req-71b6a44a-d92e-4710-8a0c-dd5facf7bc20 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-changed-6e420509-edf8-4398-892b-ee3e4ebb450d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:21:35 user nova-compute[72201]: DEBUG nova.compute.manager [req-2237ac46-d51a-49d7-9c51-df9e9a2966a8 req-71b6a44a-d92e-4710-8a0c-dd5facf7bc20 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Refreshing instance network info cache due to event network-changed-6e420509-edf8-4398-892b-ee3e4ebb450d. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:21:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2237ac46-d51a-49d7-9c51-df9e9a2966a8 req-71b6a44a-d92e-4710-8a0c-dd5facf7bc20 service nova] Acquiring lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:21:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2237ac46-d51a-49d7-9c51-df9e9a2966a8 req-71b6a44a-d92e-4710-8a0c-dd5facf7bc20 service nova] Acquired lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:21:35 user nova-compute[72201]: DEBUG nova.network.neutron [req-2237ac46-d51a-49d7-9c51-df9e9a2966a8 req-71b6a44a-d92e-4710-8a0c-dd5facf7bc20 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Refreshing network info cache for port 6e420509-edf8-4398-892b-ee3e4ebb450d {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:21:35 user nova-compute[72201]: DEBUG nova.network.neutron [req-2237ac46-d51a-49d7-9c51-df9e9a2966a8 req-71b6a44a-d92e-4710-8a0c-dd5facf7bc20 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:21:35 user nova-compute[72201]: DEBUG nova.network.neutron [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Successfully updated port: 28037956-d408-4d2b-9ea8-76dda5239b9b {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:21:35 user nova-compute[72201]: DEBUG nova.network.neutron [req-2237ac46-d51a-49d7-9c51-df9e9a2966a8 req-71b6a44a-d92e-4710-8a0c-dd5facf7bc20 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:21:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2237ac46-d51a-49d7-9c51-df9e9a2966a8 req-71b6a44a-d92e-4710-8a0c-dd5facf7bc20 service nova] Releasing lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:21:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Acquiring lock "44cde39a-a94b-4fd8-8747-def0a68d77df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "44cde39a-a94b-4fd8-8747-def0a68d77df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:35 user nova-compute[72201]: DEBUG nova.compute.manager [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:21:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:36 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:21:36 user nova-compute[72201]: INFO nova.compute.claims [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Claim successful on node user
Aug 01 15:21:36 user nova-compute[72201]: DEBUG nova.network.neutron [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Successfully updated port: ef3cbe0f-91fd-488c-80d1-48609530c75e {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:21:36 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:21:36 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:21:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:21:36 user nova-compute[72201]: DEBUG nova.compute.manager [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:21:36 user nova-compute[72201]: DEBUG nova.compute.manager [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:21:36 user nova-compute[72201]: DEBUG nova.network.neutron [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:21:36 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:21:36 user nova-compute[72201]: DEBUG nova.compute.manager [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:21:36 user nova-compute[72201]: DEBUG nova.policy [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59ec55bc93f54ef6ad59d5624c19d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a697b16b874115aedf4e49d7b042b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:21:36 user nova-compute[72201]: DEBUG nova.compute.manager [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:21:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:21:36 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Creating image(s)
Aug 01 15:21:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Acquiring lock "/opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "/opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "/opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:21:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.164s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:37 user nova-compute[72201]: INFO nova.virt.block_device [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Booting with volume 82b81bbc-3da9-48ba-a3aa-115edf768429 at /dev/vdb
Aug 01 15:21:37 user nova-compute[72201]: DEBUG os_brick.utils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8d61c0-7f5e-4c81-a24e-7e1618efb1c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.145s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[59427bcc-f038-4f0c-84d7-acb307f4da0d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df/disk 1073741824" returned: 0 in 0.051s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db52a65-e0ac-4e69-8847-8492f9a58b91]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG nova.compute.manager [req-3d670aa8-9cf9-4930-9922-a269f5088aa6 req-3ea47825-b0d6-41da-9029-6ddf45b499f0 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-changed-28037956-d408-4d2b-9ea8-76dda5239b9b {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG nova.compute.manager [req-3d670aa8-9cf9-4930-9922-a269f5088aa6 req-3ea47825-b0d6-41da-9029-6ddf45b499f0 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Refreshing instance network info cache due to event network-changed-28037956-d408-4d2b-9ea8-76dda5239b9b. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3d670aa8-9cf9-4930-9922-a269f5088aa6 req-3ea47825-b0d6-41da-9029-6ddf45b499f0 service nova] Acquiring lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3d670aa8-9cf9-4930-9922-a269f5088aa6 req-3ea47825-b0d6-41da-9029-6ddf45b499f0 service nova] Acquired lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG nova.network.neutron [req-3d670aa8-9cf9-4930-9922-a269f5088aa6 req-3ea47825-b0d6-41da-9029-6ddf45b499f0 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Refreshing network info cache for port 28037956-d408-4d2b-9ea8-76dda5239b9b {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4c2406-765c-479c-ac9d-808f49d91541]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:21:37 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[984f7bd4-c66f-4a6e-ae12-883326ced54c]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG os_brick.utils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] <== get_connector_properties: return (268ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Updating existing volume attachment record: eace7136-9575-47e6-b704-6ec888f0f64d {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG nova.network.neutron [req-3d670aa8-9cf9-4930-9922-a269f5088aa6 req-3ea47825-b0d6-41da-9029-6ddf45b499f0 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Cannot resize image /opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG nova.objects.instance [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lazy-loading 'migration_context' on Instance uuid 44cde39a-a94b-4fd8-8747-def0a68d77df {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Ensure instance console log exists: /opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG nova.network.neutron [req-3d670aa8-9cf9-4930-9922-a269f5088aa6 req-3ea47825-b0d6-41da-9029-6ddf45b499f0 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3d670aa8-9cf9-4930-9922-a269f5088aa6 req-3ea47825-b0d6-41da-9029-6ddf45b499f0 service nova] Releasing lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG nova.compute.manager [req-3d670aa8-9cf9-4930-9922-a269f5088aa6 req-3ea47825-b0d6-41da-9029-6ddf45b499f0 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-changed-ef3cbe0f-91fd-488c-80d1-48609530c75e {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG nova.compute.manager [req-3d670aa8-9cf9-4930-9922-a269f5088aa6 req-3ea47825-b0d6-41da-9029-6ddf45b499f0 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Refreshing instance network info cache due to event network-changed-ef3cbe0f-91fd-488c-80d1-48609530c75e. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3d670aa8-9cf9-4930-9922-a269f5088aa6 req-3ea47825-b0d6-41da-9029-6ddf45b499f0 service nova] Acquiring lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3d670aa8-9cf9-4930-9922-a269f5088aa6 req-3ea47825-b0d6-41da-9029-6ddf45b499f0 service nova] Acquired lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG nova.network.neutron [req-3d670aa8-9cf9-4930-9922-a269f5088aa6 req-3ea47825-b0d6-41da-9029-6ddf45b499f0 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Refreshing network info cache for port ef3cbe0f-91fd-488c-80d1-48609530c75e {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:21:37 user nova-compute[72201]: DEBUG nova.network.neutron [req-3d670aa8-9cf9-4930-9922-a269f5088aa6 req-3ea47825-b0d6-41da-9029-6ddf45b499f0 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:21:38 user nova-compute[72201]: DEBUG nova.network.neutron [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Successfully updated port: 4cc347a8-bb63-452b-a81a-eb6a87afac30 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:21:38 user nova-compute[72201]: DEBUG nova.network.neutron [req-3d670aa8-9cf9-4930-9922-a269f5088aa6 req-3ea47825-b0d6-41da-9029-6ddf45b499f0 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:21:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3d670aa8-9cf9-4930-9922-a269f5088aa6 req-3ea47825-b0d6-41da-9029-6ddf45b499f0 service nova] Releasing lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:21:38 user nova-compute[72201]: DEBUG nova.network.neutron [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Successfully created port: d3e3d40b-6f50-4f30-8074-91bb77bd0e81 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:21:38 user nova-compute[72201]: DEBUG nova.network.neutron [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Successfully updated port: 8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:21:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:39 user nova-compute[72201]: DEBUG nova.network.neutron [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Successfully updated port: f3dbdee9-e9a5-4859-b066-ccbb35f2df30 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:21:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Acquiring lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:21:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Acquired lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:21:39 user nova-compute[72201]: DEBUG nova.network.neutron [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:21:39 user nova-compute[72201]: DEBUG nova.network.neutron [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Successfully updated port: d3e3d40b-6f50-4f30-8074-91bb77bd0e81 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:21:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-8d390df3-7bee-489f-ab54-0f0b290d69c2 req-2ef8f935-8529-4beb-a99f-144c237bb11d service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-changed-4cc347a8-bb63-452b-a81a-eb6a87afac30 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:21:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-8d390df3-7bee-489f-ab54-0f0b290d69c2 req-2ef8f935-8529-4beb-a99f-144c237bb11d service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Refreshing instance network info cache due to event network-changed-4cc347a8-bb63-452b-a81a-eb6a87afac30. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:21:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8d390df3-7bee-489f-ab54-0f0b290d69c2 req-2ef8f935-8529-4beb-a99f-144c237bb11d service nova] Acquiring lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:21:39 user nova-compute[72201]: DEBUG nova.network.neutron [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:21:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Acquiring lock "refresh_cache-44cde39a-a94b-4fd8-8747-def0a68d77df" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:21:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Acquired lock "refresh_cache-44cde39a-a94b-4fd8-8747-def0a68d77df" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:21:39 user nova-compute[72201]: DEBUG nova.network.neutron [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:21:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-ae27453b-c5ca-496f-8ef2-fc1c31fd5323 req-5a2d9bf9-f1d6-4337-93b6-f322b1a64676 service nova] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Received event network-changed-d3e3d40b-6f50-4f30-8074-91bb77bd0e81 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:21:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-ae27453b-c5ca-496f-8ef2-fc1c31fd5323 req-5a2d9bf9-f1d6-4337-93b6-f322b1a64676 service nova] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Refreshing instance network info cache due to event network-changed-d3e3d40b-6f50-4f30-8074-91bb77bd0e81. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:21:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ae27453b-c5ca-496f-8ef2-fc1c31fd5323 req-5a2d9bf9-f1d6-4337-93b6-f322b1a64676 service nova] Acquiring lock "refresh_cache-44cde39a-a94b-4fd8-8747-def0a68d77df" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:21:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:39 user nova-compute[72201]: DEBUG nova.network.neutron [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.network.neutron [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Updating instance_info_cache with network_info: [{"id": "d3e3d40b-6f50-4f30-8074-91bb77bd0e81", "address": "fa:16:3e:8a:87:d2", "network": {"id": "95f92796-92dc-4732-a567-57b506b0d89b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403146244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a697b16b874115aedf4e49d7b042b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e3d40b-6f", "ovs_interfaceid": "d3e3d40b-6f50-4f30-8074-91bb77bd0e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Releasing lock "refresh_cache-44cde39a-a94b-4fd8-8747-def0a68d77df" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.compute.manager [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Instance network_info: |[{"id": "d3e3d40b-6f50-4f30-8074-91bb77bd0e81", "address": "fa:16:3e:8a:87:d2", "network": {"id": "95f92796-92dc-4732-a567-57b506b0d89b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403146244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a697b16b874115aedf4e49d7b042b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e3d40b-6f", "ovs_interfaceid": "d3e3d40b-6f50-4f30-8074-91bb77bd0e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ae27453b-c5ca-496f-8ef2-fc1c31fd5323 req-5a2d9bf9-f1d6-4337-93b6-f322b1a64676 service nova] Acquired lock "refresh_cache-44cde39a-a94b-4fd8-8747-def0a68d77df" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.network.neutron [req-ae27453b-c5ca-496f-8ef2-fc1c31fd5323 req-5a2d9bf9-f1d6-4337-93b6-f322b1a64676 service nova] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Refreshing network info cache for port d3e3d40b-6f50-4f30-8074-91bb77bd0e81 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Start _get_guest_xml network_info=[{"id": "d3e3d40b-6f50-4f30-8074-91bb77bd0e81", "address": "fa:16:3e:8a:87:d2", "network": {"id": "95f92796-92dc-4732-a567-57b506b0d89b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403146244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a697b16b874115aedf4e49d7b042b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e3d40b-6f", "ovs_interfaceid": "d3e3d40b-6f50-4f30-8074-91bb77bd0e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:21:40 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:21:40 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:21:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-285758568',display_name='tempest-VolumesActionsTest-instance-285758568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-285758568',id=11,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a697b16b874115aedf4e49d7b042b7',ramdisk_id='',reservation_id='r-kfwcugde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-343582602',owner_user_name='tempest-VolumesActionsTest-343582602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:37Z,user_data=None,user_id='59ec55bc93f54ef6ad59d5624c19d26d',uuid=44cde39a-a94b-4fd8-8747-def0a68d77df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3e3d40b-6f50-4f30-8074-91bb77bd0e81", "address": "fa:16:3e:8a:87:d2", "network": {"id": "95f92796-92dc-4732-a567-57b506b0d89b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403146244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a697b16b874115aedf4e49d7b042b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e3d40b-6f", "ovs_interfaceid": "d3e3d40b-6f50-4f30-8074-91bb77bd0e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Converting VIF {"id": "d3e3d40b-6f50-4f30-8074-91bb77bd0e81", "address": "fa:16:3e:8a:87:d2", "network": {"id": "95f92796-92dc-4732-a567-57b506b0d89b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403146244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a697b16b874115aedf4e49d7b042b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e3d40b-6f", "ovs_interfaceid": "d3e3d40b-6f50-4f30-8074-91bb77bd0e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:87:d2,bridge_name='br-int',has_traffic_filtering=True,id=d3e3d40b-6f50-4f30-8074-91bb77bd0e81,network=Network(95f92796-92dc-4732-a567-57b506b0d89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e3d40b-6f') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.objects.instance [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lazy-loading 'pci_devices' on Instance uuid 44cde39a-a94b-4fd8-8747-def0a68d77df {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:21:40 user nova-compute[72201]:   <uuid>44cde39a-a94b-4fd8-8747-def0a68d77df</uuid>
Aug 01 15:21:40 user nova-compute[72201]:   <name>instance-0000000b</name>
Aug 01 15:21:40 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:21:40 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:21:40 user nova-compute[72201]:   <metadata>
Aug 01 15:21:40 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:21:40 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:21:40 user nova-compute[72201]:       <nova:name>tempest-VolumesActionsTest-instance-285758568</nova:name>
Aug 01 15:21:40 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:21:40</nova:creationTime>
Aug 01 15:21:40 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:21:40 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:21:40 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:21:40 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:21:40 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:21:40 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:21:40 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:21:40 user nova-compute[72201]:       <nova:owner>
Aug 01 15:21:40 user nova-compute[72201]:         <nova:user uuid="59ec55bc93f54ef6ad59d5624c19d26d">tempest-VolumesActionsTest-343582602-project-member</nova:user>
Aug 01 15:21:40 user nova-compute[72201]:         <nova:project uuid="19a697b16b874115aedf4e49d7b042b7">tempest-VolumesActionsTest-343582602</nova:project>
Aug 01 15:21:40 user nova-compute[72201]:       </nova:owner>
Aug 01 15:21:40 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:21:40 user nova-compute[72201]:       <nova:ports>
Aug 01 15:21:40 user nova-compute[72201]:         <nova:port uuid="d3e3d40b-6f50-4f30-8074-91bb77bd0e81">
Aug 01 15:21:40 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 15:21:40 user nova-compute[72201]:         </nova:port>
Aug 01 15:21:40 user nova-compute[72201]:       </nova:ports>
Aug 01 15:21:40 user nova-compute[72201]:     </nova:instance>
Aug 01 15:21:40 user nova-compute[72201]:   </metadata>
Aug 01 15:21:40 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:21:40 user nova-compute[72201]:     <system>
Aug 01 15:21:40 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:21:40 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:21:40 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:21:40 user nova-compute[72201]:       <entry name="serial">44cde39a-a94b-4fd8-8747-def0a68d77df</entry>
Aug 01 15:21:40 user nova-compute[72201]:       <entry name="uuid">44cde39a-a94b-4fd8-8747-def0a68d77df</entry>
Aug 01 15:21:40 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:21:40 user nova-compute[72201]:     </system>
Aug 01 15:21:40 user nova-compute[72201]:   </sysinfo>
Aug 01 15:21:40 user nova-compute[72201]:   <os>
Aug 01 15:21:40 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:21:40 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:21:40 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:21:40 user nova-compute[72201]:   </os>
Aug 01 15:21:40 user nova-compute[72201]:   <features>
Aug 01 15:21:40 user nova-compute[72201]:     <acpi/>
Aug 01 15:21:40 user nova-compute[72201]:     <apic/>
Aug 01 15:21:40 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:21:40 user nova-compute[72201]:   </features>
Aug 01 15:21:40 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:21:40 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:21:40 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:21:40 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:21:40 user nova-compute[72201]:   </clock>
Aug 01 15:21:40 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:21:40 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:21:40 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:21:40 user nova-compute[72201]:   </cpu>
Aug 01 15:21:40 user nova-compute[72201]:   <devices>
Aug 01 15:21:40 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:21:40 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:21:40 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df/disk"/>
Aug 01 15:21:40 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:21:40 user nova-compute[72201]:     </disk>
Aug 01 15:21:40 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:21:40 user nova-compute[72201]:       <mac address="fa:16:3e:8a:87:d2"/>
Aug 01 15:21:40 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:21:40 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:21:40 user nova-compute[72201]:       <target dev="tapd3e3d40b-6f"/>
Aug 01 15:21:40 user nova-compute[72201]:     </interface>
Aug 01 15:21:40 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:21:40 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df/console.log" append="off"/>
Aug 01 15:21:40 user nova-compute[72201]:     </serial>
Aug 01 15:21:40 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:21:40 user nova-compute[72201]:     <video>
Aug 01 15:21:40 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:21:40 user nova-compute[72201]:     </video>
Aug 01 15:21:40 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:21:40 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:21:40 user nova-compute[72201]:     </rng>
Aug 01 15:21:40 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:21:40 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:21:40 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:21:40 user nova-compute[72201]:     </memballoon>
Aug 01 15:21:40 user nova-compute[72201]:   </devices>
Aug 01 15:21:40 user nova-compute[72201]: </domain>
Aug 01 15:21:40 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:21:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-285758568',display_name='tempest-VolumesActionsTest-instance-285758568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-285758568',id=11,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a697b16b874115aedf4e49d7b042b7',ramdisk_id='',reservation_id='r-kfwcugde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-343582602',owner_user_name='tempest-VolumesActionsTest-343582602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:37Z,user_data=None,user_id='59ec55bc93f54ef6ad59d5624c19d26d',uuid=44cde39a-a94b-4fd8-8747-def0a68d77df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3e3d40b-6f50-4f30-8074-91bb77bd0e81", "address": "fa:16:3e:8a:87:d2", "network": {"id": "95f92796-92dc-4732-a567-57b506b0d89b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403146244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a697b16b874115aedf4e49d7b042b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e3d40b-6f", "ovs_interfaceid": "d3e3d40b-6f50-4f30-8074-91bb77bd0e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Converting VIF {"id": "d3e3d40b-6f50-4f30-8074-91bb77bd0e81", "address": "fa:16:3e:8a:87:d2", "network": {"id": "95f92796-92dc-4732-a567-57b506b0d89b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403146244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a697b16b874115aedf4e49d7b042b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e3d40b-6f", "ovs_interfaceid": "d3e3d40b-6f50-4f30-8074-91bb77bd0e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:87:d2,bridge_name='br-int',has_traffic_filtering=True,id=d3e3d40b-6f50-4f30-8074-91bb77bd0e81,network=Network(95f92796-92dc-4732-a567-57b506b0d89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e3d40b-6f') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG os_vif [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:87:d2,bridge_name='br-int',has_traffic_filtering=True,id=d3e3d40b-6f50-4f30-8074-91bb77bd0e81,network=Network(95f92796-92dc-4732-a567-57b506b0d89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e3d40b-6f') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3e3d40b-6f, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd3e3d40b-6f, col_values=(('external_ids', {'iface-id': 'd3e3d40b-6f50-4f30-8074-91bb77bd0e81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:87:d2', 'vm-uuid': '44cde39a-a94b-4fd8-8747-def0a68d77df'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:40 user nova-compute[72201]: INFO os_vif [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:87:d2,bridge_name='br-int',has_traffic_filtering=True,id=d3e3d40b-6f50-4f30-8074-91bb77bd0e81,network=Network(95f92796-92dc-4732-a567-57b506b0d89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e3d40b-6f')
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] No VIF found with MAC fa:16:3e:8a:87:d2, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.network.neutron [req-ae27453b-c5ca-496f-8ef2-fc1c31fd5323 req-5a2d9bf9-f1d6-4337-93b6-f322b1a64676 service nova] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Updated VIF entry in instance network info cache for port d3e3d40b-6f50-4f30-8074-91bb77bd0e81. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG nova.network.neutron [req-ae27453b-c5ca-496f-8ef2-fc1c31fd5323 req-5a2d9bf9-f1d6-4337-93b6-f322b1a64676 service nova] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Updating instance_info_cache with network_info: [{"id": "d3e3d40b-6f50-4f30-8074-91bb77bd0e81", "address": "fa:16:3e:8a:87:d2", "network": {"id": "95f92796-92dc-4732-a567-57b506b0d89b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403146244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a697b16b874115aedf4e49d7b042b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e3d40b-6f", "ovs_interfaceid": "d3e3d40b-6f50-4f30-8074-91bb77bd0e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:21:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ae27453b-c5ca-496f-8ef2-fc1c31fd5323 req-5a2d9bf9-f1d6-4337-93b6-f322b1a64676 service nova] Releasing lock "refresh_cache-44cde39a-a94b-4fd8-8747-def0a68d77df" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:21:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-5cce05fc-d8d7-4a03-a6fc-f8243d007c45 req-596c5d85-4252-47a2-962d-a8af0727b044 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-changed-f3dbdee9-e9a5-4859-b066-ccbb35f2df30 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:21:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-5cce05fc-d8d7-4a03-a6fc-f8243d007c45 req-596c5d85-4252-47a2-962d-a8af0727b044 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Refreshing instance network info cache due to event network-changed-f3dbdee9-e9a5-4859-b066-ccbb35f2df30. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:21:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5cce05fc-d8d7-4a03-a6fc-f8243d007c45 req-596c5d85-4252-47a2-962d-a8af0727b044 service nova] Acquiring lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:21:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:42 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:21:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:21:42 user nova-compute[72201]: INFO nova.compute.claims [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Claim successful on node user
Aug 01 15:21:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:21:43 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:21:43 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:21:43 user nova-compute[72201]: INFO nova.virt.block_device [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Booting with volume 01356eec-0a71-4aad-94bf-ac863bf85d00 at /dev/vda
Aug 01 15:21:43 user nova-compute[72201]: DEBUG nova.policy [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7b68ccc67f5401b87a5951bde152dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0072ae6c74c3997ea40225a876c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG os_brick.utils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a2e939-7fd1-4dc6-b23a-f69959485afa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebe739f-e12c-4c8c-943a-5f3aa4dd8a5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc597cf-2d6f-4dcf-8fa0-a4b597baeeb5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[17187f76-8dc3-42d7-a254-ef349f66b4c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:21:43 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:21:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b6473b-b0e0-4e77-b60b-f279c29bb3a4]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG os_brick.utils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Updating existing volume attachment record: ee25c2a8-2903-4bcb-98b0-1d0ffc293330 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:21:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903304.0059152, 44cde39a-a94b-4fd8-8747-def0a68d77df => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:21:44 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] VM Resumed (Lifecycle Event)
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.compute.manager [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:21:44 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Instance spawned successfully.
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:21:44 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903304.0066974, 44cde39a-a94b-4fd8-8747-def0a68d77df => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:21:44 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] VM Started (Lifecycle Event)
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:21:44 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:21:44 user nova-compute[72201]: INFO nova.compute.manager [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Took 7.25 seconds to spawn the instance on the hypervisor.
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.compute.manager [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-9420252e-0eae-41c5-af87-cfb1bd3cc2d1 req-42ad44bd-7fdd-4c04-b933-801b08b27f23 service nova] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Received event network-vif-plugged-d3e3d40b-6f50-4f30-8074-91bb77bd0e81 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9420252e-0eae-41c5-af87-cfb1bd3cc2d1 req-42ad44bd-7fdd-4c04-b933-801b08b27f23 service nova] Acquiring lock "44cde39a-a94b-4fd8-8747-def0a68d77df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9420252e-0eae-41c5-af87-cfb1bd3cc2d1 req-42ad44bd-7fdd-4c04-b933-801b08b27f23 service nova] Lock "44cde39a-a94b-4fd8-8747-def0a68d77df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9420252e-0eae-41c5-af87-cfb1bd3cc2d1 req-42ad44bd-7fdd-4c04-b933-801b08b27f23 service nova] Lock "44cde39a-a94b-4fd8-8747-def0a68d77df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-9420252e-0eae-41c5-af87-cfb1bd3cc2d1 req-42ad44bd-7fdd-4c04-b933-801b08b27f23 service nova] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] No waiting events found dispatching network-vif-plugged-d3e3d40b-6f50-4f30-8074-91bb77bd0e81 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:21:44 user nova-compute[72201]: WARNING nova.compute.manager [req-9420252e-0eae-41c5-af87-cfb1bd3cc2d1 req-42ad44bd-7fdd-4c04-b933-801b08b27f23 service nova] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Received unexpected event network-vif-plugged-d3e3d40b-6f50-4f30-8074-91bb77bd0e81 for instance with vm_state building and task_state spawning.
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-9420252e-0eae-41c5-af87-cfb1bd3cc2d1 req-42ad44bd-7fdd-4c04-b933-801b08b27f23 service nova] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Received event network-vif-plugged-d3e3d40b-6f50-4f30-8074-91bb77bd0e81 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9420252e-0eae-41c5-af87-cfb1bd3cc2d1 req-42ad44bd-7fdd-4c04-b933-801b08b27f23 service nova] Acquiring lock "44cde39a-a94b-4fd8-8747-def0a68d77df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9420252e-0eae-41c5-af87-cfb1bd3cc2d1 req-42ad44bd-7fdd-4c04-b933-801b08b27f23 service nova] Lock "44cde39a-a94b-4fd8-8747-def0a68d77df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9420252e-0eae-41c5-af87-cfb1bd3cc2d1 req-42ad44bd-7fdd-4c04-b933-801b08b27f23 service nova] Lock "44cde39a-a94b-4fd8-8747-def0a68d77df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-9420252e-0eae-41c5-af87-cfb1bd3cc2d1 req-42ad44bd-7fdd-4c04-b933-801b08b27f23 service nova] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] No waiting events found dispatching network-vif-plugged-d3e3d40b-6f50-4f30-8074-91bb77bd0e81 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:21:44 user nova-compute[72201]: WARNING nova.compute.manager [req-9420252e-0eae-41c5-af87-cfb1bd3cc2d1 req-42ad44bd-7fdd-4c04-b933-801b08b27f23 service nova] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Received unexpected event network-vif-plugged-d3e3d40b-6f50-4f30-8074-91bb77bd0e81 for instance with vm_state building and task_state spawning.
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Successfully created port: 5c6a1011-f0c2-4d1b-8559-116d9b15bdd8 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:21:44 user nova-compute[72201]: INFO nova.compute.manager [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Took 8.30 seconds to build instance.
Aug 01 15:21:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-032aa1e5-d9ef-4301-a7d6-168c0634ad20 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "44cde39a-a94b-4fd8-8747-def0a68d77df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.402s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.network.neutron [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Updating instance_info_cache with network_info: [{"id": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "address": "fa:16:3e:5c:9c:8c", "network": {"id": "dd813b4b-a3e3-44c9-839b-1eab4b536882", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1931202477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12cc53e2-1a", "ovs_interfaceid": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e420509-edf8-4398-892b-ee3e4ebb450d", "address": "fa:16:3e:b2:af:3c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e420509-ed", "ovs_interfaceid": "6e420509-edf8-4398-892b-ee3e4ebb450d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28037956-d408-4d2b-9ea8-76dda5239b9b", "address": "fa:16:3e:3f:1c:0c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28037956-d4", "ovs_interfaceid": "28037956-d408-4d2b-9ea8-76dda5239b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "address": "fa:16:3e:c9:09:37", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3cbe0f-91", "ovs_interfaceid": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "address": "fa:16:3e:49:dc:99", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc347a8-bb", "ovs_interfaceid": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "address": "fa:16:3e:c5:f9:56", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2b6f03-3c", "ovs_interfaceid": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "address": "fa:16:3e:0f:d2:23", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3dbdee9-e9", "ovs_interfaceid": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Releasing lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.compute.manager [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Instance network_info: |[{"id": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "address": "fa:16:3e:5c:9c:8c", "network": {"id": "dd813b4b-a3e3-44c9-839b-1eab4b536882", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1931202477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12cc53e2-1a", "ovs_interfaceid": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e420509-edf8-4398-892b-ee3e4ebb450d", "address": "fa:16:3e:b2:af:3c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e420509-ed", "ovs_interfaceid": "6e420509-edf8-4398-892b-ee3e4ebb450d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28037956-d408-4d2b-9ea8-76dda5239b9b", "address": "fa:16:3e:3f:1c:0c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28037956-d4", "ovs_interfaceid": "28037956-d408-4d2b-9ea8-76dda5239b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "address": "fa:16:3e:c9:09:37", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3cbe0f-91", "ovs_interfaceid": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "address": "fa:16:3e:49:dc:99", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc347a8-bb", "ovs_interfaceid": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "address": "fa:16:3e:c5:f9:56", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2b6f03-3c", "ovs_interfaceid": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "address": "fa:16:3e:0f:d2:23", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3dbdee9-e9", "ovs_interfaceid": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8d390df3-7bee-489f-ab54-0f0b290d69c2 req-2ef8f935-8529-4beb-a99f-144c237bb11d service nova] Acquired lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.network.neutron [req-8d390df3-7bee-489f-ab54-0f0b290d69c2 req-2ef8f935-8529-4beb-a99f-144c237bb11d service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Refreshing network info cache for port 4cc347a8-bb63-452b-a81a-eb6a87afac30 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Successfully created port: 52014d35-b37b-41ec-ab07-1ec05db59785 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.network.neutron [req-8d390df3-7bee-489f-ab54-0f0b290d69c2 req-2ef8f935-8529-4beb-a99f-144c237bb11d service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Updated VIF entry in instance network info cache for port 4cc347a8-bb63-452b-a81a-eb6a87afac30. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:21:44 user nova-compute[72201]: DEBUG nova.network.neutron [req-8d390df3-7bee-489f-ab54-0f0b290d69c2 req-2ef8f935-8529-4beb-a99f-144c237bb11d service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Updating instance_info_cache with network_info: [{"id": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "address": "fa:16:3e:5c:9c:8c", "network": {"id": "dd813b4b-a3e3-44c9-839b-1eab4b536882", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1931202477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12cc53e2-1a", "ovs_interfaceid": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e420509-edf8-4398-892b-ee3e4ebb450d", "address": "fa:16:3e:b2:af:3c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e420509-ed", "ovs_interfaceid": "6e420509-edf8-4398-892b-ee3e4ebb450d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28037956-d408-4d2b-9ea8-76dda5239b9b", "address": "fa:16:3e:3f:1c:0c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28037956-d4", "ovs_interfaceid": "28037956-d408-4d2b-9ea8-76dda5239b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "address": "fa:16:3e:c9:09:37", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3cbe0f-91", "ovs_interfaceid": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "address": "fa:16:3e:49:dc:99", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc347a8-bb", "ovs_interfaceid": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "address": "fa:16:3e:c5:f9:56", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2b6f03-3c", "ovs_interfaceid": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "address": "fa:16:3e:0f:d2:23", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3dbdee9-e9", "ovs_interfaceid": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8d390df3-7bee-489f-ab54-0f0b290d69c2 req-2ef8f935-8529-4beb-a99f-144c237bb11d service nova] Releasing lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-8d390df3-7bee-489f-ab54-0f0b290d69c2 req-2ef8f935-8529-4beb-a99f-144c237bb11d service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-changed-8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-8d390df3-7bee-489f-ab54-0f0b290d69c2 req-2ef8f935-8529-4beb-a99f-144c237bb11d service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Refreshing instance network info cache due to event network-changed-8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8d390df3-7bee-489f-ab54-0f0b290d69c2 req-2ef8f935-8529-4beb-a99f-144c237bb11d service nova] Acquiring lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8d390df3-7bee-489f-ab54-0f0b290d69c2 req-2ef8f935-8529-4beb-a99f-144c237bb11d service nova] Acquired lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG nova.network.neutron [req-8d390df3-7bee-489f-ab54-0f0b290d69c2 req-2ef8f935-8529-4beb-a99f-144c237bb11d service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Refreshing network info cache for port 8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:45 user nova-compute[72201]: INFO nova.virt.block_device [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Booting with volume f50070c4-3768-46e8-bb02-aa1bb66a65e0 at /dev/vdc
Aug 01 15:21:45 user nova-compute[72201]: DEBUG os_brick.utils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ece034c-4e3d-476d-b91e-c65d32acbb63]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Successfully created port: 892001ed-6dfd-4e71-baa0-dae05528700d {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e621dacf-5312-4582-8b76-a386b50de178]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d2d38b-ed97-4725-87d4-94af7f3066be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5588a30a-c2d5-43f0-9631-e1fbd788d8a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:21:45 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:21:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54e030c-8064-4e4b-90c1-ba3199e06e6f]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG os_brick.utils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Updating existing volume attachment record: 0575db35-7421-4865-a945-485067c3192c {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG nova.network.neutron [req-8d390df3-7bee-489f-ab54-0f0b290d69c2 req-2ef8f935-8529-4beb-a99f-144c237bb11d service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Updated VIF entry in instance network info cache for port 8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG nova.network.neutron [req-8d390df3-7bee-489f-ab54-0f0b290d69c2 req-2ef8f935-8529-4beb-a99f-144c237bb11d service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Updating instance_info_cache with network_info: [{"id": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "address": "fa:16:3e:5c:9c:8c", "network": {"id": "dd813b4b-a3e3-44c9-839b-1eab4b536882", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1931202477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12cc53e2-1a", "ovs_interfaceid": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e420509-edf8-4398-892b-ee3e4ebb450d", "address": "fa:16:3e:b2:af:3c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e420509-ed", "ovs_interfaceid": "6e420509-edf8-4398-892b-ee3e4ebb450d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28037956-d408-4d2b-9ea8-76dda5239b9b", "address": "fa:16:3e:3f:1c:0c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28037956-d4", "ovs_interfaceid": "28037956-d408-4d2b-9ea8-76dda5239b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "address": "fa:16:3e:c9:09:37", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3cbe0f-91", "ovs_interfaceid": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "address": "fa:16:3e:49:dc:99", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc347a8-bb", "ovs_interfaceid": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "address": "fa:16:3e:c5:f9:56", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2b6f03-3c", "ovs_interfaceid": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "address": "fa:16:3e:0f:d2:23", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3dbdee9-e9", "ovs_interfaceid": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8d390df3-7bee-489f-ab54-0f0b290d69c2 req-2ef8f935-8529-4beb-a99f-144c237bb11d service nova] Releasing lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5cce05fc-d8d7-4a03-a6fc-f8243d007c45 req-596c5d85-4252-47a2-962d-a8af0727b044 service nova] Acquired lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:21:45 user nova-compute[72201]: DEBUG nova.network.neutron [req-5cce05fc-d8d7-4a03-a6fc-f8243d007c45 req-596c5d85-4252-47a2-962d-a8af0727b044 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Refreshing network info cache for port f3dbdee9-e9a5-4859-b066-ccbb35f2df30 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:21:46 user nova-compute[72201]: DEBUG nova.network.neutron [req-5cce05fc-d8d7-4a03-a6fc-f8243d007c45 req-596c5d85-4252-47a2-962d-a8af0727b044 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Updated VIF entry in instance network info cache for port f3dbdee9-e9a5-4859-b066-ccbb35f2df30. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:21:46 user nova-compute[72201]: DEBUG nova.network.neutron [req-5cce05fc-d8d7-4a03-a6fc-f8243d007c45 req-596c5d85-4252-47a2-962d-a8af0727b044 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Updating instance_info_cache with network_info: [{"id": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "address": "fa:16:3e:5c:9c:8c", "network": {"id": "dd813b4b-a3e3-44c9-839b-1eab4b536882", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1931202477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12cc53e2-1a", "ovs_interfaceid": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e420509-edf8-4398-892b-ee3e4ebb450d", "address": "fa:16:3e:b2:af:3c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e420509-ed", "ovs_interfaceid": "6e420509-edf8-4398-892b-ee3e4ebb450d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28037956-d408-4d2b-9ea8-76dda5239b9b", "address": "fa:16:3e:3f:1c:0c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28037956-d4", "ovs_interfaceid": "28037956-d408-4d2b-9ea8-76dda5239b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "address": "fa:16:3e:c9:09:37", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3cbe0f-91", "ovs_interfaceid": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "address": "fa:16:3e:49:dc:99", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc347a8-bb", "ovs_interfaceid": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "address": "fa:16:3e:c5:f9:56", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2b6f03-3c", "ovs_interfaceid": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "address": "fa:16:3e:0f:d2:23", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3dbdee9-e9", "ovs_interfaceid": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:21:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5cce05fc-d8d7-4a03-a6fc-f8243d007c45 req-596c5d85-4252-47a2-962d-a8af0727b044 service nova] Releasing lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:21:46 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Successfully created port: babde51a-fce1-4954-8aa6-2e3715330cf0 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:21:47 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Successfully created port: 5c3087dd-d4fb-4ec6-8ae3-7a90993941ae {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:21:47 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Successfully updated port: 5c6a1011-f0c2-4d1b-8559-116d9b15bdd8 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:21:47 user nova-compute[72201]: DEBUG nova.compute.manager [req-42029e10-946e-428c-85ca-42051143aee6 req-c81ff934-6f40-4e95-8bb1-15a90f71c77d service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-changed-5c6a1011-f0c2-4d1b-8559-116d9b15bdd8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:21:47 user nova-compute[72201]: DEBUG nova.compute.manager [req-42029e10-946e-428c-85ca-42051143aee6 req-c81ff934-6f40-4e95-8bb1-15a90f71c77d service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Refreshing instance network info cache due to event network-changed-5c6a1011-f0c2-4d1b-8559-116d9b15bdd8. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:21:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-42029e10-946e-428c-85ca-42051143aee6 req-c81ff934-6f40-4e95-8bb1-15a90f71c77d service nova] Acquiring lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:21:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-42029e10-946e-428c-85ca-42051143aee6 req-c81ff934-6f40-4e95-8bb1-15a90f71c77d service nova] Acquired lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:21:47 user nova-compute[72201]: DEBUG nova.network.neutron [req-42029e10-946e-428c-85ca-42051143aee6 req-c81ff934-6f40-4e95-8bb1-15a90f71c77d service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Refreshing network info cache for port 5c6a1011-f0c2-4d1b-8559-116d9b15bdd8 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:21:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:47 user nova-compute[72201]: DEBUG nova.network.neutron [req-42029e10-946e-428c-85ca-42051143aee6 req-c81ff934-6f40-4e95-8bb1-15a90f71c77d service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:21:48 user nova-compute[72201]: DEBUG nova.network.neutron [req-42029e10-946e-428c-85ca-42051143aee6 req-c81ff934-6f40-4e95-8bb1-15a90f71c77d service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:21:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-42029e10-946e-428c-85ca-42051143aee6 req-c81ff934-6f40-4e95-8bb1-15a90f71c77d service nova] Releasing lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:21:48 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Successfully updated port: b3bdcebc-0ff7-45e1-995e-790d24bc580f {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:21:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:49 user nova-compute[72201]: DEBUG nova.compute.manager [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:21:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:21:49 user nova-compute[72201]: INFO nova.compute.claims [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Claim successful on node user
Aug 01 15:21:49 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Successfully updated port: 5eec44e9-3963-454e-931c-4f5a94548672 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:21:49 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:21:49 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:21:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:21:49 user nova-compute[72201]: DEBUG nova.compute.manager [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:21:49 user nova-compute[72201]: DEBUG nova.compute.manager [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:21:49 user nova-compute[72201]: DEBUG nova.network.neutron [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:21:49 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:21:49 user nova-compute[72201]: DEBUG nova.compute.manager [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:21:49 user nova-compute[72201]: DEBUG nova.compute.manager [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:21:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:21:49 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Creating image(s)
Aug 01 15:21:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "/opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "/opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:21:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "b594736f5326cc44b2c21b0265dc7a86f25b8fc2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "b594736f5326cc44b2c21b0265dc7a86f25b8fc2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG nova.policy [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c5267b768cf46958384d9ad4c585f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e1f59585b44545ae3ec0cdfa480fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b594736f5326cc44b2c21b0265dc7a86f25b8fc2.part --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-ac568dd0-0140-4e7c-80a0-b0db6abc111b req-e55de606-7e58-41ea-8521-3de6ba67ba5c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-changed-b3bdcebc-0ff7-45e1-995e-790d24bc580f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-ac568dd0-0140-4e7c-80a0-b0db6abc111b req-e55de606-7e58-41ea-8521-3de6ba67ba5c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Refreshing instance network info cache due to event network-changed-b3bdcebc-0ff7-45e1-995e-790d24bc580f. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ac568dd0-0140-4e7c-80a0-b0db6abc111b req-e55de606-7e58-41ea-8521-3de6ba67ba5c service nova] Acquiring lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ac568dd0-0140-4e7c-80a0-b0db6abc111b req-e55de606-7e58-41ea-8521-3de6ba67ba5c service nova] Acquired lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG nova.network.neutron [req-ac568dd0-0140-4e7c-80a0-b0db6abc111b req-e55de606-7e58-41ea-8521-3de6ba67ba5c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Refreshing network info cache for port b3bdcebc-0ff7-45e1-995e-790d24bc580f {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG nova.network.neutron [req-ac568dd0-0140-4e7c-80a0-b0db6abc111b req-e55de606-7e58-41ea-8521-3de6ba67ba5c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b594736f5326cc44b2c21b0265dc7a86f25b8fc2.part --force-share --output=json" returned: 0 in 0.169s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG nova.virt.images [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] 01e1b9e2-1afb-49c6-88ca-e8c8a2144418 was qcow2, converting to raw {{(pid=72201) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG nova.privsep.utils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72201) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b594736f5326cc44b2c21b0265dc7a86f25b8fc2.part /opt/stack/data/nova/instances/_base/b594736f5326cc44b2c21b0265dc7a86f25b8fc2.converted {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Successfully updated port: 52014d35-b37b-41ec-ab07-1ec05db59785 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG nova.network.neutron [req-ac568dd0-0140-4e7c-80a0-b0db6abc111b req-e55de606-7e58-41ea-8521-3de6ba67ba5c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b594736f5326cc44b2c21b0265dc7a86f25b8fc2.part /opt/stack/data/nova/instances/_base/b594736f5326cc44b2c21b0265dc7a86f25b8fc2.converted" returned: 0 in 0.233s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b594736f5326cc44b2c21b0265dc7a86f25b8fc2.converted --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ac568dd0-0140-4e7c-80a0-b0db6abc111b req-e55de606-7e58-41ea-8521-3de6ba67ba5c service nova] Releasing lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-ac568dd0-0140-4e7c-80a0-b0db6abc111b req-e55de606-7e58-41ea-8521-3de6ba67ba5c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-changed-5eec44e9-3963-454e-931c-4f5a94548672 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-ac568dd0-0140-4e7c-80a0-b0db6abc111b req-e55de606-7e58-41ea-8521-3de6ba67ba5c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Refreshing instance network info cache due to event network-changed-5eec44e9-3963-454e-931c-4f5a94548672. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ac568dd0-0140-4e7c-80a0-b0db6abc111b req-e55de606-7e58-41ea-8521-3de6ba67ba5c service nova] Acquiring lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ac568dd0-0140-4e7c-80a0-b0db6abc111b req-e55de606-7e58-41ea-8521-3de6ba67ba5c service nova] Acquired lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG nova.network.neutron [req-ac568dd0-0140-4e7c-80a0-b0db6abc111b req-e55de606-7e58-41ea-8521-3de6ba67ba5c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Refreshing network info cache for port 5eec44e9-3963-454e-931c-4f5a94548672 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG nova.network.neutron [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Successfully created port: a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:21:50 user nova-compute[72201]: DEBUG nova.network.neutron [req-ac568dd0-0140-4e7c-80a0-b0db6abc111b req-e55de606-7e58-41ea-8521-3de6ba67ba5c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b594736f5326cc44b2c21b0265dc7a86f25b8fc2.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "b594736f5326cc44b2c21b0265dc7a86f25b8fc2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.063s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b594736f5326cc44b2c21b0265dc7a86f25b8fc2 --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b594736f5326cc44b2c21b0265dc7a86f25b8fc2 --force-share --output=json" returned: 0 in 0.180s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "b594736f5326cc44b2c21b0265dc7a86f25b8fc2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "b594736f5326cc44b2c21b0265dc7a86f25b8fc2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b594736f5326cc44b2c21b0265dc7a86f25b8fc2 --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG nova.network.neutron [req-ac568dd0-0140-4e7c-80a0-b0db6abc111b req-e55de606-7e58-41ea-8521-3de6ba67ba5c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ac568dd0-0140-4e7c-80a0-b0db6abc111b req-e55de606-7e58-41ea-8521-3de6ba67ba5c service nova] Releasing lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b594736f5326cc44b2c21b0265dc7a86f25b8fc2 --force-share --output=json" returned: 0 in 0.158s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b594736f5326cc44b2c21b0265dc7a86f25b8fc2,backing_fmt=raw /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b594736f5326cc44b2c21b0265dc7a86f25b8fc2,backing_fmt=raw /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk 1073741824" returned: 0 in 0.063s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "b594736f5326cc44b2c21b0265dc7a86f25b8fc2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b594736f5326cc44b2c21b0265dc7a86f25b8fc2 --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Successfully updated port: 892001ed-6dfd-4e71-baa0-dae05528700d {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b594736f5326cc44b2c21b0265dc7a86f25b8fc2 --force-share --output=json" returned: 0 in 0.152s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Cannot resize image /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG nova.objects.instance [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lazy-loading 'migration_context' on Instance uuid 3e869e37-c921-48e3-b89a-946bbcc1a5ed {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Ensure instance console log exists: /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.network.neutron [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Successfully updated port: a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "refresh_cache-3e869e37-c921-48e3-b89a-946bbcc1a5ed" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquired lock "refresh_cache-3e869e37-c921-48e3-b89a-946bbcc1a5ed" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.network.neutron [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.compute.manager [req-a7a88d7d-4588-4bcf-ba2f-416378225bc0 req-547883f2-79bc-4659-ae9f-81ecba587cec service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received event network-changed-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.compute.manager [req-a7a88d7d-4588-4bcf-ba2f-416378225bc0 req-547883f2-79bc-4659-ae9f-81ecba587cec service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Refreshing instance network info cache due to event network-changed-a2128465-b362-4945-945b-c02795ea1705. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a7a88d7d-4588-4bcf-ba2f-416378225bc0 req-547883f2-79bc-4659-ae9f-81ecba587cec service nova] Acquiring lock "refresh_cache-3e869e37-c921-48e3-b89a-946bbcc1a5ed" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.compute.manager [req-223d46d7-f28d-400b-b71a-ba45651d9f7c req-62aec4d3-7135-4277-876d-867bf578fc11 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-changed-52014d35-b37b-41ec-ab07-1ec05db59785 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.compute.manager [req-223d46d7-f28d-400b-b71a-ba45651d9f7c req-62aec4d3-7135-4277-876d-867bf578fc11 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Refreshing instance network info cache due to event network-changed-52014d35-b37b-41ec-ab07-1ec05db59785. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-223d46d7-f28d-400b-b71a-ba45651d9f7c req-62aec4d3-7135-4277-876d-867bf578fc11 service nova] Acquiring lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-223d46d7-f28d-400b-b71a-ba45651d9f7c req-62aec4d3-7135-4277-876d-867bf578fc11 service nova] Acquired lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.network.neutron [req-223d46d7-f28d-400b-b71a-ba45651d9f7c req-62aec4d3-7135-4277-876d-867bf578fc11 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Refreshing network info cache for port 52014d35-b37b-41ec-ab07-1ec05db59785 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.network.neutron [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.network.neutron [req-223d46d7-f28d-400b-b71a-ba45651d9f7c req-62aec4d3-7135-4277-876d-867bf578fc11 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Acquiring lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lazy-loading 'flavor' on Instance uuid 54cee809-6ad0-4a16-85cd-ebf8ef683bbe {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Successfully updated port: babde51a-fce1-4954-8aa6-2e3715330cf0 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.network.neutron [req-223d46d7-f28d-400b-b71a-ba45651d9f7c req-62aec4d3-7135-4277-876d-867bf578fc11 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-223d46d7-f28d-400b-b71a-ba45651d9f7c req-62aec4d3-7135-4277-876d-867bf578fc11 service nova] Releasing lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.compute.manager [req-223d46d7-f28d-400b-b71a-ba45651d9f7c req-62aec4d3-7135-4277-876d-867bf578fc11 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-changed-892001ed-6dfd-4e71-baa0-dae05528700d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.compute.manager [req-223d46d7-f28d-400b-b71a-ba45651d9f7c req-62aec4d3-7135-4277-876d-867bf578fc11 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Refreshing instance network info cache due to event network-changed-892001ed-6dfd-4e71-baa0-dae05528700d. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-223d46d7-f28d-400b-b71a-ba45651d9f7c req-62aec4d3-7135-4277-876d-867bf578fc11 service nova] Acquiring lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-223d46d7-f28d-400b-b71a-ba45651d9f7c req-62aec4d3-7135-4277-876d-867bf578fc11 service nova] Acquired lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.network.neutron [req-223d46d7-f28d-400b-b71a-ba45651d9f7c req-62aec4d3-7135-4277-876d-867bf578fc11 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Refreshing network info cache for port 892001ed-6dfd-4e71-baa0-dae05528700d {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.112s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.network.neutron [req-223d46d7-f28d-400b-b71a-ba45651d9f7c req-62aec4d3-7135-4277-876d-867bf578fc11 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.network.neutron [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Updating instance_info_cache with network_info: [{"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Releasing lock "refresh_cache-3e869e37-c921-48e3-b89a-946bbcc1a5ed" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.compute.manager [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Instance network_info: |[{"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a7a88d7d-4588-4bcf-ba2f-416378225bc0 req-547883f2-79bc-4659-ae9f-81ecba587cec service nova] Acquired lock "refresh_cache-3e869e37-c921-48e3-b89a-946bbcc1a5ed" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.network.neutron [req-a7a88d7d-4588-4bcf-ba2f-416378225bc0 req-547883f2-79bc-4659-ae9f-81ecba587cec service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Refreshing network info cache for port a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Start _get_guest_xml network_info=[{"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:21:46Z,direct_url=<?>,disk_format='qcow2',id=01e1b9e2-1afb-49c6-88ca-e8c8a2144418,min_disk=0,min_ram=0,name='tempest-scenario-img--846768859',owner='b5e1f59585b44545ae3ec0cdfa480fab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:21:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '01e1b9e2-1afb-49c6-88ca-e8c8a2144418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:21:52 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:21:52 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:21:46Z,direct_url=<?>,disk_format='qcow2',id=01e1b9e2-1afb-49c6-88ca-e8c8a2144418,min_disk=0,min_ram=0,name='tempest-scenario-img--846768859',owner='b5e1f59585b44545ae3ec0cdfa480fab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:21:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1436254959',display_name='tempest-TestMinimumBasicScenario-server-1436254959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1436254959',id=13,image_ref='01e1b9e2-1afb-49c6-88ca-e8c8a2144418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXoI7zVJBdB0lr76+ibKx3rQTpkh4ZH+yifRw2rO8nKGcImkfspfIluEMinD7nXk08i9/YN+XHFBkn4ywU/yP/bAjF2s6xHFjvo2R0jo8pEhg87HKQHG3uQq9h9kIwiKA==',key_name='tempest-TestMinimumBasicScenario-2124161389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5e1f59585b44545ae3ec0cdfa480fab',ramdisk_id='',reservation_id='r-5r163mpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='01e1b9e2-1afb-49c6-88ca-e8c8a2144418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1524896067',owner_user_name='tempest-TestMinimumBasicScenario-1524896067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:50Z,user_data=None,user_id='2c5267b768cf46958384d9ad4c585f82',uuid=3e869e37-c921-48e3-b89a-946bbcc1a5ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Converting VIF {"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=a2128465-b362-4945-945b-c02795ea1705,network=Network(d1dbf82c-df93-48ae-b118-278943635ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2128465-b3') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.objects.instance [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e869e37-c921-48e3-b89a-946bbcc1a5ed {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:21:52 user nova-compute[72201]:   <uuid>3e869e37-c921-48e3-b89a-946bbcc1a5ed</uuid>
Aug 01 15:21:52 user nova-compute[72201]:   <name>instance-0000000d</name>
Aug 01 15:21:52 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:21:52 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:21:52 user nova-compute[72201]:   <metadata>
Aug 01 15:21:52 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:21:52 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:21:52 user nova-compute[72201]:       <nova:name>tempest-TestMinimumBasicScenario-server-1436254959</nova:name>
Aug 01 15:21:52 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:21:52</nova:creationTime>
Aug 01 15:21:52 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:21:52 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:21:52 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:21:52 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:21:52 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:21:52 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:21:52 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:21:52 user nova-compute[72201]:       <nova:owner>
Aug 01 15:21:52 user nova-compute[72201]:         <nova:user uuid="2c5267b768cf46958384d9ad4c585f82">tempest-TestMinimumBasicScenario-1524896067-project-member</nova:user>
Aug 01 15:21:52 user nova-compute[72201]:         <nova:project uuid="b5e1f59585b44545ae3ec0cdfa480fab">tempest-TestMinimumBasicScenario-1524896067</nova:project>
Aug 01 15:21:52 user nova-compute[72201]:       </nova:owner>
Aug 01 15:21:52 user nova-compute[72201]:       <nova:root type="image" uuid="01e1b9e2-1afb-49c6-88ca-e8c8a2144418"/>
Aug 01 15:21:52 user nova-compute[72201]:       <nova:ports>
Aug 01 15:21:52 user nova-compute[72201]:         <nova:port uuid="a2128465-b362-4945-945b-c02795ea1705">
Aug 01 15:21:52 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 15:21:52 user nova-compute[72201]:         </nova:port>
Aug 01 15:21:52 user nova-compute[72201]:       </nova:ports>
Aug 01 15:21:52 user nova-compute[72201]:     </nova:instance>
Aug 01 15:21:52 user nova-compute[72201]:   </metadata>
Aug 01 15:21:52 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:21:52 user nova-compute[72201]:     <system>
Aug 01 15:21:52 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:21:52 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:21:52 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:21:52 user nova-compute[72201]:       <entry name="serial">3e869e37-c921-48e3-b89a-946bbcc1a5ed</entry>
Aug 01 15:21:52 user nova-compute[72201]:       <entry name="uuid">3e869e37-c921-48e3-b89a-946bbcc1a5ed</entry>
Aug 01 15:21:52 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:21:52 user nova-compute[72201]:     </system>
Aug 01 15:21:52 user nova-compute[72201]:   </sysinfo>
Aug 01 15:21:52 user nova-compute[72201]:   <os>
Aug 01 15:21:52 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:21:52 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:21:52 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:21:52 user nova-compute[72201]:   </os>
Aug 01 15:21:52 user nova-compute[72201]:   <features>
Aug 01 15:21:52 user nova-compute[72201]:     <acpi/>
Aug 01 15:21:52 user nova-compute[72201]:     <apic/>
Aug 01 15:21:52 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:21:52 user nova-compute[72201]:   </features>
Aug 01 15:21:52 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:21:52 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:21:52 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:21:52 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:21:52 user nova-compute[72201]:   </clock>
Aug 01 15:21:52 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:21:52 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:21:52 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:21:52 user nova-compute[72201]:   </cpu>
Aug 01 15:21:52 user nova-compute[72201]:   <devices>
Aug 01 15:21:52 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:21:52 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:21:52 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk"/>
Aug 01 15:21:52 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:21:52 user nova-compute[72201]:     </disk>
Aug 01 15:21:52 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:21:52 user nova-compute[72201]:       <mac address="fa:16:3e:c4:7c:00"/>
Aug 01 15:21:52 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:21:52 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:21:52 user nova-compute[72201]:       <target dev="tapa2128465-b3"/>
Aug 01 15:21:52 user nova-compute[72201]:     </interface>
Aug 01 15:21:52 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:21:52 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/console.log" append="off"/>
Aug 01 15:21:52 user nova-compute[72201]:     </serial>
Aug 01 15:21:52 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:21:52 user nova-compute[72201]:     <video>
Aug 01 15:21:52 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:21:52 user nova-compute[72201]:     </video>
Aug 01 15:21:52 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:21:52 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:21:52 user nova-compute[72201]:     </rng>
Aug 01 15:21:52 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:21:52 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:21:52 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:21:52 user nova-compute[72201]:     </memballoon>
Aug 01 15:21:52 user nova-compute[72201]:   </devices>
Aug 01 15:21:52 user nova-compute[72201]: </domain>
Aug 01 15:21:52 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1436254959',display_name='tempest-TestMinimumBasicScenario-server-1436254959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1436254959',id=13,image_ref='01e1b9e2-1afb-49c6-88ca-e8c8a2144418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXoI7zVJBdB0lr76+ibKx3rQTpkh4ZH+yifRw2rO8nKGcImkfspfIluEMinD7nXk08i9/YN+XHFBkn4ywU/yP/bAjF2s6xHFjvo2R0jo8pEhg87HKQHG3uQq9h9kIwiKA==',key_name='tempest-TestMinimumBasicScenario-2124161389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5e1f59585b44545ae3ec0cdfa480fab',ramdisk_id='',reservation_id='r-5r163mpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='01e1b9e2-1afb-49c6-88ca-e8c8a2144418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1524896067',owner_user_name='tempest-TestMinimumBasicScenario-1524896067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:50Z,user_data=None,user_id='2c5267b768cf46958384d9ad4c585f82',uuid=3e869e37-c921-48e3-b89a-946bbcc1a5ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Converting VIF {"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=a2128465-b362-4945-945b-c02795ea1705,network=Network(d1dbf82c-df93-48ae-b118-278943635ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2128465-b3') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG os_vif [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=a2128465-b362-4945-945b-c02795ea1705,network=Network(d1dbf82c-df93-48ae-b118-278943635ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2128465-b3') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.network.neutron [req-223d46d7-f28d-400b-b71a-ba45651d9f7c req-62aec4d3-7135-4277-876d-867bf578fc11 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-223d46d7-f28d-400b-b71a-ba45651d9f7c req-62aec4d3-7135-4277-876d-867bf578fc11 service nova] Releasing lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2128465-b3, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa2128465-b3, col_values=(('external_ids', {'iface-id': 'a2128465-b362-4945-945b-c02795ea1705', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:7c:00', 'vm-uuid': '3e869e37-c921-48e3-b89a-946bbcc1a5ed'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:52 user nova-compute[72201]: INFO os_vif [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=a2128465-b362-4945-945b-c02795ea1705,network=Network(d1dbf82c-df93-48ae-b118-278943635ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2128465-b3')
Aug 01 15:21:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Acquiring lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:52 user nova-compute[72201]: INFO nova.compute.manager [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Attaching volume 63518989-b7e3-4b73-bb1d-daa99b9dfcc6 to /dev/vdb
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:21:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] No VIF found with MAC fa:16:3e:c4:7c:00, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG os_brick.utils [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe079ae6-2b60-4270-b79e-753aa4fa484e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[157d6ab7-ae31-49f8-9478-ad4f5ec3d4e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:53 user nova-compute[72201]: INFO nova.virt.block_device [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Booting with volume c452cc06-1e64-4257-8ee5-7f75f4ead5c9 at /dev/vdb
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa50ac29-227b-432d-a786-f0695830f90c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cf95d7-18ac-4b28-885c-82a5e9e09478]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:21:53 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15ed3d7-e2b8-428d-8339-356acd838b4e]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG os_brick.utils [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Updating existing volume attachment record: b77afc6d-75af-4d2a-8370-a5df6770fdcd {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG os_brick.utils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c798664e-cd5f-42e7-84c6-7f8d485aad4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[689272c5-7802-46fd-a1da-aa6756cd1e52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG nova.network.neutron [req-a7a88d7d-4588-4bcf-ba2f-416378225bc0 req-547883f2-79bc-4659-ae9f-81ecba587cec service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Updated VIF entry in instance network info cache for port a2128465-b362-4945-945b-c02795ea1705. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG nova.network.neutron [req-a7a88d7d-4588-4bcf-ba2f-416378225bc0 req-547883f2-79bc-4659-ae9f-81ecba587cec service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Updating instance_info_cache with network_info: [{"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0fbcbc-a86a-4d0c-8342-9239029148fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1288a32f-a777-4ccf-b6e9-5a99f65700bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a7a88d7d-4588-4bcf-ba2f-416378225bc0 req-547883f2-79bc-4659-ae9f-81ecba587cec service nova] Releasing lock "refresh_cache-3e869e37-c921-48e3-b89a-946bbcc1a5ed" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:21:53 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e340ec27-3292-44a3-85ce-5c9da81a010f]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG os_brick.utils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Updating existing volume attachment record: ffdb0e91-4797-48a4-b55c-d96f4fe5c897 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Successfully updated port: 5c3087dd-d4fb-4ec6-8ae3-7a90993941ae {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Acquiring lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Acquired lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG nova.compute.manager [req-344975b4-24ea-462d-b5db-8baff52039b2 req-357aadd1-6442-40b5-9d0f-93af9826411e service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-changed-5c3087dd-d4fb-4ec6-8ae3-7a90993941ae {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG nova.compute.manager [req-344975b4-24ea-462d-b5db-8baff52039b2 req-357aadd1-6442-40b5-9d0f-93af9826411e service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Refreshing instance network info cache due to event network-changed-5c3087dd-d4fb-4ec6-8ae3-7a90993941ae. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-344975b4-24ea-462d-b5db-8baff52039b2 req-357aadd1-6442-40b5-9d0f-93af9826411e service nova] Acquiring lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:21:53 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.compute.manager [req-4325b480-e5f0-4c23-a7a5-1bc04f97d799 req-df12dcea-d928-471f-9590-db7f5de22680 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-changed-babde51a-fce1-4954-8aa6-2e3715330cf0 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.compute.manager [req-4325b480-e5f0-4c23-a7a5-1bc04f97d799 req-df12dcea-d928-471f-9590-db7f5de22680 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Refreshing instance network info cache due to event network-changed-babde51a-fce1-4954-8aa6-2e3715330cf0. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4325b480-e5f0-4c23-a7a5-1bc04f97d799 req-df12dcea-d928-471f-9590-db7f5de22680 service nova] Acquiring lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:21:54 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Creating image(s)
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Did not create local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Ensure instance console log exists: /opt/stack/data/nova/instances/45a40359-7496-44f6-ae86-a77f991e5106/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Start _get_guest_xml network_info=[{"id": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "address": "fa:16:3e:5c:9c:8c", "network": {"id": "dd813b4b-a3e3-44c9-839b-1eab4b536882", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1931202477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12cc53e2-1a", "ovs_interfaceid": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e420509-edf8-4398-892b-ee3e4ebb450d", "address": "fa:16:3e:b2:af:3c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e420509-ed", "ovs_interfaceid": "6e420509-edf8-4398-892b-ee3e4ebb450d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28037956-d408-4d2b-9ea8-76dda5239b9b", "address": "fa:16:3e:3f:1c:0c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28037956-d4", "ovs_interfaceid": "28037956-d408-4d2b-9ea8-76dda5239b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "address": "fa:16:3e:c9:09:37", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3cbe0f-91", "ovs_interfaceid": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "address": "fa:16:3e:49:dc:99", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc347a8-bb", "ovs_interfaceid": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "address": "fa:16:3e:c5:f9:56", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2b6f03-3c", "ovs_interfaceid": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "address": "fa:16:3e:0f:d2:23", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3dbdee9-e9", "ovs_interfaceid": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dGEiVaxY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '45a40359-7496-44f6-ae86-a77f991e5106', 'attached_at': '', 'detached_at': '', 'volume_id': '0409930c-64ac-4079-ba24-2beb3dd73e57', 'serial': '0409930c-64ac-4079-ba24-2beb3dd73e57'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '01b37948-1871-468d-8f91-3a7bc70e2556', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wkTxAsDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '45a40359-7496-44f6-ae86-a77f991e5106', 'attached_at': '', 'detached_at': '', 'volume_id': '82b81bbc-3da9-48ba-a3aa-115edf768429', 'serial': '82b81bbc-3da9-48ba-a3aa-115edf768429'}, 'guest_format': None, 'boot_index': 1, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'eace7136-9575-47e6-b704-6ec888f0f64d', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eEPVwAWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '45a40359-7496-44f6-ae86-a77f991e5106', 'attached_at': '', 'detached_at': '', 'volume_id': 'f50070c4-3768-46e8-bb02-aa1bb66a65e0', 'serial': 'f50070c4-3768-46e8-bb02-aa1bb66a65e0'}, 'guest_format': None, 'boot_index': 2, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '0575db35-7421-4865-a945-485067c3192c', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:21:54 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:21:54 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG os_brick.initiator.connector [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Factory for ISCSI on None {{(pid=72201) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dGEiVaxY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:21:54 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:21:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:21:54 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:21:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:21:54 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c671dd7-7630-4d6d-9552-403f5c4e8925]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:21:54 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2309ac-50a4-46db-b5f3-be2b546d3f2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57] added
Aug 01 15:21:54 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff37666-7cbe-45eb-959b-7c010739ed66]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0690a117-46a8-41e9-b10b-4446e468e6d0]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dGEiVaxY {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dGEiVaxY" returned: 0 in 0.028s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06e2086-5fee-4260-b3cb-e5f0dc71b392]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dGEiVaxY'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d9a8d1-fc55-4b9e-9aea-364e7f3b0e00]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6094b0d1-36b7-479a-aec3-bc1e81cadbc3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 15:21:55 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 15:21:55 user nova-compute[72201]:  {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:21:55 user nova-compute[72201]: WARNING os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 15:21:55 user nova-compute[72201]: 
Aug 01 15:21:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6155ec72-2b06-4015-b7a4-c7a939272ec4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57, portal: 172.16.0.220,3260]
Aug 01 15:21:55 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57, portal: 172.16.0.220,3260] successful.
Aug 01 15:21:55 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[203f5920-c46e-4990-97ae-bdd2681b98bd]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef6d125-5e66-47dc-bc1c-79d8802df22b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:21:55 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:21:55 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[09154511-7145-4966-8091-ffc1f94fec93]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dGEiVaxY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Updating instance_info_cache with network_info: [{"id": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "address": "fa:16:3e:43:cd:e6", "network": {"id": "43b87e91-7bb8-432c-abc5-9821f28350ef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-494863642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6a1011-f0", "ovs_interfaceid": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "address": "fa:16:3e:e9:aa:f5", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bdcebc-0f", "ovs_interfaceid": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5eec44e9-3963-454e-931c-4f5a94548672", "address": "fa:16:3e:9c:5a:6f", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eec44e9-39", "ovs_interfaceid": "5eec44e9-3963-454e-931c-4f5a94548672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "52014d35-b37b-41ec-ab07-1ec05db59785", "address": "fa:16:3e:f0:e7:fb", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52014d35-b3", "ovs_interfaceid": "52014d35-b37b-41ec-ab07-1ec05db59785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "892001ed-6dfd-4e71-baa0-dae05528700d", "address": "fa:16:3e:59:ec:7a", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892001ed-6d", "ovs_interfaceid": "892001ed-6dfd-4e71-baa0-dae05528700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "babde51a-fce1-4954-8aa6-2e3715330cf0", "address": "fa:16:3e:41:5d:45", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabde51a-fc", "ovs_interfaceid": "babde51a-fce1-4954-8aa6-2e3715330cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "address": "fa:16:3e:bd:98:53", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c3087dd-d4", "ovs_interfaceid": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Releasing lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Instance network_info: |[{"id": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "address": "fa:16:3e:43:cd:e6", "network": {"id": "43b87e91-7bb8-432c-abc5-9821f28350ef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-494863642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6a1011-f0", "ovs_interfaceid": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "address": "fa:16:3e:e9:aa:f5", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bdcebc-0f", "ovs_interfaceid": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5eec44e9-3963-454e-931c-4f5a94548672", "address": "fa:16:3e:9c:5a:6f", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eec44e9-39", "ovs_interfaceid": "5eec44e9-3963-454e-931c-4f5a94548672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "52014d35-b37b-41ec-ab07-1ec05db59785", "address": "fa:16:3e:f0:e7:fb", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52014d35-b3", "ovs_interfaceid": "52014d35-b37b-41ec-ab07-1ec05db59785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "892001ed-6dfd-4e71-baa0-dae05528700d", "address": "fa:16:3e:59:ec:7a", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892001ed-6d", "ovs_interfaceid": "892001ed-6dfd-4e71-baa0-dae05528700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "babde51a-fce1-4954-8aa6-2e3715330cf0", "address": "fa:16:3e:41:5d:45", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabde51a-fc", "ovs_interfaceid": "babde51a-fce1-4954-8aa6-2e3715330cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "address": "fa:16:3e:bd:98:53", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c3087dd-d4", "ovs_interfaceid": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-344975b4-24ea-462d-b5db-8baff52039b2 req-357aadd1-6442-40b5-9d0f-93af9826411e service nova] Acquired lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:21:55 user nova-compute[72201]: DEBUG nova.network.neutron [req-344975b4-24ea-462d-b5db-8baff52039b2 req-357aadd1-6442-40b5-9d0f-93af9826411e service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Refreshing network info cache for port 5c3087dd-d4fb-4ec6-8ae3-7a90993941ae {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23133623233666366', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133623233666366', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.network.neutron [req-344975b4-24ea-462d-b5db-8baff52039b2 req-357aadd1-6442-40b5-9d0f-93af9826411e service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Updated VIF entry in instance network info cache for port 5c3087dd-d4fb-4ec6-8ae3-7a90993941ae. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.network.neutron [req-344975b4-24ea-462d-b5db-8baff52039b2 req-357aadd1-6442-40b5-9d0f-93af9826411e service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Updating instance_info_cache with network_info: [{"id": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "address": "fa:16:3e:43:cd:e6", "network": {"id": "43b87e91-7bb8-432c-abc5-9821f28350ef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-494863642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6a1011-f0", "ovs_interfaceid": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "address": "fa:16:3e:e9:aa:f5", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bdcebc-0f", "ovs_interfaceid": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5eec44e9-3963-454e-931c-4f5a94548672", "address": "fa:16:3e:9c:5a:6f", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eec44e9-39", "ovs_interfaceid": "5eec44e9-3963-454e-931c-4f5a94548672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "52014d35-b37b-41ec-ab07-1ec05db59785", "address": "fa:16:3e:f0:e7:fb", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52014d35-b3", "ovs_interfaceid": "52014d35-b37b-41ec-ab07-1ec05db59785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "892001ed-6dfd-4e71-baa0-dae05528700d", "address": "fa:16:3e:59:ec:7a", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892001ed-6d", "ovs_interfaceid": "892001ed-6dfd-4e71-baa0-dae05528700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "babde51a-fce1-4954-8aa6-2e3715330cf0", "address": "fa:16:3e:41:5d:45", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabde51a-fc", "ovs_interfaceid": "babde51a-fce1-4954-8aa6-2e3715330cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "address": "fa:16:3e:bd:98:53", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c3087dd-d4", "ovs_interfaceid": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-b64f1cfb-64f2-4493-8721-fc63fcd93bb6" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-b64f1cfb-64f2-4493-8721-fc63fcd93bb6" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-344975b4-24ea-462d-b5db-8baff52039b2 req-357aadd1-6442-40b5-9d0f-93af9826411e service nova] Releasing lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4325b480-e5f0-4c23-a7a5-1bc04f97d799 req-df12dcea-d928-471f-9590-db7f5de22680 service nova] Acquired lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.network.neutron [req-4325b480-e5f0-4c23-a7a5-1bc04f97d799 req-df12dcea-d928-471f-9590-db7f5de22680 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Refreshing network info cache for port babde51a-fce1-4954-8aa6-2e3715330cf0 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wkTxAsDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:21:56 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:21:56 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:21:56 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[17314543-d150-4d08-9b0b-d90edf541eca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:21:56 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b55e2ae-6f71-432a-9d71-ef3e172deb47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429] added
Aug 01 15:21:56 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[266e7929-fc68-4a9c-9c0e-507aa77bb632]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdb0f05-9341-4e21-8e25-19ff8f995927]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wkTxAsDC {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-05785856-ac37-4c6a-a547-a81e308bcb0e req-539c79d3-a209-4c9f-8002-ded50047564c service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received event network-vif-plugged-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-05785856-ac37-4c6a-a547-a81e308bcb0e req-539c79d3-a209-4c9f-8002-ded50047564c service nova] Acquiring lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-05785856-ac37-4c6a-a547-a81e308bcb0e req-539c79d3-a209-4c9f-8002-ded50047564c service nova] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-05785856-ac37-4c6a-a547-a81e308bcb0e req-539c79d3-a209-4c9f-8002-ded50047564c service nova] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-05785856-ac37-4c6a-a547-a81e308bcb0e req-539c79d3-a209-4c9f-8002-ded50047564c service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] No waiting events found dispatching network-vif-plugged-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:21:56 user nova-compute[72201]: WARNING nova.compute.manager [req-05785856-ac37-4c6a-a547-a81e308bcb0e req-539c79d3-a209-4c9f-8002-ded50047564c service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received unexpected event network-vif-plugged-a2128465-b362-4945-945b-c02795ea1705 for instance with vm_state building and task_state spawning.
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-05785856-ac37-4c6a-a547-a81e308bcb0e req-539c79d3-a209-4c9f-8002-ded50047564c service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received event network-vif-plugged-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-05785856-ac37-4c6a-a547-a81e308bcb0e req-539c79d3-a209-4c9f-8002-ded50047564c service nova] Acquiring lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-05785856-ac37-4c6a-a547-a81e308bcb0e req-539c79d3-a209-4c9f-8002-ded50047564c service nova] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-05785856-ac37-4c6a-a547-a81e308bcb0e req-539c79d3-a209-4c9f-8002-ded50047564c service nova] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-05785856-ac37-4c6a-a547-a81e308bcb0e req-539c79d3-a209-4c9f-8002-ded50047564c service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] No waiting events found dispatching network-vif-plugged-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:21:56 user nova-compute[72201]: WARNING nova.compute.manager [req-05785856-ac37-4c6a-a547-a81e308bcb0e req-539c79d3-a209-4c9f-8002-ded50047564c service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received unexpected event network-vif-plugged-a2128465-b362-4945-945b-c02795ea1705 for instance with vm_state building and task_state spawning.
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wkTxAsDC" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aeca1c0-cdfa-4477-8df4-e358ffafa820]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wkTxAsDC'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc45b38-5d08-484a-9936-34392a3ca99d]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2144b0d6-1440-4520-9cf5-182f90b28b06]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:21:56 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:21:56 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[713c1a9d-78da-4b08-8e8e-7abf0ac469e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429, portal: 172.16.0.220,3260]
Aug 01 15:21:56 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429, portal: 172.16.0.220,3260] successful.
Aug 01 15:21:56 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[38361be3-026a-45ab-8f34-6f1d2f51f3ed]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53631ea-28e9-4895-b231-bb1f34d85b07]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:21:56 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:21:56 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:21:56 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:21:56 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903316.6137874, 3e869e37-c921-48e3-b89a-946bbcc1a5ed => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:21:56 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] VM Resumed (Lifecycle Event)
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d525b02-4b4b-4285-9110-0fe83f193313]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wkTxAsDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:21:56 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Instance spawned successfully.
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.network.neutron [req-4325b480-e5f0-4c23-a7a5-1bc04f97d799 req-df12dcea-d928-471f-9590-db7f5de22680 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Updated VIF entry in instance network info cache for port babde51a-fce1-4954-8aa6-2e3715330cf0. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.network.neutron [req-4325b480-e5f0-4c23-a7a5-1bc04f97d799 req-df12dcea-d928-471f-9590-db7f5de22680 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Updating instance_info_cache with network_info: [{"id": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "address": "fa:16:3e:43:cd:e6", "network": {"id": "43b87e91-7bb8-432c-abc5-9821f28350ef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-494863642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6a1011-f0", "ovs_interfaceid": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "address": "fa:16:3e:e9:aa:f5", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bdcebc-0f", "ovs_interfaceid": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5eec44e9-3963-454e-931c-4f5a94548672", "address": "fa:16:3e:9c:5a:6f", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eec44e9-39", "ovs_interfaceid": "5eec44e9-3963-454e-931c-4f5a94548672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "52014d35-b37b-41ec-ab07-1ec05db59785", "address": "fa:16:3e:f0:e7:fb", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52014d35-b3", "ovs_interfaceid": "52014d35-b37b-41ec-ab07-1ec05db59785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "892001ed-6dfd-4e71-baa0-dae05528700d", "address": "fa:16:3e:59:ec:7a", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892001ed-6d", "ovs_interfaceid": "892001ed-6dfd-4e71-baa0-dae05528700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "babde51a-fce1-4954-8aa6-2e3715330cf0", "address": "fa:16:3e:41:5d:45", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabde51a-fc", "ovs_interfaceid": "babde51a-fce1-4954-8aa6-2e3715330cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "address": "fa:16:3e:bd:98:53", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c3087dd-d4", "ovs_interfaceid": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4325b480-e5f0-4c23-a7a5-1bc04f97d799 req-df12dcea-d928-471f-9590-db7f5de22680 service nova] Releasing lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:21:56 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903316.6146839, 3e869e37-c921-48e3-b89a-946bbcc1a5ed => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:21:56 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] VM Started (Lifecycle Event)
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Updating instance_info_cache with network_info: [{"id": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "address": "fa:16:3e:5d:24:e6", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8b84b-6b", "ovs_interfaceid": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:21:56 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-b64f1cfb-64f2-4493-8721-fc63fcd93bb6" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:21:56 user nova-compute[72201]: INFO nova.compute.manager [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Took 6.91 seconds to spawn the instance on the hypervisor.
Aug 01 15:21:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:21:56 user nova-compute[72201]: INFO nova.compute.manager [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Took 7.82 seconds to build instance.
Aug 01 15:21:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-36ea383f-df0d-4862-a28e-1f117b023886 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.933s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26662636131386238', 'path': '/dev/sdc'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662636131386238', 'path': '/dev/sdc'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eEPVwAWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:21:57 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:21:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:21:57 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:21:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:21:57 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f92fba1-b8e6-4784-a327-88b44c3fe845]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:21:57 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[764cb127-1aab-4e6b-b8ed-04ece5495c61]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0] added
Aug 01 15:21:57 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[510d14ac-a6f8-4d06-b31f-e0590a5ea803]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c65ae0-cc1c-4ec0-bdf4-e721324d372a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eEPVwAWZ {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eEPVwAWZ" returned: 0 in 0.108s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecabf060-df0b-4fc6-869e-66d7f3e47184]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eEPVwAWZ'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab54b43-ba31-4303-8ac0-5ec05a4a88cc]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e7167b-7d54-4206-88f7-7db3df35375f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:21:57 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:21:57 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:21:57 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:21:57 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:21:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab22aaf-1d9f-4ffd-a381-d19b63832592]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0, portal: 172.16.0.220,3260]
Aug 01 15:21:58 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0, portal: 172.16.0.220,3260] successful.
Aug 01 15:21:58 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfea30bb-1b5a-4c1f-a86d-a0b347a89fa6]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5417562-850e-4b3f-85cf-89072c3b4b90]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:21:58 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:21:58 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:21:58 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:21:58 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:21:58 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:21:58 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[162161b8-028c-4fb8-9869-bed83471bc36]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eEPVwAWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:21:58 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '26362653263633531', 'path': '/dev/sdd'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362653263633531', 'path': '/dev/sdd'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2097729005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2097729005',id=10,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp1K/ORVcGLeOVNZLXDddd0H6aTpPgyDEIb1ynvVxfBr7TjGEofHSas3VzHl7WfFaIdXDza1M1ImDTGGDwP0YTIFxJ4VJA2DglK20QPjpeUjMA0Iz8F+wHOKnyAmm2JQw==',key_name='tempest-keypair-852805528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e55bd6f4fa84c4da104a5a782bad7ff',ramdisk_id='',reservation_id='r-k6xe63iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-729948914',owner_user_name='tempest-TaggedBootDevicesTest-729948914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffd657fbfccc4fc2a7f58a60bcada3df',uuid=45a40359-7496-44f6-ae86-a77f991e5106,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "address": "fa:16:3e:5c:9c:8c", "network": {"id": "dd813b4b-a3e3-44c9-839b-1eab4b536882", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1931202477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12cc53e2-1a", "ovs_interfaceid": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converting VIF {"id": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "address": "fa:16:3e:5c:9c:8c", "network": {"id": "dd813b4b-a3e3-44c9-839b-1eab4b536882", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1931202477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12cc53e2-1a", "ovs_interfaceid": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=12cc53e2-1a6d-455c-9737-dd4a14957fa0,network=Network(dd813b4b-a3e3-44c9-839b-1eab4b536882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12cc53e2-1a') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2097729005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2097729005',id=10,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp1K/ORVcGLeOVNZLXDddd0H6aTpPgyDEIb1ynvVxfBr7TjGEofHSas3VzHl7WfFaIdXDza1M1ImDTGGDwP0YTIFxJ4VJA2DglK20QPjpeUjMA0Iz8F+wHOKnyAmm2JQw==',key_name='tempest-keypair-852805528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e55bd6f4fa84c4da104a5a782bad7ff',ramdisk_id='',reservation_id='r-k6xe63iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-729948914',owner_user_name='tempest-TaggedBootDevicesTest-729948914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffd657fbfccc4fc2a7f58a60bcada3df',uuid=45a40359-7496-44f6-ae86-a77f991e5106,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e420509-edf8-4398-892b-ee3e4ebb450d", "address": "fa:16:3e:b2:af:3c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e420509-ed", "ovs_interfaceid": "6e420509-edf8-4398-892b-ee3e4ebb450d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converting VIF {"id": "6e420509-edf8-4398-892b-ee3e4ebb450d", "address": "fa:16:3e:b2:af:3c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e420509-ed", "ovs_interfaceid": "6e420509-edf8-4398-892b-ee3e4ebb450d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:3c,bridge_name='br-int',has_traffic_filtering=True,id=6e420509-edf8-4398-892b-ee3e4ebb450d,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e420509-ed') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2097729005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2097729005',id=10,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp1K/ORVcGLeOVNZLXDddd0H6aTpPgyDEIb1ynvVxfBr7TjGEofHSas3VzHl7WfFaIdXDza1M1ImDTGGDwP0YTIFxJ4VJA2DglK20QPjpeUjMA0Iz8F+wHOKnyAmm2JQw==',key_name='tempest-keypair-852805528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e55bd6f4fa84c4da104a5a782bad7ff',ramdisk_id='',reservation_id='r-k6xe63iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-729948914',owner_user_name='tempest-TaggedBootDevicesTest-729948914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffd657fbfccc4fc2a7f58a60bcada3df',uuid=45a40359-7496-44f6-ae86-a77f991e5106,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28037956-d408-4d2b-9ea8-76dda5239b9b", "address": "fa:16:3e:3f:1c:0c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28037956-d4", "ovs_interfaceid": "28037956-d408-4d2b-9ea8-76dda5239b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converting VIF {"id": "28037956-d408-4d2b-9ea8-76dda5239b9b", "address": "fa:16:3e:3f:1c:0c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28037956-d4", "ovs_interfaceid": "28037956-d408-4d2b-9ea8-76dda5239b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:1c:0c,bridge_name='br-int',has_traffic_filtering=True,id=28037956-d408-4d2b-9ea8-76dda5239b9b,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap28037956-d4') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2097729005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2097729005',id=10,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp1K/ORVcGLeOVNZLXDddd0H6aTpPgyDEIb1ynvVxfBr7TjGEofHSas3VzHl7WfFaIdXDza1M1ImDTGGDwP0YTIFxJ4VJA2DglK20QPjpeUjMA0Iz8F+wHOKnyAmm2JQw==',key_name='tempest-keypair-852805528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e55bd6f4fa84c4da104a5a782bad7ff',ramdisk_id='',reservation_id='r-k6xe63iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-729948914',owner_user_name='tempest-TaggedBootDevicesTest-729948914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffd657fbfccc4fc2a7f58a60bcada3df',uuid=45a40359-7496-44f6-ae86-a77f991e5106,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "address": "fa:16:3e:c9:09:37", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3cbe0f-91", "ovs_interfaceid": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converting VIF {"id": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "address": "fa:16:3e:c9:09:37", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3cbe0f-91", "ovs_interfaceid": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:09:37,bridge_name='br-int',has_traffic_filtering=True,id=ef3cbe0f-91fd-488c-80d1-48609530c75e,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3cbe0f-91') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2097729005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2097729005',id=10,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp1K/ORVcGLeOVNZLXDddd0H6aTpPgyDEIb1ynvVxfBr7TjGEofHSas3VzHl7WfFaIdXDza1M1ImDTGGDwP0YTIFxJ4VJA2DglK20QPjpeUjMA0Iz8F+wHOKnyAmm2JQw==',key_name='tempest-keypair-852805528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e55bd6f4fa84c4da104a5a782bad7ff',ramdisk_id='',reservation_id='r-k6xe63iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-729948914',owner_user_name='tempest-TaggedBootDevicesTest-729948914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffd657fbfccc4fc2a7f58a60bcada3df',uuid=45a40359-7496-44f6-ae86-a77f991e5106,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "address": "fa:16:3e:49:dc:99", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc347a8-bb", "ovs_interfaceid": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converting VIF {"id": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "address": "fa:16:3e:49:dc:99", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc347a8-bb", "ovs_interfaceid": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:dc:99,bridge_name='br-int',has_traffic_filtering=True,id=4cc347a8-bb63-452b-a81a-eb6a87afac30,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc347a8-bb') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2097729005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2097729005',id=10,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp1K/ORVcGLeOVNZLXDddd0H6aTpPgyDEIb1ynvVxfBr7TjGEofHSas3VzHl7WfFaIdXDza1M1ImDTGGDwP0YTIFxJ4VJA2DglK20QPjpeUjMA0Iz8F+wHOKnyAmm2JQw==',key_name='tempest-keypair-852805528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e55bd6f4fa84c4da104a5a782bad7ff',ramdisk_id='',reservation_id='r-k6xe63iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-729948914',owner_user_name='tempest-TaggedBootDevicesTest-729948914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffd657fbfccc4fc2a7f58a60bcada3df',uuid=45a40359-7496-44f6-ae86-a77f991e5106,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "address": "fa:16:3e:c5:f9:56", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2b6f03-3c", "ovs_interfaceid": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converting VIF {"id": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "address": "fa:16:3e:c5:f9:56", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2b6f03-3c", "ovs_interfaceid": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f9:56,bridge_name='br-int',has_traffic_filtering=True,id=8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe,network=Network(9f2eee2b-0819-45b2-bf6f-6831fa766f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e2b6f03-3c') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2097729005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2097729005',id=10,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp1K/ORVcGLeOVNZLXDddd0H6aTpPgyDEIb1ynvVxfBr7TjGEofHSas3VzHl7WfFaIdXDza1M1ImDTGGDwP0YTIFxJ4VJA2DglK20QPjpeUjMA0Iz8F+wHOKnyAmm2JQw==',key_name='tempest-keypair-852805528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e55bd6f4fa84c4da104a5a782bad7ff',ramdisk_id='',reservation_id='r-k6xe63iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-729948914',owner_user_name='tempest-TaggedBootDevicesTest-729948914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffd657fbfccc4fc2a7f58a60bcada3df',uuid=45a40359-7496-44f6-ae86-a77f991e5106,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "address": "fa:16:3e:0f:d2:23", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3dbdee9-e9", "ovs_interfaceid": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converting VIF {"id": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "address": "fa:16:3e:0f:d2:23", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3dbdee9-e9", "ovs_interfaceid": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:d2:23,bridge_name='br-int',has_traffic_filtering=True,id=f3dbdee9-e9a5-4859-b066-ccbb35f2df30,network=Network(9f2eee2b-0819-45b2-bf6f-6831fa766f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3dbdee9-e9') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.objects.instance [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lazy-loading 'pci_devices' on Instance uuid 45a40359-7496-44f6-ae86-a77f991e5106 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:21:59 user nova-compute[72201]:   <uuid>45a40359-7496-44f6-ae86-a77f991e5106</uuid>
Aug 01 15:21:59 user nova-compute[72201]:   <name>instance-0000000a</name>
Aug 01 15:21:59 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:21:59 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:21:59 user nova-compute[72201]:   <metadata>
Aug 01 15:21:59 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:21:59 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:21:59 user nova-compute[72201]:       <nova:name>tempest-device-tagging-server-2097729005</nova:name>
Aug 01 15:21:59 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:21:54</nova:creationTime>
Aug 01 15:21:59 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:21:59 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:21:59 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:21:59 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:21:59 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:21:59 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:21:59 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:21:59 user nova-compute[72201]:       <nova:owner>
Aug 01 15:21:59 user nova-compute[72201]:         <nova:user uuid="ffd657fbfccc4fc2a7f58a60bcada3df">tempest-TaggedBootDevicesTest-729948914-project-member</nova:user>
Aug 01 15:21:59 user nova-compute[72201]:         <nova:project uuid="5e55bd6f4fa84c4da104a5a782bad7ff">tempest-TaggedBootDevicesTest-729948914</nova:project>
Aug 01 15:21:59 user nova-compute[72201]:       </nova:owner>
Aug 01 15:21:59 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:21:59 user nova-compute[72201]:       <nova:ports>
Aug 01 15:21:59 user nova-compute[72201]:         <nova:port uuid="12cc53e2-1a6d-455c-9737-dd4a14957fa0">
Aug 01 15:21:59 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 15:21:59 user nova-compute[72201]:         </nova:port>
Aug 01 15:21:59 user nova-compute[72201]:         <nova:port uuid="6e420509-edf8-4398-892b-ee3e4ebb450d">
Aug 01 15:21:59 user nova-compute[72201]:           <nova:ip type="fixed" address="10.1.1.173" ipVersion="4"/>
Aug 01 15:21:59 user nova-compute[72201]:         </nova:port>
Aug 01 15:21:59 user nova-compute[72201]:         <nova:port uuid="28037956-d408-4d2b-9ea8-76dda5239b9b">
Aug 01 15:21:59 user nova-compute[72201]:           <nova:ip type="fixed" address="10.1.1.187" ipVersion="4"/>
Aug 01 15:21:59 user nova-compute[72201]:         </nova:port>
Aug 01 15:21:59 user nova-compute[72201]:         <nova:port uuid="ef3cbe0f-91fd-488c-80d1-48609530c75e">
Aug 01 15:21:59 user nova-compute[72201]:           <nova:ip type="fixed" address="10.1.1.124" ipVersion="4"/>
Aug 01 15:21:59 user nova-compute[72201]:         </nova:port>
Aug 01 15:21:59 user nova-compute[72201]:         <nova:port uuid="4cc347a8-bb63-452b-a81a-eb6a87afac30">
Aug 01 15:21:59 user nova-compute[72201]:           <nova:ip type="fixed" address="10.1.1.108" ipVersion="4"/>
Aug 01 15:21:59 user nova-compute[72201]:         </nova:port>
Aug 01 15:21:59 user nova-compute[72201]:         <nova:port uuid="8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe">
Aug 01 15:21:59 user nova-compute[72201]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 01 15:21:59 user nova-compute[72201]:         </nova:port>
Aug 01 15:21:59 user nova-compute[72201]:         <nova:port uuid="f3dbdee9-e9a5-4859-b066-ccbb35f2df30">
Aug 01 15:21:59 user nova-compute[72201]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 01 15:21:59 user nova-compute[72201]:         </nova:port>
Aug 01 15:21:59 user nova-compute[72201]:       </nova:ports>
Aug 01 15:21:59 user nova-compute[72201]:     </nova:instance>
Aug 01 15:21:59 user nova-compute[72201]:   </metadata>
Aug 01 15:21:59 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:21:59 user nova-compute[72201]:     <system>
Aug 01 15:21:59 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:21:59 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:21:59 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:21:59 user nova-compute[72201]:       <entry name="serial">45a40359-7496-44f6-ae86-a77f991e5106</entry>
Aug 01 15:21:59 user nova-compute[72201]:       <entry name="uuid">45a40359-7496-44f6-ae86-a77f991e5106</entry>
Aug 01 15:21:59 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:21:59 user nova-compute[72201]:     </system>
Aug 01 15:21:59 user nova-compute[72201]:   </sysinfo>
Aug 01 15:21:59 user nova-compute[72201]:   <os>
Aug 01 15:21:59 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:21:59 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:21:59 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:21:59 user nova-compute[72201]:   </os>
Aug 01 15:21:59 user nova-compute[72201]:   <features>
Aug 01 15:21:59 user nova-compute[72201]:     <acpi/>
Aug 01 15:21:59 user nova-compute[72201]:     <apic/>
Aug 01 15:21:59 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:21:59 user nova-compute[72201]:   </features>
Aug 01 15:21:59 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:21:59 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:21:59 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:21:59 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:21:59 user nova-compute[72201]:   </clock>
Aug 01 15:21:59 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:21:59 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:21:59 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:21:59 user nova-compute[72201]:   </cpu>
Aug 01 15:21:59 user nova-compute[72201]:   <devices>
Aug 01 15:21:59 user nova-compute[72201]:     <disk type="file" device="cdrom">
Aug 01 15:21:59 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 15:21:59 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/45a40359-7496-44f6-ae86-a77f991e5106/disk.config"/>
Aug 01 15:21:59 user nova-compute[72201]:       <target dev="hda" bus="ide"/>
Aug 01 15:21:59 user nova-compute[72201]:     </disk>
Aug 01 15:21:59 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:21:59 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:21:59 user nova-compute[72201]:       <source dev="/dev/sdb"/>
Aug 01 15:21:59 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:21:59 user nova-compute[72201]:       <serial>0409930c-64ac-4079-ba24-2beb3dd73e57</serial>
Aug 01 15:21:59 user nova-compute[72201]:     </disk>
Aug 01 15:21:59 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:21:59 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:21:59 user nova-compute[72201]:       <source dev="/dev/sdc"/>
Aug 01 15:21:59 user nova-compute[72201]:       <target dev="vdb" bus="virtio"/>
Aug 01 15:21:59 user nova-compute[72201]:       <serial>82b81bbc-3da9-48ba-a3aa-115edf768429</serial>
Aug 01 15:21:59 user nova-compute[72201]:     </disk>
Aug 01 15:21:59 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:21:59 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:21:59 user nova-compute[72201]:       <source dev="/dev/sdd"/>
Aug 01 15:21:59 user nova-compute[72201]:       <target dev="vdc" bus="virtio"/>
Aug 01 15:21:59 user nova-compute[72201]:       <serial>f50070c4-3768-46e8-bb02-aa1bb66a65e0</serial>
Aug 01 15:21:59 user nova-compute[72201]:     </disk>
Aug 01 15:21:59 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:21:59 user nova-compute[72201]:       <mac address="fa:16:3e:5c:9c:8c"/>
Aug 01 15:21:59 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:21:59 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:21:59 user nova-compute[72201]:       <target dev="tap12cc53e2-1a"/>
Aug 01 15:21:59 user nova-compute[72201]:     </interface>
Aug 01 15:21:59 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:21:59 user nova-compute[72201]:       <mac address="fa:16:3e:b2:af:3c"/>
Aug 01 15:21:59 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:21:59 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:21:59 user nova-compute[72201]:       <target dev="tap6e420509-ed"/>
Aug 01 15:21:59 user nova-compute[72201]:     </interface>
Aug 01 15:21:59 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:21:59 user nova-compute[72201]:       <mac address="fa:16:3e:3f:1c:0c"/>
Aug 01 15:21:59 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:21:59 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:21:59 user nova-compute[72201]:       <target dev="tap28037956-d4"/>
Aug 01 15:21:59 user nova-compute[72201]:     </interface>
Aug 01 15:21:59 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:21:59 user nova-compute[72201]:       <mac address="fa:16:3e:c9:09:37"/>
Aug 01 15:21:59 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:21:59 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:21:59 user nova-compute[72201]:       <target dev="tapef3cbe0f-91"/>
Aug 01 15:21:59 user nova-compute[72201]:     </interface>
Aug 01 15:21:59 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:21:59 user nova-compute[72201]:       <mac address="fa:16:3e:49:dc:99"/>
Aug 01 15:21:59 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:21:59 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:21:59 user nova-compute[72201]:       <target dev="tap4cc347a8-bb"/>
Aug 01 15:21:59 user nova-compute[72201]:     </interface>
Aug 01 15:21:59 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:21:59 user nova-compute[72201]:       <mac address="fa:16:3e:c5:f9:56"/>
Aug 01 15:21:59 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:21:59 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:21:59 user nova-compute[72201]:       <target dev="tap8e2b6f03-3c"/>
Aug 01 15:21:59 user nova-compute[72201]:     </interface>
Aug 01 15:21:59 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:21:59 user nova-compute[72201]:       <mac address="fa:16:3e:0f:d2:23"/>
Aug 01 15:21:59 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:21:59 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:21:59 user nova-compute[72201]:       <target dev="tapf3dbdee9-e9"/>
Aug 01 15:21:59 user nova-compute[72201]:     </interface>
Aug 01 15:21:59 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:21:59 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/45a40359-7496-44f6-ae86-a77f991e5106/console.log" append="off"/>
Aug 01 15:21:59 user nova-compute[72201]:     </serial>
Aug 01 15:21:59 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:21:59 user nova-compute[72201]:     <video>
Aug 01 15:21:59 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:21:59 user nova-compute[72201]:     </video>
Aug 01 15:21:59 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:21:59 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:21:59 user nova-compute[72201]:     </rng>
Aug 01 15:21:59 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:21:59 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:21:59 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:21:59 user nova-compute[72201]:     </memballoon>
Aug 01 15:21:59 user nova-compute[72201]:   </devices>
Aug 01 15:21:59 user nova-compute[72201]: </domain>
Aug 01 15:21:59 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2097729005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2097729005',id=10,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp1K/ORVcGLeOVNZLXDddd0H6aTpPgyDEIb1ynvVxfBr7TjGEofHSas3VzHl7WfFaIdXDza1M1ImDTGGDwP0YTIFxJ4VJA2DglK20QPjpeUjMA0Iz8F+wHOKnyAmm2JQw==',key_name='tempest-keypair-852805528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e55bd6f4fa84c4da104a5a782bad7ff',ramdisk_id='',reservation_id='r-k6xe63iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-729948914',owner_user_name='tempest-TaggedBootDevicesTest-729948914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffd657fbfccc4fc2a7f58a60bcada3df',uuid=45a40359-7496-44f6-ae86-a77f991e5106,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "address": "fa:16:3e:5c:9c:8c", "network": {"id": "dd813b4b-a3e3-44c9-839b-1eab4b536882", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1931202477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12cc53e2-1a", "ovs_interfaceid": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converting VIF {"id": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "address": "fa:16:3e:5c:9c:8c", "network": {"id": "dd813b4b-a3e3-44c9-839b-1eab4b536882", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1931202477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12cc53e2-1a", "ovs_interfaceid": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=12cc53e2-1a6d-455c-9737-dd4a14957fa0,network=Network(dd813b4b-a3e3-44c9-839b-1eab4b536882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12cc53e2-1a') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG os_vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=12cc53e2-1a6d-455c-9737-dd4a14957fa0,network=Network(dd813b4b-a3e3-44c9-839b-1eab4b536882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12cc53e2-1a') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12cc53e2-1a, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap12cc53e2-1a, col_values=(('external_ids', {'iface-id': '12cc53e2-1a6d-455c-9737-dd4a14957fa0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:9c:8c', 'vm-uuid': '45a40359-7496-44f6-ae86-a77f991e5106'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: INFO os_vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=12cc53e2-1a6d-455c-9737-dd4a14957fa0,network=Network(dd813b4b-a3e3-44c9-839b-1eab4b536882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12cc53e2-1a')
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2097729005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2097729005',id=10,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp1K/ORVcGLeOVNZLXDddd0H6aTpPgyDEIb1ynvVxfBr7TjGEofHSas3VzHl7WfFaIdXDza1M1ImDTGGDwP0YTIFxJ4VJA2DglK20QPjpeUjMA0Iz8F+wHOKnyAmm2JQw==',key_name='tempest-keypair-852805528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e55bd6f4fa84c4da104a5a782bad7ff',ramdisk_id='',reservation_id='r-k6xe63iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-729948914',owner_user_name='tempest-TaggedBootDevicesTest-729948914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffd657fbfccc4fc2a7f58a60bcada3df',uuid=45a40359-7496-44f6-ae86-a77f991e5106,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e420509-edf8-4398-892b-ee3e4ebb450d", "address": "fa:16:3e:b2:af:3c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e420509-ed", "ovs_interfaceid": "6e420509-edf8-4398-892b-ee3e4ebb450d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converting VIF {"id": "6e420509-edf8-4398-892b-ee3e4ebb450d", "address": "fa:16:3e:b2:af:3c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e420509-ed", "ovs_interfaceid": "6e420509-edf8-4398-892b-ee3e4ebb450d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:3c,bridge_name='br-int',has_traffic_filtering=True,id=6e420509-edf8-4398-892b-ee3e4ebb450d,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e420509-ed') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG os_vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:3c,bridge_name='br-int',has_traffic_filtering=True,id=6e420509-edf8-4398-892b-ee3e4ebb450d,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e420509-ed') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e420509-ed, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e420509-ed, col_values=(('external_ids', {'iface-id': '6e420509-edf8-4398-892b-ee3e4ebb450d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:af:3c', 'vm-uuid': '45a40359-7496-44f6-ae86-a77f991e5106'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: INFO os_vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:3c,bridge_name='br-int',has_traffic_filtering=True,id=6e420509-edf8-4398-892b-ee3e4ebb450d,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e420509-ed')
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2097729005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2097729005',id=10,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp1K/ORVcGLeOVNZLXDddd0H6aTpPgyDEIb1ynvVxfBr7TjGEofHSas3VzHl7WfFaIdXDza1M1ImDTGGDwP0YTIFxJ4VJA2DglK20QPjpeUjMA0Iz8F+wHOKnyAmm2JQw==',key_name='tempest-keypair-852805528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e55bd6f4fa84c4da104a5a782bad7ff',ramdisk_id='',reservation_id='r-k6xe63iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-729948914',owner_user_name='tempest-TaggedBootDevicesTest-729948914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffd657fbfccc4fc2a7f58a60bcada3df',uuid=45a40359-7496-44f6-ae86-a77f991e5106,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28037956-d408-4d2b-9ea8-76dda5239b9b", "address": "fa:16:3e:3f:1c:0c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28037956-d4", "ovs_interfaceid": "28037956-d408-4d2b-9ea8-76dda5239b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converting VIF {"id": "28037956-d408-4d2b-9ea8-76dda5239b9b", "address": "fa:16:3e:3f:1c:0c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28037956-d4", "ovs_interfaceid": "28037956-d408-4d2b-9ea8-76dda5239b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:1c:0c,bridge_name='br-int',has_traffic_filtering=True,id=28037956-d408-4d2b-9ea8-76dda5239b9b,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap28037956-d4') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG os_vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:1c:0c,bridge_name='br-int',has_traffic_filtering=True,id=28037956-d408-4d2b-9ea8-76dda5239b9b,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap28037956-d4') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28037956-d4, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap28037956-d4, col_values=(('external_ids', {'iface-id': '28037956-d408-4d2b-9ea8-76dda5239b9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:1c:0c', 'vm-uuid': '45a40359-7496-44f6-ae86-a77f991e5106'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: INFO os_vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:1c:0c,bridge_name='br-int',has_traffic_filtering=True,id=28037956-d408-4d2b-9ea8-76dda5239b9b,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap28037956-d4')
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2097729005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2097729005',id=10,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp1K/ORVcGLeOVNZLXDddd0H6aTpPgyDEIb1ynvVxfBr7TjGEofHSas3VzHl7WfFaIdXDza1M1ImDTGGDwP0YTIFxJ4VJA2DglK20QPjpeUjMA0Iz8F+wHOKnyAmm2JQw==',key_name='tempest-keypair-852805528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e55bd6f4fa84c4da104a5a782bad7ff',ramdisk_id='',reservation_id='r-k6xe63iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-729948914',owner_user_name='tempest-TaggedBootDevicesTest-729948914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffd657fbfccc4fc2a7f58a60bcada3df',uuid=45a40359-7496-44f6-ae86-a77f991e5106,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "address": "fa:16:3e:c9:09:37", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3cbe0f-91", "ovs_interfaceid": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converting VIF {"id": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "address": "fa:16:3e:c9:09:37", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3cbe0f-91", "ovs_interfaceid": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:09:37,bridge_name='br-int',has_traffic_filtering=True,id=ef3cbe0f-91fd-488c-80d1-48609530c75e,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3cbe0f-91') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG os_vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:09:37,bridge_name='br-int',has_traffic_filtering=True,id=ef3cbe0f-91fd-488c-80d1-48609530c75e,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3cbe0f-91') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef3cbe0f-91, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef3cbe0f-91, col_values=(('external_ids', {'iface-id': 'ef3cbe0f-91fd-488c-80d1-48609530c75e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:09:37', 'vm-uuid': '45a40359-7496-44f6-ae86-a77f991e5106'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: INFO os_vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:09:37,bridge_name='br-int',has_traffic_filtering=True,id=ef3cbe0f-91fd-488c-80d1-48609530c75e,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3cbe0f-91')
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2097729005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2097729005',id=10,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp1K/ORVcGLeOVNZLXDddd0H6aTpPgyDEIb1ynvVxfBr7TjGEofHSas3VzHl7WfFaIdXDza1M1ImDTGGDwP0YTIFxJ4VJA2DglK20QPjpeUjMA0Iz8F+wHOKnyAmm2JQw==',key_name='tempest-keypair-852805528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e55bd6f4fa84c4da104a5a782bad7ff',ramdisk_id='',reservation_id='r-k6xe63iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-729948914',owner_user_name='tempest-TaggedBootDevicesTest-729948914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffd657fbfccc4fc2a7f58a60bcada3df',uuid=45a40359-7496-44f6-ae86-a77f991e5106,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "address": "fa:16:3e:49:dc:99", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc347a8-bb", "ovs_interfaceid": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converting VIF {"id": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "address": "fa:16:3e:49:dc:99", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc347a8-bb", "ovs_interfaceid": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:dc:99,bridge_name='br-int',has_traffic_filtering=True,id=4cc347a8-bb63-452b-a81a-eb6a87afac30,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc347a8-bb') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG os_vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:dc:99,bridge_name='br-int',has_traffic_filtering=True,id=4cc347a8-bb63-452b-a81a-eb6a87afac30,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc347a8-bb') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cc347a8-bb, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4cc347a8-bb, col_values=(('external_ids', {'iface-id': '4cc347a8-bb63-452b-a81a-eb6a87afac30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:dc:99', 'vm-uuid': '45a40359-7496-44f6-ae86-a77f991e5106'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: INFO os_vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:dc:99,bridge_name='br-int',has_traffic_filtering=True,id=4cc347a8-bb63-452b-a81a-eb6a87afac30,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc347a8-bb')
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2097729005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2097729005',id=10,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp1K/ORVcGLeOVNZLXDddd0H6aTpPgyDEIb1ynvVxfBr7TjGEofHSas3VzHl7WfFaIdXDza1M1ImDTGGDwP0YTIFxJ4VJA2DglK20QPjpeUjMA0Iz8F+wHOKnyAmm2JQw==',key_name='tempest-keypair-852805528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e55bd6f4fa84c4da104a5a782bad7ff',ramdisk_id='',reservation_id='r-k6xe63iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-729948914',owner_user_name='tempest-TaggedBootDevicesTest-729948914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffd657fbfccc4fc2a7f58a60bcada3df',uuid=45a40359-7496-44f6-ae86-a77f991e5106,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "address": "fa:16:3e:c5:f9:56", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2b6f03-3c", "ovs_interfaceid": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converting VIF {"id": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "address": "fa:16:3e:c5:f9:56", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2b6f03-3c", "ovs_interfaceid": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f9:56,bridge_name='br-int',has_traffic_filtering=True,id=8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe,network=Network(9f2eee2b-0819-45b2-bf6f-6831fa766f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e2b6f03-3c') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG os_vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f9:56,bridge_name='br-int',has_traffic_filtering=True,id=8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe,network=Network(9f2eee2b-0819-45b2-bf6f-6831fa766f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e2b6f03-3c') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e2b6f03-3c, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e2b6f03-3c, col_values=(('external_ids', {'iface-id': '8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:f9:56', 'vm-uuid': '45a40359-7496-44f6-ae86-a77f991e5106'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: INFO os_vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f9:56,bridge_name='br-int',has_traffic_filtering=True,id=8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe,network=Network(9f2eee2b-0819-45b2-bf6f-6831fa766f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e2b6f03-3c')
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2097729005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2097729005',id=10,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp1K/ORVcGLeOVNZLXDddd0H6aTpPgyDEIb1ynvVxfBr7TjGEofHSas3VzHl7WfFaIdXDza1M1ImDTGGDwP0YTIFxJ4VJA2DglK20QPjpeUjMA0Iz8F+wHOKnyAmm2JQw==',key_name='tempest-keypair-852805528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e55bd6f4fa84c4da104a5a782bad7ff',ramdisk_id='',reservation_id='r-k6xe63iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-729948914',owner_user_name='tempest-TaggedBootDevicesTest-729948914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffd657fbfccc4fc2a7f58a60bcada3df',uuid=45a40359-7496-44f6-ae86-a77f991e5106,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "address": "fa:16:3e:0f:d2:23", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3dbdee9-e9", "ovs_interfaceid": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converting VIF {"id": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "address": "fa:16:3e:0f:d2:23", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3dbdee9-e9", "ovs_interfaceid": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:d2:23,bridge_name='br-int',has_traffic_filtering=True,id=f3dbdee9-e9a5-4859-b066-ccbb35f2df30,network=Network(9f2eee2b-0819-45b2-bf6f-6831fa766f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3dbdee9-e9') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG os_vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:d2:23,bridge_name='br-int',has_traffic_filtering=True,id=f3dbdee9-e9a5-4859-b066-ccbb35f2df30,network=Network(9f2eee2b-0819-45b2-bf6f-6831fa766f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3dbdee9-e9') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3dbdee9-e9, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3dbdee9-e9, col_values=(('external_ids', {'iface-id': 'f3dbdee9-e9a5-4859-b066-ccbb35f2df30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:d2:23', 'vm-uuid': '45a40359-7496-44f6-ae86-a77f991e5106'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:21:59 user nova-compute[72201]: INFO os_vif [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:d2:23,bridge_name='br-int',has_traffic_filtering=True,id=f3dbdee9-e9a5-4859-b066-ccbb35f2df30,network=Network(9f2eee2b-0819-45b2-bf6f-6831fa766f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3dbdee9-e9')
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] No BDM found with device name hda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] No VIF found with MAC fa:16:3e:5c:9c:8c, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] No VIF found with MAC fa:16:3e:49:dc:99, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:21:59 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Using config drive
Aug 01 15:21:59 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Creating config drive at /opt/stack/data/nova/instances/45a40359-7496-44f6-ae86-a77f991e5106/disk.config
Aug 01 15:21:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/45a40359-7496-44f6-ae86-a77f991e5106/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5omvl4hx {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:21:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/45a40359-7496-44f6-ae86-a77f991e5106/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5omvl4hx" returned: 0 in 0.052s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:00 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:22:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:00 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:22:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-d053c7a5-b58c-46e9-af9f-585c041144aa req-12846d3b-ecff-4157-ab0d-36c1622027fc service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-plugged-12cc53e2-1a6d-455c-9737-dd4a14957fa0 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d053c7a5-b58c-46e9-af9f-585c041144aa req-12846d3b-ecff-4157-ab0d-36c1622027fc service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d053c7a5-b58c-46e9-af9f-585c041144aa req-12846d3b-ecff-4157-ab0d-36c1622027fc service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d053c7a5-b58c-46e9-af9f-585c041144aa req-12846d3b-ecff-4157-ab0d-36c1622027fc service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-d053c7a5-b58c-46e9-af9f-585c041144aa req-12846d3b-ecff-4157-ab0d-36c1622027fc service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-plugged-12cc53e2-1a6d-455c-9737-dd4a14957fa0 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:02 user nova-compute[72201]: WARNING nova.compute.manager [req-d053c7a5-b58c-46e9-af9f-585c041144aa req-12846d3b-ecff-4157-ab0d-36c1622027fc service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received unexpected event network-vif-plugged-12cc53e2-1a6d-455c-9737-dd4a14957fa0 for instance with vm_state building and task_state spawning.
Aug 01 15:22:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hAqZBkaF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:22:02 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:02 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:02 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a67cf1-501b-4420-890c-c837b8bed5a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:22:02 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a105ed08-427e-40a2-ac13-cce39644f9a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6] added
Aug 01 15:22:02 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0335fb58-4fbb-4973-8433-a2767fb02dab]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9281989-7c56-48d1-85e8-947e34fb4333]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hAqZBkaF {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hAqZBkaF" returned: 0 in 0.030s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8770c557-e179-4227-896a-80c60cc7bd8e]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hAqZBkaF'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.161s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c02240-00bb-4137-afcf-f7e54fa4a18b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:02 user nova-compute[72201]: INFO nova.virt.block_device [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Booting with volume 8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 at /dev/vdc
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb7bd1d-ed31-4492-9ab7-a1c82becf018]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:02 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:02 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:02 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:02 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:02 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:02 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.utils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ece0fa-0946-401d-be47-58bd5928fd4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6, portal: 172.16.0.220,3260]
Aug 01 15:22:02 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6, portal: 172.16.0.220,3260] successful.
Aug 01 15:22:02 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c757e1f2-f405-4044-90fc-6b7186171352]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-3d5de4bb-8766-4ad5-82f3-4fd76fc7ab4f req-ba792153-2e7a-4121-83e2-ae7b797fc329 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-plugged-6e420509-edf8-4398-892b-ee3e4ebb450d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3d5de4bb-8766-4ad5-82f3-4fd76fc7ab4f req-ba792153-2e7a-4121-83e2-ae7b797fc329 service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3d5de4bb-8766-4ad5-82f3-4fd76fc7ab4f req-ba792153-2e7a-4121-83e2-ae7b797fc329 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3d5de4bb-8766-4ad5-82f3-4fd76fc7ab4f req-ba792153-2e7a-4121-83e2-ae7b797fc329 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-3d5de4bb-8766-4ad5-82f3-4fd76fc7ab4f req-ba792153-2e7a-4121-83e2-ae7b797fc329 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-plugged-6e420509-edf8-4398-892b-ee3e4ebb450d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:02 user nova-compute[72201]: WARNING nova.compute.manager [req-3d5de4bb-8766-4ad5-82f3-4fd76fc7ab4f req-ba792153-2e7a-4121-83e2-ae7b797fc329 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received unexpected event network-vif-plugged-6e420509-edf8-4398-892b-ee3e4ebb450d for instance with vm_state building and task_state spawning.
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c53f0db-c7e5-43d9-8112-e93244011321]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9389d53e-a781-4ad2-a771-5c710f558f44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d4ddae-053d-4c27-b1ef-53d29b913c99]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:02 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:02 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:02 user nova-compute[72201]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 (non-flash)
Aug 01 15:22:02 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:02 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:02 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:02 user nova-compute[72201]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 (non-flash)
Aug 01 15:22:02 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.516s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09f626e-645d-4714-ac5b-77c7caeecf63]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[de45988e-36fa-429e-9595-f2084934d7c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[243f2ddd-3a75-41f6-a94a-58748428eab2]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hAqZBkaF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:22:02 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:22:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f81835-df58-4a26-9f05-ae2526439f6f]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG os_brick.utils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] <== get_connector_properties: return (191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Updating existing volume attachment record: 97d1dbd5-f107-4b3f-b0ba-6c63512f8ed7 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:22:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:03 user nova-compute[72201]: DEBUG nova.compute.manager [req-1dd5c3ba-91aa-487d-81be-5f33aa941d12 req-3dfcd479-6aad-44c9-b17c-82dfba609a32 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-plugged-28037956-d408-4d2b-9ea8-76dda5239b9b {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1dd5c3ba-91aa-487d-81be-5f33aa941d12 req-3dfcd479-6aad-44c9-b17c-82dfba609a32 service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1dd5c3ba-91aa-487d-81be-5f33aa941d12 req-3dfcd479-6aad-44c9-b17c-82dfba609a32 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1dd5c3ba-91aa-487d-81be-5f33aa941d12 req-3dfcd479-6aad-44c9-b17c-82dfba609a32 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:03 user nova-compute[72201]: DEBUG nova.compute.manager [req-1dd5c3ba-91aa-487d-81be-5f33aa941d12 req-3dfcd479-6aad-44c9-b17c-82dfba609a32 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-plugged-28037956-d408-4d2b-9ea8-76dda5239b9b {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:03 user nova-compute[72201]: WARNING nova.compute.manager [req-1dd5c3ba-91aa-487d-81be-5f33aa941d12 req-3dfcd479-6aad-44c9-b17c-82dfba609a32 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received unexpected event network-vif-plugged-28037956-d408-4d2b-9ea8-76dda5239b9b for instance with vm_state building and task_state spawning.
Aug 01 15:22:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:03 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.602s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:03 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] <== connect_volume: return (1605ms) {'type': 'block', 'scsi_wwn': '23532383439376362', 'path': '/dev/sde'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:22:03 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532383439376362', 'path': '/dev/sde'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:22:03 user nova-compute[72201]: INFO nova.compute.manager [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Rescuing
Aug 01 15:22:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "refresh_cache-0f059ccc-f609-4cf3-a644-c3d1305ae26e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:22:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquired lock "refresh_cache-0f059ccc-f609-4cf3-a644-c3d1305ae26e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:22:03 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:22:03 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lazy-loading 'flavor' on Instance uuid 54cee809-6ad0-4a16-85cd-ebf8ef683bbe {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:03 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:22:03 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:22:03 user nova-compute[72201]:   <source dev="/dev/sde"/>
Aug 01 15:22:03 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:22:03 user nova-compute[72201]:   <serial>63518989-b7e3-4b73-bb1d-daa99b9dfcc6</serial>
Aug 01 15:22:03 user nova-compute[72201]: </disk>
Aug 01 15:22:03 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-315049cd-7480-4030-b401-66e98456b137 req-9fe75ce0-96fc-4cd4-8993-b51593bf56a3 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-plugged-12cc53e2-1a6d-455c-9737-dd4a14957fa0 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-315049cd-7480-4030-b401-66e98456b137 req-9fe75ce0-96fc-4cd4-8993-b51593bf56a3 service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-315049cd-7480-4030-b401-66e98456b137 req-9fe75ce0-96fc-4cd4-8993-b51593bf56a3 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-315049cd-7480-4030-b401-66e98456b137 req-9fe75ce0-96fc-4cd4-8993-b51593bf56a3 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-315049cd-7480-4030-b401-66e98456b137 req-9fe75ce0-96fc-4cd4-8993-b51593bf56a3 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-plugged-12cc53e2-1a6d-455c-9737-dd4a14957fa0 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:04 user nova-compute[72201]: WARNING nova.compute.manager [req-315049cd-7480-4030-b401-66e98456b137 req-9fe75ce0-96fc-4cd4-8993-b51593bf56a3 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received unexpected event network-vif-plugged-12cc53e2-1a6d-455c-9737-dd4a14957fa0 for instance with vm_state building and task_state spawning.
Aug 01 15:22:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] No VIF found with MAC fa:16:3e:f4:62:2d, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Updating instance_info_cache with network_info: [{"id": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "address": "fa:16:3e:2d:e0:8c", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1fc053-fd", "ovs_interfaceid": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-b7a28e7e-b8bc-4fd1-8ff5-0332385209b1 req-bf66ab63-fd51-4af3-a8d4-3220613b3e2a service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-plugged-6e420509-edf8-4398-892b-ee3e4ebb450d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b7a28e7e-b8bc-4fd1-8ff5-0332385209b1 req-bf66ab63-fd51-4af3-a8d4-3220613b3e2a service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b7a28e7e-b8bc-4fd1-8ff5-0332385209b1 req-bf66ab63-fd51-4af3-a8d4-3220613b3e2a service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b7a28e7e-b8bc-4fd1-8ff5-0332385209b1 req-bf66ab63-fd51-4af3-a8d4-3220613b3e2a service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-b7a28e7e-b8bc-4fd1-8ff5-0332385209b1 req-bf66ab63-fd51-4af3-a8d4-3220613b3e2a service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-plugged-6e420509-edf8-4398-892b-ee3e4ebb450d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:04 user nova-compute[72201]: WARNING nova.compute.manager [req-b7a28e7e-b8bc-4fd1-8ff5-0332385209b1 req-bf66ab63-fd51-4af3-a8d4-3220613b3e2a service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received unexpected event network-vif-plugged-6e420509-edf8-4398-892b-ee3e4ebb450d for instance with vm_state building and task_state spawning.
Aug 01 15:22:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-b7a28e7e-b8bc-4fd1-8ff5-0332385209b1 req-bf66ab63-fd51-4af3-a8d4-3220613b3e2a service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-plugged-f3dbdee9-e9a5-4859-b066-ccbb35f2df30 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b7a28e7e-b8bc-4fd1-8ff5-0332385209b1 req-bf66ab63-fd51-4af3-a8d4-3220613b3e2a service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b7a28e7e-b8bc-4fd1-8ff5-0332385209b1 req-bf66ab63-fd51-4af3-a8d4-3220613b3e2a service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b7a28e7e-b8bc-4fd1-8ff5-0332385209b1 req-bf66ab63-fd51-4af3-a8d4-3220613b3e2a service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-b7a28e7e-b8bc-4fd1-8ff5-0332385209b1 req-bf66ab63-fd51-4af3-a8d4-3220613b3e2a service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-plugged-f3dbdee9-e9a5-4859-b066-ccbb35f2df30 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:04 user nova-compute[72201]: WARNING nova.compute.manager [req-b7a28e7e-b8bc-4fd1-8ff5-0332385209b1 req-bf66ab63-fd51-4af3-a8d4-3220613b3e2a service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received unexpected event network-vif-plugged-f3dbdee9-e9a5-4859-b066-ccbb35f2df30 for instance with vm_state building and task_state spawning.
Aug 01 15:22:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-b7a28e7e-b8bc-4fd1-8ff5-0332385209b1 req-bf66ab63-fd51-4af3-a8d4-3220613b3e2a service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-plugged-f3dbdee9-e9a5-4859-b066-ccbb35f2df30 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b7a28e7e-b8bc-4fd1-8ff5-0332385209b1 req-bf66ab63-fd51-4af3-a8d4-3220613b3e2a service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b7a28e7e-b8bc-4fd1-8ff5-0332385209b1 req-bf66ab63-fd51-4af3-a8d4-3220613b3e2a service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b7a28e7e-b8bc-4fd1-8ff5-0332385209b1 req-bf66ab63-fd51-4af3-a8d4-3220613b3e2a service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-b7a28e7e-b8bc-4fd1-8ff5-0332385209b1 req-bf66ab63-fd51-4af3-a8d4-3220613b3e2a service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-plugged-f3dbdee9-e9a5-4859-b066-ccbb35f2df30 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:04 user nova-compute[72201]: WARNING nova.compute.manager [req-b7a28e7e-b8bc-4fd1-8ff5-0332385209b1 req-bf66ab63-fd51-4af3-a8d4-3220613b3e2a service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received unexpected event network-vif-plugged-f3dbdee9-e9a5-4859-b066-ccbb35f2df30 for instance with vm_state building and task_state spawning.
Aug 01 15:22:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Releasing lock "refresh_cache-0f059ccc-f609-4cf3-a644-c3d1305ae26e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:22:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a50bdcc2-b415-46a5-90bc-ff0429171d1e tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.940s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-plugged-28037956-d408-4d2b-9ea8-76dda5239b9b {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-plugged-28037956-d408-4d2b-9ea8-76dda5239b9b {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:05 user nova-compute[72201]: WARNING nova.compute.manager [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received unexpected event network-vif-plugged-28037956-d408-4d2b-9ea8-76dda5239b9b for instance with vm_state building and task_state spawning.
Aug 01 15:22:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-plugged-ef3cbe0f-91fd-488c-80d1-48609530c75e {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-plugged-ef3cbe0f-91fd-488c-80d1-48609530c75e {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:05 user nova-compute[72201]: WARNING nova.compute.manager [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received unexpected event network-vif-plugged-ef3cbe0f-91fd-488c-80d1-48609530c75e for instance with vm_state building and task_state spawning.
Aug 01 15:22:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Received event network-changed-bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Refreshing instance network info cache due to event network-changed-bc611803-5aa5-4b8b-961b-cd6c43317b21. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] Acquiring lock "refresh_cache-e2ca19ea-868c-40ad-a453-f6e348cfac15" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] Acquired lock "refresh_cache-e2ca19ea-868c-40ad-a453-f6e348cfac15" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG nova.network.neutron [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Refreshing network info cache for port bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Acquiring lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Acquiring lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:05 user nova-compute[72201]: INFO nova.compute.manager [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Terminating instance
Aug 01 15:22:05 user nova-compute[72201]: DEBUG nova.compute.manager [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:22:05 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Instance destroyed successfully.
Aug 01 15:22:05 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Attempting rescue
Aug 01 15:22:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72201) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Instance directory exists: not creating {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 15:22:05 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Creating image(s)
Aug 01 15:22:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "/opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "/opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG nova.objects.instance [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0f059ccc-f609-4cf3-a644-c3d1305ae26e {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.169s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue" returned: 0 in 0.071s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.objects.instance [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'migration_context' on Instance uuid 0f059ccc-f609-4cf3-a644-c3d1305ae26e {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-a83185c9-41e2-4e76-8519-75d27ba2fb3d req-0a5829b6-95b2-4392-99e0-64cae1f3aa28 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-plugged-8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a83185c9-41e2-4e76-8519-75d27ba2fb3d req-0a5829b6-95b2-4392-99e0-64cae1f3aa28 service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a83185c9-41e2-4e76-8519-75d27ba2fb3d req-0a5829b6-95b2-4392-99e0-64cae1f3aa28 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a83185c9-41e2-4e76-8519-75d27ba2fb3d req-0a5829b6-95b2-4392-99e0-64cae1f3aa28 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-a83185c9-41e2-4e76-8519-75d27ba2fb3d req-0a5829b6-95b2-4392-99e0-64cae1f3aa28 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-plugged-8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:06 user nova-compute[72201]: WARNING nova.compute.manager [req-a83185c9-41e2-4e76-8519-75d27ba2fb3d req-0a5829b6-95b2-4392-99e0-64cae1f3aa28 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received unexpected event network-vif-plugged-8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe for instance with vm_state building and task_state spawning.
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-a83185c9-41e2-4e76-8519-75d27ba2fb3d req-0a5829b6-95b2-4392-99e0-64cae1f3aa28 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-plugged-8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a83185c9-41e2-4e76-8519-75d27ba2fb3d req-0a5829b6-95b2-4392-99e0-64cae1f3aa28 service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a83185c9-41e2-4e76-8519-75d27ba2fb3d req-0a5829b6-95b2-4392-99e0-64cae1f3aa28 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a83185c9-41e2-4e76-8519-75d27ba2fb3d req-0a5829b6-95b2-4392-99e0-64cae1f3aa28 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-a83185c9-41e2-4e76-8519-75d27ba2fb3d req-0a5829b6-95b2-4392-99e0-64cae1f3aa28 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-plugged-8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:06 user nova-compute[72201]: WARNING nova.compute.manager [req-a83185c9-41e2-4e76-8519-75d27ba2fb3d req-0a5829b6-95b2-4392-99e0-64cae1f3aa28 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received unexpected event network-vif-plugged-8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe for instance with vm_state building and task_state spawning.
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Start _get_guest_xml network_info=[{"id": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "address": "fa:16:3e:2d:e0:8c", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "vif_mac": "fa:16:3e:2d:e0:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1fc053-fd", "ovs_interfaceid": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.objects.instance [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'resources' on Instance uuid 0f059ccc-f609-4cf3-a644-c3d1305ae26e {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.objects.instance [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'numa_topology' on Instance uuid 0f059ccc-f609-4cf3-a644-c3d1305ae26e {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:06 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:22:06 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.objects.instance [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0f059ccc-f609-4cf3-a644-c3d1305ae26e {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:20:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1512947866',display_name='tempest-ServerRescueNegativeTestJSON-server-1512947866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1512947866',id=4,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:20:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f130c48f19cf4ab7803c1169b759ccb6',ramdisk_id='',reservation_id='r-oa7fpdsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-773079660',owner_user_name='tempest-ServerRescueNegativeTestJSON-773079660-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:20:29Z,user_data=None,user_id='31a432c1165e4ff4a9a10b4d71ddc513',uuid=0f059ccc-f609-4cf3-a644-c3d1305ae26e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "address": "fa:16:3e:2d:e0:8c", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "vif_mac": "fa:16:3e:2d:e0:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1fc053-fd", "ovs_interfaceid": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converting VIF {"id": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "address": "fa:16:3e:2d:e0:8c", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "vif_mac": "fa:16:3e:2d:e0:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1fc053-fd", "ovs_interfaceid": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:e0:8c,bridge_name='br-int',has_traffic_filtering=True,id=eb1fc053-fd35-4b5e-a557-4be5052de15d,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb1fc053-fd') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.objects.instance [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f059ccc-f609-4cf3-a644-c3d1305ae26e {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:22:06 user nova-compute[72201]:   <uuid>0f059ccc-f609-4cf3-a644-c3d1305ae26e</uuid>
Aug 01 15:22:06 user nova-compute[72201]:   <name>instance-00000004</name>
Aug 01 15:22:06 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:22:06 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:22:06 user nova-compute[72201]:   <metadata>
Aug 01 15:22:06 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:22:06 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:22:06 user nova-compute[72201]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1512947866</nova:name>
Aug 01 15:22:06 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:22:06</nova:creationTime>
Aug 01 15:22:06 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:22:06 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:22:06 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:22:06 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:22:06 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:22:06 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:22:06 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:22:06 user nova-compute[72201]:       <nova:owner>
Aug 01 15:22:06 user nova-compute[72201]:         <nova:user uuid="31a432c1165e4ff4a9a10b4d71ddc513">tempest-ServerRescueNegativeTestJSON-773079660-project-member</nova:user>
Aug 01 15:22:06 user nova-compute[72201]:         <nova:project uuid="f130c48f19cf4ab7803c1169b759ccb6">tempest-ServerRescueNegativeTestJSON-773079660</nova:project>
Aug 01 15:22:06 user nova-compute[72201]:       </nova:owner>
Aug 01 15:22:06 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:22:06 user nova-compute[72201]:       <nova:ports>
Aug 01 15:22:06 user nova-compute[72201]:         <nova:port uuid="eb1fc053-fd35-4b5e-a557-4be5052de15d">
Aug 01 15:22:06 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 15:22:06 user nova-compute[72201]:         </nova:port>
Aug 01 15:22:06 user nova-compute[72201]:       </nova:ports>
Aug 01 15:22:06 user nova-compute[72201]:     </nova:instance>
Aug 01 15:22:06 user nova-compute[72201]:   </metadata>
Aug 01 15:22:06 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:22:06 user nova-compute[72201]:     <system>
Aug 01 15:22:06 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:22:06 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:22:06 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:22:06 user nova-compute[72201]:       <entry name="serial">0f059ccc-f609-4cf3-a644-c3d1305ae26e</entry>
Aug 01 15:22:06 user nova-compute[72201]:       <entry name="uuid">0f059ccc-f609-4cf3-a644-c3d1305ae26e</entry>
Aug 01 15:22:06 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:22:06 user nova-compute[72201]:     </system>
Aug 01 15:22:06 user nova-compute[72201]:   </sysinfo>
Aug 01 15:22:06 user nova-compute[72201]:   <os>
Aug 01 15:22:06 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:22:06 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:22:06 user nova-compute[72201]:   </os>
Aug 01 15:22:06 user nova-compute[72201]:   <features>
Aug 01 15:22:06 user nova-compute[72201]:     <acpi/>
Aug 01 15:22:06 user nova-compute[72201]:     <apic/>
Aug 01 15:22:06 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:22:06 user nova-compute[72201]:   </features>
Aug 01 15:22:06 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:22:06 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:22:06 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:22:06 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:22:06 user nova-compute[72201]:   </clock>
Aug 01 15:22:06 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:22:06 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:22:06 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:22:06 user nova-compute[72201]:   </cpu>
Aug 01 15:22:06 user nova-compute[72201]:   <devices>
Aug 01 15:22:06 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:22:06 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:22:06 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue"/>
Aug 01 15:22:06 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:22:06 user nova-compute[72201]:     </disk>
Aug 01 15:22:06 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:22:06 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:22:06 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk"/>
Aug 01 15:22:06 user nova-compute[72201]:       <target dev="vdb" bus="virtio"/>
Aug 01 15:22:06 user nova-compute[72201]:     </disk>
Aug 01 15:22:06 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:22:06 user nova-compute[72201]:       <mac address="fa:16:3e:2d:e0:8c"/>
Aug 01 15:22:06 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:22:06 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:22:06 user nova-compute[72201]:       <target dev="tapeb1fc053-fd"/>
Aug 01 15:22:06 user nova-compute[72201]:     </interface>
Aug 01 15:22:06 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:22:06 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/console.log" append="off"/>
Aug 01 15:22:06 user nova-compute[72201]:     </serial>
Aug 01 15:22:06 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:22:06 user nova-compute[72201]:     <video>
Aug 01 15:22:06 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:22:06 user nova-compute[72201]:     </video>
Aug 01 15:22:06 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:22:06 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:22:06 user nova-compute[72201]:     </rng>
Aug 01 15:22:06 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:22:06 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:22:06 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:22:06 user nova-compute[72201]:     </memballoon>
Aug 01 15:22:06 user nova-compute[72201]:   </devices>
Aug 01 15:22:06 user nova-compute[72201]: </domain>
Aug 01 15:22:06 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:06 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Instance destroyed successfully.
Aug 01 15:22:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.network.neutron [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Updated VIF entry in instance network info cache for port bc611803-5aa5-4b8b-961b-cd6c43317b21. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.network.neutron [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Updating instance_info_cache with network_info: [{"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] Releasing lock "refresh_cache-e2ca19ea-868c-40ad-a453-f6e348cfac15" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-plugged-ef3cbe0f-91fd-488c-80d1-48609530c75e {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-plugged-ef3cbe0f-91fd-488c-80d1-48609530c75e {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:06 user nova-compute[72201]: WARNING nova.compute.manager [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received unexpected event network-vif-plugged-ef3cbe0f-91fd-488c-80d1-48609530c75e for instance with vm_state building and task_state spawning.
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-plugged-4cc347a8-bb63-452b-a81a-eb6a87afac30 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-plugged-4cc347a8-bb63-452b-a81a-eb6a87afac30 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:06 user nova-compute[72201]: WARNING nova.compute.manager [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received unexpected event network-vif-plugged-4cc347a8-bb63-452b-a81a-eb6a87afac30 for instance with vm_state building and task_state spawning.
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-plugged-4cc347a8-bb63-452b-a81a-eb6a87afac30 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-plugged-4cc347a8-bb63-452b-a81a-eb6a87afac30 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:06 user nova-compute[72201]: WARNING nova.compute.manager [req-e68a3486-2f65-41c3-a2e1-0852b74c3001 req-b448c571-4603-4e78-ba81-cdf133d92bf6 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received unexpected event network-vif-plugged-4cc347a8-bb63-452b-a81a-eb6a87afac30 for instance with vm_state building and task_state spawning.
Aug 01 15:22:06 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Instance destroyed successfully.
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.objects.instance [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lazy-loading 'resources' on Instance uuid 54cee809-6ad0-4a16-85cd-ebf8ef683bbe {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:19:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-901535866',display_name='tempest-DeleteServersTestJSON-server-901535866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-901535866',id=1,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:20:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4d83c3cd9b64a3d8cb45c3f0d0fb02b',ramdisk_id='',reservation_id='r-7jj7zris',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-565141156',owner_user_name='tempest-DeleteServersTestJSON-565141156-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:20:18Z,user_data=None,user_id='20231bd439f44da69e66c8c467114f0b',uuid=54cee809-6ad0-4a16-85cd-ebf8ef683bbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3a09866-55a9-407c-b2d9-7883a411a246", "address": "fa:16:3e:f4:62:2d", "network": {"id": "c773bb9f-5601-48bd-9c67-638c0380bb5b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-340882723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4d83c3cd9b64a3d8cb45c3f0d0fb02b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a09866-55", "ovs_interfaceid": "c3a09866-55a9-407c-b2d9-7883a411a246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Converting VIF {"id": "c3a09866-55a9-407c-b2d9-7883a411a246", "address": "fa:16:3e:f4:62:2d", "network": {"id": "c773bb9f-5601-48bd-9c67-638c0380bb5b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-340882723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4d83c3cd9b64a3d8cb45c3f0d0fb02b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a09866-55", "ovs_interfaceid": "c3a09866-55a9-407c-b2d9-7883a411a246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:62:2d,bridge_name='br-int',has_traffic_filtering=True,id=c3a09866-55a9-407c-b2d9-7883a411a246,network=Network(c773bb9f-5601-48bd-9c67-638c0380bb5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a09866-55') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG os_vif [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:62:2d,bridge_name='br-int',has_traffic_filtering=True,id=c3a09866-55a9-407c-b2d9-7883a411a246,network=Network(c773bb9f-5601-48bd-9c67-638c0380bb5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a09866-55') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3a09866-55, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] No VIF found with MAC fa:16:3e:2d:e0:8c, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:22:06 user nova-compute[72201]: INFO os_vif [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:62:2d,bridge_name='br-int',has_traffic_filtering=True,id=c3a09866-55a9-407c-b2d9-7883a411a246,network=Network(c773bb9f-5601-48bd-9c67-638c0380bb5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a09866-55')
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hAqZBkaF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:22:06 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-9fedb302-76dc-4285-bcb0-2f40a017e751 req-1657a42c-8f14-4972-a3f2-db66072b3d6d service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Received event network-vif-unplugged-eb1fc053-fd35-4b5e-a557-4be5052de15d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9fedb302-76dc-4285-bcb0-2f40a017e751 req-1657a42c-8f14-4972-a3f2-db66072b3d6d service nova] Acquiring lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9fedb302-76dc-4285-bcb0-2f40a017e751 req-1657a42c-8f14-4972-a3f2-db66072b3d6d service nova] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9fedb302-76dc-4285-bcb0-2f40a017e751 req-1657a42c-8f14-4972-a3f2-db66072b3d6d service nova] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-9fedb302-76dc-4285-bcb0-2f40a017e751 req-1657a42c-8f14-4972-a3f2-db66072b3d6d service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] No waiting events found dispatching network-vif-unplugged-eb1fc053-fd35-4b5e-a557-4be5052de15d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:06 user nova-compute[72201]: WARNING nova.compute.manager [req-9fedb302-76dc-4285-bcb0-2f40a017e751 req-1657a42c-8f14-4972-a3f2-db66072b3d6d service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Received unexpected event network-vif-unplugged-eb1fc053-fd35-4b5e-a557-4be5052de15d for instance with vm_state active and task_state rescuing.
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-9fedb302-76dc-4285-bcb0-2f40a017e751 req-1657a42c-8f14-4972-a3f2-db66072b3d6d service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Received event network-vif-plugged-eb1fc053-fd35-4b5e-a557-4be5052de15d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9fedb302-76dc-4285-bcb0-2f40a017e751 req-1657a42c-8f14-4972-a3f2-db66072b3d6d service nova] Acquiring lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9fedb302-76dc-4285-bcb0-2f40a017e751 req-1657a42c-8f14-4972-a3f2-db66072b3d6d service nova] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9fedb302-76dc-4285-bcb0-2f40a017e751 req-1657a42c-8f14-4972-a3f2-db66072b3d6d service nova] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-9fedb302-76dc-4285-bcb0-2f40a017e751 req-1657a42c-8f14-4972-a3f2-db66072b3d6d service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] No waiting events found dispatching network-vif-plugged-eb1fc053-fd35-4b5e-a557-4be5052de15d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:06 user nova-compute[72201]: WARNING nova.compute.manager [req-9fedb302-76dc-4285-bcb0-2f40a017e751 req-1657a42c-8f14-4972-a3f2-db66072b3d6d service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Received unexpected event network-vif-plugged-eb1fc053-fd35-4b5e-a557-4be5052de15d for instance with vm_state active and task_state rescuing.
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aae4f03-1c95-4c45-a298-11a409f9df35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e80c42-7b6e-499c-999b-ee382694d438]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:06 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:06 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:06 user nova-compute[72201]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 (non-flash)
Aug 01 15:22:06 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:06 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:06 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:06 user nova-compute[72201]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 (non-flash)
Aug 01 15:22:06 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc54418add0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6'): ({'sde'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Removing single pathed devices sde {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[801ee939-cd3f-4f79-8aaa-5ed1341a430c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d3b460-8e1f-410b-9af8-533fbd9efef2]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Flushing IO for device /dev/sde {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d8d628-0134-401d-b9b4-9f68d6ae67cf]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b1d1a2-66f9-4752-809a-fa46b26011d6]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] SCSI volumes sde have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef19a95-9826-4309-861e-93c516d18025]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdc42d5-1e52-4f7b-a0ea-e5963b01bce6]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6, portal: 172.16.0.220,3260]
Aug 01 15:22:07 user nova-compute[72201]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6, portal: 172.16.0.220,3260] successful.
Aug 01 15:22:07 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63518989-b7e3-4b73-bb1d-daa99b9dfcc6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff98da1-fad5-4b75-a7de-27b7782be907]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] <== disconnect_volume: return (339ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:22:07 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Deleting instance files /opt/stack/data/nova/instances/54cee809-6ad0-4a16-85cd-ebf8ef683bbe_del
Aug 01 15:22:07 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Deletion of /opt/stack/data/nova/instances/54cee809-6ad0-4a16-85cd-ebf8ef683bbe_del complete
Aug 01 15:22:07 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903327.2502136, 45a40359-7496-44f6-ae86-a77f991e5106 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:22:07 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] VM Resumed (Lifecycle Event)
Aug 01 15:22:07 user nova-compute[72201]: DEBUG nova.compute.manager [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:22:07 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Instance spawned successfully.
Aug 01 15:22:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:22:07 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:22:07 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903327.2538574, 45a40359-7496-44f6-ae86-a77f991e5106 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:22:07 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] VM Started (Lifecycle Event)
Aug 01 15:22:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72201) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 01 15:22:07 user nova-compute[72201]: INFO nova.virt.libvirt.host [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] UEFI support detected
Aug 01 15:22:07 user nova-compute[72201]: INFO nova.compute.manager [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Took 1.50 seconds to destroy the instance on the hypervisor.
Aug 01 15:22:07 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:22:07 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:22:07 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:22:07 user nova-compute[72201]: INFO nova.compute.manager [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Took 12.65 seconds to spawn the instance on the hypervisor.
Aug 01 15:22:07 user nova-compute[72201]: DEBUG nova.compute.manager [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:22:07 user nova-compute[72201]: INFO nova.compute.manager [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Took 41.19 seconds to build instance.
Aug 01 15:22:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-12211f59-26fb-4d5b-b6df-a35c640ce352 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "45a40359-7496-44f6-ae86-a77f991e5106" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.309s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:08 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:22:08 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Took 0.80 seconds to deallocate network for instance.
Aug 01 15:22:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:08 user nova-compute[72201]: DEBUG nova.compute.manager [req-a7cad695-3d7c-4861-8a4b-7f7201f3ac5e req-10a9a246-413c-452c-8dea-18039610140e service nova] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Received event network-vif-unplugged-c3a09866-55a9-407c-b2d9-7883a411a246 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a7cad695-3d7c-4861-8a4b-7f7201f3ac5e req-10a9a246-413c-452c-8dea-18039610140e service nova] Acquiring lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a7cad695-3d7c-4861-8a4b-7f7201f3ac5e req-10a9a246-413c-452c-8dea-18039610140e service nova] Lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a7cad695-3d7c-4861-8a4b-7f7201f3ac5e req-10a9a246-413c-452c-8dea-18039610140e service nova] Lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:08 user nova-compute[72201]: DEBUG nova.compute.manager [req-a7cad695-3d7c-4861-8a4b-7f7201f3ac5e req-10a9a246-413c-452c-8dea-18039610140e service nova] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] No waiting events found dispatching network-vif-unplugged-c3a09866-55a9-407c-b2d9-7883a411a246 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:08 user nova-compute[72201]: DEBUG nova.compute.manager [req-a7cad695-3d7c-4861-8a4b-7f7201f3ac5e req-10a9a246-413c-452c-8dea-18039610140e service nova] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Received event network-vif-unplugged-c3a09866-55a9-407c-b2d9-7883a411a246 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:22:08 user nova-compute[72201]: DEBUG nova.compute.manager [req-a7cad695-3d7c-4861-8a4b-7f7201f3ac5e req-10a9a246-413c-452c-8dea-18039610140e service nova] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Received event network-vif-plugged-c3a09866-55a9-407c-b2d9-7883a411a246 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a7cad695-3d7c-4861-8a4b-7f7201f3ac5e req-10a9a246-413c-452c-8dea-18039610140e service nova] Acquiring lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a7cad695-3d7c-4861-8a4b-7f7201f3ac5e req-10a9a246-413c-452c-8dea-18039610140e service nova] Lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a7cad695-3d7c-4861-8a4b-7f7201f3ac5e req-10a9a246-413c-452c-8dea-18039610140e service nova] Lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:08 user nova-compute[72201]: DEBUG nova.compute.manager [req-a7cad695-3d7c-4861-8a4b-7f7201f3ac5e req-10a9a246-413c-452c-8dea-18039610140e service nova] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] No waiting events found dispatching network-vif-plugged-c3a09866-55a9-407c-b2d9-7883a411a246 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:08 user nova-compute[72201]: WARNING nova.compute.manager [req-a7cad695-3d7c-4861-8a4b-7f7201f3ac5e req-10a9a246-413c-452c-8dea-18039610140e service nova] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Received unexpected event network-vif-plugged-c3a09866-55a9-407c-b2d9-7883a411a246 for instance with vm_state active and task_state deleting.
Aug 01 15:22:08 user nova-compute[72201]: DEBUG nova.compute.manager [req-a7cad695-3d7c-4861-8a4b-7f7201f3ac5e req-10a9a246-413c-452c-8dea-18039610140e service nova] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Received event network-vif-deleted-c3a09866-55a9-407c-b2d9-7883a411a246 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:08 user nova-compute[72201]: INFO nova.compute.manager [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Took 0.79 seconds to detach 1 volumes for instance.
Aug 01 15:22:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-b847e5ef-b598-4317-b881-b06f33969f0c req-2aa43a9d-274f-4642-89e2-2a29ad07d52c service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Received event network-vif-plugged-eb1fc053-fd35-4b5e-a557-4be5052de15d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b847e5ef-b598-4317-b881-b06f33969f0c req-2aa43a9d-274f-4642-89e2-2a29ad07d52c service nova] Acquiring lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b847e5ef-b598-4317-b881-b06f33969f0c req-2aa43a9d-274f-4642-89e2-2a29ad07d52c service nova] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b847e5ef-b598-4317-b881-b06f33969f0c req-2aa43a9d-274f-4642-89e2-2a29ad07d52c service nova] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-b847e5ef-b598-4317-b881-b06f33969f0c req-2aa43a9d-274f-4642-89e2-2a29ad07d52c service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] No waiting events found dispatching network-vif-plugged-eb1fc053-fd35-4b5e-a557-4be5052de15d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:09 user nova-compute[72201]: WARNING nova.compute.manager [req-b847e5ef-b598-4317-b881-b06f33969f0c req-2aa43a9d-274f-4642-89e2-2a29ad07d52c service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Received unexpected event network-vif-plugged-eb1fc053-fd35-4b5e-a557-4be5052de15d for instance with vm_state active and task_state rescuing.
Aug 01 15:22:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-b847e5ef-b598-4317-b881-b06f33969f0c req-2aa43a9d-274f-4642-89e2-2a29ad07d52c service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Received event network-vif-plugged-eb1fc053-fd35-4b5e-a557-4be5052de15d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b847e5ef-b598-4317-b881-b06f33969f0c req-2aa43a9d-274f-4642-89e2-2a29ad07d52c service nova] Acquiring lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b847e5ef-b598-4317-b881-b06f33969f0c req-2aa43a9d-274f-4642-89e2-2a29ad07d52c service nova] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b847e5ef-b598-4317-b881-b06f33969f0c req-2aa43a9d-274f-4642-89e2-2a29ad07d52c service nova] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-b847e5ef-b598-4317-b881-b06f33969f0c req-2aa43a9d-274f-4642-89e2-2a29ad07d52c service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] No waiting events found dispatching network-vif-plugged-eb1fc053-fd35-4b5e-a557-4be5052de15d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:09 user nova-compute[72201]: WARNING nova.compute.manager [req-b847e5ef-b598-4317-b881-b06f33969f0c req-2aa43a9d-274f-4642-89e2-2a29ad07d52c service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Received unexpected event network-vif-plugged-eb1fc053-fd35-4b5e-a557-4be5052de15d for instance with vm_state active and task_state rescuing.
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.501s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:09 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Deleted allocations for instance 54cee809-6ad0-4a16-85cd-ebf8ef683bbe
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1022c094-5d3b-4ecb-a87d-d70477e3f6f9 tempest-DeleteServersTestJSON-565141156 tempest-DeleteServersTestJSON-565141156-project-member] Lock "54cee809-6ad0-4a16-85cd-ebf8ef683bbe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.927s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Removed pending event for 0f059ccc-f609-4cf3-a644-c3d1305ae26e due to event {{(pid=72201) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903330.5307412, 0f059ccc-f609-4cf3-a644-c3d1305ae26e => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:22:10 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] VM Resumed (Lifecycle Event)
Aug 01 15:22:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6b42b918-0255-4f92-a849-9187a71c45b6 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:22:10 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 15:22:10 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903330.5352263, 0f059ccc-f609-4cf3-a644-c3d1305ae26e => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:22:10 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] VM Started (Lifecycle Event)
Aug 01 15:22:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:22:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:12 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:22:12 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=6904MB free_disk=25.562088012695312GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:22:12 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Creating image(s)
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Did not create local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Ensure instance console log exists: /opt/stack/data/nova/instances/d86ed500-ec1a-4e2c-a137-7a654ada6e11/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Start _get_guest_xml network_info=[{"id": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "address": "fa:16:3e:43:cd:e6", "network": {"id": "43b87e91-7bb8-432c-abc5-9821f28350ef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-494863642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6a1011-f0", "ovs_interfaceid": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "address": "fa:16:3e:e9:aa:f5", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bdcebc-0f", "ovs_interfaceid": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5eec44e9-3963-454e-931c-4f5a94548672", "address": "fa:16:3e:9c:5a:6f", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eec44e9-39", "ovs_interfaceid": "5eec44e9-3963-454e-931c-4f5a94548672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "52014d35-b37b-41ec-ab07-1ec05db59785", "address": "fa:16:3e:f0:e7:fb", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52014d35-b3", "ovs_interfaceid": "52014d35-b37b-41ec-ab07-1ec05db59785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "892001ed-6dfd-4e71-baa0-dae05528700d", "address": "fa:16:3e:59:ec:7a", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892001ed-6d", "ovs_interfaceid": "892001ed-6dfd-4e71-baa0-dae05528700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "babde51a-fce1-4954-8aa6-2e3715330cf0", "address": "fa:16:3e:41:5d:45", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabde51a-fc", "ovs_interfaceid": "babde51a-fce1-4954-8aa6-2e3715330cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "address": "fa:16:3e:bd:98:53", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c3087dd-d4", "ovs_interfaceid": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgUmnNhF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd86ed500-ec1a-4e2c-a137-7a654ada6e11', 'attached_at': '', 'detached_at': '', 'volume_id': '01356eec-0a71-4aad-94bf-ac863bf85d00', 'serial': '01356eec-0a71-4aad-94bf-ac863bf85d00'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'ee25c2a8-2903-4bcb-98b0-1d0ffc293330', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lHhYXNDx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd86ed500-ec1a-4e2c-a137-7a654ada6e11', 'attached_at': '', 'detached_at': '', 'volume_id': 'c452cc06-1e64-4257-8ee5-7f75f4ead5c9', 'serial': 'c452cc06-1e64-4257-8ee5-7f75f4ead5c9'}, 'guest_format': None, 'boot_index': 1, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'ffdb0e91-4797-48a4-b55c-d96f4fe5c897', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXAvBuit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd86ed500-ec1a-4e2c-a137-7a654ada6e11', 'attached_at': '', 'detached_at': '', 'volume_id': '8043bb3d-5c99-4f42-9fa7-8bc0d09ac545', 'serial': '8043bb3d-5c99-4f42-9fa7-8bc0d09ac545'}, 'guest_format': None, 'boot_index': 2, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '97d1dbd5-f107-4b3f-b0ba-6c63512f8ed7', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance b64f1cfb-64f2-4493-8721-fc63fcd93bb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e2ca19ea-868c-40ad-a453-f6e348cfac15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 0f059ccc-f609-4cf3-a644-c3d1305ae26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance cb684e00-1740-402d-b3c5-c14eaf7e8054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 02d227b0-2b25-467f-a318-ab46aa391a31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e2846f03-5074-495b-831f-734dd477dc18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance c918ea78-9bf8-421c-9a31-0da4104cd032 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 0331ddd6-3aa1-47df-b1a3-4d539d26c708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 45a40359-7496-44f6-ae86-a77f991e5106 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 44cde39a-a94b-4fd8-8747-def0a68d77df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance d86ed500-ec1a-4e2c-a137-7a654ada6e11 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 3e869e37-c921-48e3-b89a-946bbcc1a5ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:22:12 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:22:12 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:22:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgUmnNhF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:22:13 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:13 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:13 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[12372c73-161c-49f4-9de2-28a69aa81bb3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:22:13 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a956a7-0b08-4077-93df-0381fad771f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00] added
Aug 01 15:22:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[231e89aa-49ff-46dc-9b7f-8741a4e623e1]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7260bd9d-190c-422e-9337-226c0517a265]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rgUmnNhF {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rgUmnNhF" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[92beb22d-12f0-4c5e-81f5-195faa7de2f9]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rgUmnNhF'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dd1ce4-b6c2-4370-b2db-185e2b25f2d1]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4a8542-44db-4381-a7a1-befa1ba36e92]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:13 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:13 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:13 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:13 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff06a58-97de-4ae1-8031-c883800ff1f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00, portal: 172.16.0.220,3260]
Aug 01 15:22:13 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00, portal: 172.16.0.220,3260] successful.
Aug 01 15:22:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb1972c-6ff2-4822-8c08-19cd83a18696]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af04496-f841-4e56-82ea-9d08d8315b7d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:13 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:13 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:13 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:13 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:13 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:13 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec344f0-0845-4861-84e3-706b39528f79]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgUmnNhF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:22:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.676s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26138626338363338', 'path': '/dev/sde'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138626338363338', 'path': '/dev/sde'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lHhYXNDx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:22:14 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:14 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:14 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e670927-b9eb-4bc3-9328-ceb5e26f0b6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:22:14 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5361b2-3e81-4b1b-836c-8a45b2a515ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9] added
Aug 01 15:22:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2faa2b-f0ef-4525-b6ff-d4516b5cfa37]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5727c9d9-b08e-4246-8398-056773d104e8]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lHhYXNDx {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lHhYXNDx" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b76d64-d764-44d2-b756-521c583dd364]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lHhYXNDx'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ece674-5662-4f10-9897-4a1c23f66ba2]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e794aba0-1740-409b-902f-9466a22c9f44]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:14 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:14 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:14 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:14 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:14 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:14 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae7a6d0-0431-4156-a334-7b14ecb837c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9, portal: 172.16.0.220,3260]
Aug 01 15:22:14 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9, portal: 172.16.0.220,3260] successful.
Aug 01 15:22:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fbb92f-2d88-4579-b2da-03b33cad76a9]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03031d8-a451-42fc-bc01-f7e57cc14613]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:14 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:14 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:14 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:14 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:14 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:14 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:14 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:14 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73d0ae6-c6b8-4458-b037-c0cf00329a00]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:22:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lHhYXNDx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26235383039383437', 'path': '/dev/sdf'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235383039383437', 'path': '/dev/sdf'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXAvBuit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:22:15 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:15 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:15 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1252216d-b069-4011-ac44-90ebd1eaf8ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:22:15 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[54469fc3-2087-4108-b1a1-1d76710f03ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545] added
Aug 01 15:22:15 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d840bc5-2cd5-49a4-a082-d4a4f6535ac1]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcaf52d-53d5-493c-bd30-17cff3e20dee]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IXAvBuit {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IXAvBuit" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb9b4a8-dca6-48ee-95fd-70e65eb5fe33]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IXAvBuit'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[377d9d78-be98-4dfe-a6e2-e2e66245e099]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9860fcc-054c-434a-baff-0b91bfdd301f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:15 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:15 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:15 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:15 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:15 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:15 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:15 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:15 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:15 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:15 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03b5ff3-c5b3-4329-88c9-3e33bdb44d7f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545, portal: 172.16.0.220,3260]
Aug 01 15:22:16 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545, portal: 172.16.0.220,3260] successful.
Aug 01 15:22:16 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[600a9837-d86f-4a27-8ee3-e5ab2a92579a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[57349f07-be90-496c-b644-dff134ca748b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:16 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:16 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:16 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:16 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:16 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:16 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:16 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:16 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:16 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:16 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:16 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:16 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff3b428-9674-4484-88be-34795590360a]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXAvBuit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:22:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23838616266346233', 'path': '/dev/sdg'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838616266346233', 'path': '/dev/sdg'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768097343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768097343',id=12,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgbXmP8E15q/2hc/sGGZZBtyKuuqNtJdk8Iq/aT7Y+eOcUaZn3yzcvDKh1GBxnTbvzsaqHqnI8TS1PZHT0WQ3lAxYtOiZyiWfRylI4pBb6s6CN+8bL4bsjkBNc38pPNRQ==',key_name='tempest-keypair-335494459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce0072ae6c74c3997ea40225a876c68',ramdisk_id='',reservation_id='r-temo3w1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1828701596',owner_user_name='tempest-TaggedBootDevicesTest_v242-1828701596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b68ccc67f5401b87a5951bde152dc5',uuid=d86ed500-ec1a-4e2c-a137-7a654ada6e11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "address": "fa:16:3e:43:cd:e6", "network": {"id": "43b87e91-7bb8-432c-abc5-9821f28350ef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-494863642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6a1011-f0", "ovs_interfaceid": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converting VIF {"id": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "address": "fa:16:3e:43:cd:e6", "network": {"id": "43b87e91-7bb8-432c-abc5-9821f28350ef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-494863642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6a1011-f0", "ovs_interfaceid": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:cd:e6,bridge_name='br-int',has_traffic_filtering=True,id=5c6a1011-f0c2-4d1b-8559-116d9b15bdd8,network=Network(43b87e91-7bb8-432c-abc5-9821f28350ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6a1011-f0') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768097343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768097343',id=12,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgbXmP8E15q/2hc/sGGZZBtyKuuqNtJdk8Iq/aT7Y+eOcUaZn3yzcvDKh1GBxnTbvzsaqHqnI8TS1PZHT0WQ3lAxYtOiZyiWfRylI4pBb6s6CN+8bL4bsjkBNc38pPNRQ==',key_name='tempest-keypair-335494459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce0072ae6c74c3997ea40225a876c68',ramdisk_id='',reservation_id='r-temo3w1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1828701596',owner_user_name='tempest-TaggedBootDevicesTest_v242-1828701596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b68ccc67f5401b87a5951bde152dc5',uuid=d86ed500-ec1a-4e2c-a137-7a654ada6e11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "address": "fa:16:3e:e9:aa:f5", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bdcebc-0f", "ovs_interfaceid": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converting VIF {"id": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "address": "fa:16:3e:e9:aa:f5", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bdcebc-0f", "ovs_interfaceid": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:aa:f5,bridge_name='br-int',has_traffic_filtering=True,id=b3bdcebc-0ff7-45e1-995e-790d24bc580f,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3bdcebc-0f') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768097343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768097343',id=12,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgbXmP8E15q/2hc/sGGZZBtyKuuqNtJdk8Iq/aT7Y+eOcUaZn3yzcvDKh1GBxnTbvzsaqHqnI8TS1PZHT0WQ3lAxYtOiZyiWfRylI4pBb6s6CN+8bL4bsjkBNc38pPNRQ==',key_name='tempest-keypair-335494459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce0072ae6c74c3997ea40225a876c68',ramdisk_id='',reservation_id='r-temo3w1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1828701596',owner_user_name='tempest-TaggedBootDevicesTest_v242-1828701596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b68ccc67f5401b87a5951bde152dc5',uuid=d86ed500-ec1a-4e2c-a137-7a654ada6e11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5eec44e9-3963-454e-931c-4f5a94548672", "address": "fa:16:3e:9c:5a:6f", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eec44e9-39", "ovs_interfaceid": "5eec44e9-3963-454e-931c-4f5a94548672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converting VIF {"id": "5eec44e9-3963-454e-931c-4f5a94548672", "address": "fa:16:3e:9c:5a:6f", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eec44e9-39", "ovs_interfaceid": "5eec44e9-3963-454e-931c-4f5a94548672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:5a:6f,bridge_name='br-int',has_traffic_filtering=True,id=5eec44e9-3963-454e-931c-4f5a94548672,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5eec44e9-39') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768097343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768097343',id=12,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgbXmP8E15q/2hc/sGGZZBtyKuuqNtJdk8Iq/aT7Y+eOcUaZn3yzcvDKh1GBxnTbvzsaqHqnI8TS1PZHT0WQ3lAxYtOiZyiWfRylI4pBb6s6CN+8bL4bsjkBNc38pPNRQ==',key_name='tempest-keypair-335494459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce0072ae6c74c3997ea40225a876c68',ramdisk_id='',reservation_id='r-temo3w1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1828701596',owner_user_name='tempest-TaggedBootDevicesTest_v242-1828701596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b68ccc67f5401b87a5951bde152dc5',uuid=d86ed500-ec1a-4e2c-a137-7a654ada6e11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52014d35-b37b-41ec-ab07-1ec05db59785", "address": "fa:16:3e:f0:e7:fb", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52014d35-b3", "ovs_interfaceid": "52014d35-b37b-41ec-ab07-1ec05db59785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converting VIF {"id": "52014d35-b37b-41ec-ab07-1ec05db59785", "address": "fa:16:3e:f0:e7:fb", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52014d35-b3", "ovs_interfaceid": "52014d35-b37b-41ec-ab07-1ec05db59785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e7:fb,bridge_name='br-int',has_traffic_filtering=True,id=52014d35-b37b-41ec-ab07-1ec05db59785,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52014d35-b3') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768097343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768097343',id=12,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgbXmP8E15q/2hc/sGGZZBtyKuuqNtJdk8Iq/aT7Y+eOcUaZn3yzcvDKh1GBxnTbvzsaqHqnI8TS1PZHT0WQ3lAxYtOiZyiWfRylI4pBb6s6CN+8bL4bsjkBNc38pPNRQ==',key_name='tempest-keypair-335494459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce0072ae6c74c3997ea40225a876c68',ramdisk_id='',reservation_id='r-temo3w1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1828701596',owner_user_name='tempest-TaggedBootDevicesTest_v242-1828701596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b68ccc67f5401b87a5951bde152dc5',uuid=d86ed500-ec1a-4e2c-a137-7a654ada6e11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "892001ed-6dfd-4e71-baa0-dae05528700d", "address": "fa:16:3e:59:ec:7a", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892001ed-6d", "ovs_interfaceid": "892001ed-6dfd-4e71-baa0-dae05528700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converting VIF {"id": "892001ed-6dfd-4e71-baa0-dae05528700d", "address": "fa:16:3e:59:ec:7a", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892001ed-6d", "ovs_interfaceid": "892001ed-6dfd-4e71-baa0-dae05528700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:ec:7a,bridge_name='br-int',has_traffic_filtering=True,id=892001ed-6dfd-4e71-baa0-dae05528700d,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap892001ed-6d') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768097343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768097343',id=12,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgbXmP8E15q/2hc/sGGZZBtyKuuqNtJdk8Iq/aT7Y+eOcUaZn3yzcvDKh1GBxnTbvzsaqHqnI8TS1PZHT0WQ3lAxYtOiZyiWfRylI4pBb6s6CN+8bL4bsjkBNc38pPNRQ==',key_name='tempest-keypair-335494459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce0072ae6c74c3997ea40225a876c68',ramdisk_id='',reservation_id='r-temo3w1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1828701596',owner_user_name='tempest-TaggedBootDevicesTest_v242-1828701596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b68ccc67f5401b87a5951bde152dc5',uuid=d86ed500-ec1a-4e2c-a137-7a654ada6e11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "babde51a-fce1-4954-8aa6-2e3715330cf0", "address": "fa:16:3e:41:5d:45", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabde51a-fc", "ovs_interfaceid": "babde51a-fce1-4954-8aa6-2e3715330cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converting VIF {"id": "babde51a-fce1-4954-8aa6-2e3715330cf0", "address": "fa:16:3e:41:5d:45", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabde51a-fc", "ovs_interfaceid": "babde51a-fce1-4954-8aa6-2e3715330cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:5d:45,bridge_name='br-int',has_traffic_filtering=True,id=babde51a-fce1-4954-8aa6-2e3715330cf0,network=Network(163285c6-73ff-4004-80ac-264355f256c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbabde51a-fc') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768097343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768097343',id=12,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgbXmP8E15q/2hc/sGGZZBtyKuuqNtJdk8Iq/aT7Y+eOcUaZn3yzcvDKh1GBxnTbvzsaqHqnI8TS1PZHT0WQ3lAxYtOiZyiWfRylI4pBb6s6CN+8bL4bsjkBNc38pPNRQ==',key_name='tempest-keypair-335494459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce0072ae6c74c3997ea40225a876c68',ramdisk_id='',reservation_id='r-temo3w1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1828701596',owner_user_name='tempest-TaggedBootDevicesTest_v242-1828701596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b68ccc67f5401b87a5951bde152dc5',uuid=d86ed500-ec1a-4e2c-a137-7a654ada6e11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "address": "fa:16:3e:bd:98:53", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c3087dd-d4", "ovs_interfaceid": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converting VIF {"id": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "address": "fa:16:3e:bd:98:53", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c3087dd-d4", "ovs_interfaceid": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:98:53,bridge_name='br-int',has_traffic_filtering=True,id=5c3087dd-d4fb-4ec6-8ae3-7a90993941ae,network=Network(163285c6-73ff-4004-80ac-264355f256c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c3087dd-d4') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lazy-loading 'pci_devices' on Instance uuid d86ed500-ec1a-4e2c-a137-7a654ada6e11 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:22:17 user nova-compute[72201]:   <uuid>d86ed500-ec1a-4e2c-a137-7a654ada6e11</uuid>
Aug 01 15:22:17 user nova-compute[72201]:   <name>instance-0000000c</name>
Aug 01 15:22:17 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:22:17 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:22:17 user nova-compute[72201]:   <metadata>
Aug 01 15:22:17 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:22:17 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:22:17 user nova-compute[72201]:       <nova:name>tempest-device-tagging-server-1768097343</nova:name>
Aug 01 15:22:17 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:22:12</nova:creationTime>
Aug 01 15:22:17 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:22:17 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:22:17 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:22:17 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:22:17 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:22:17 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:22:17 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:22:17 user nova-compute[72201]:       <nova:owner>
Aug 01 15:22:17 user nova-compute[72201]:         <nova:user uuid="b7b68ccc67f5401b87a5951bde152dc5">tempest-TaggedBootDevicesTest_v242-1828701596-project-member</nova:user>
Aug 01 15:22:17 user nova-compute[72201]:         <nova:project uuid="fce0072ae6c74c3997ea40225a876c68">tempest-TaggedBootDevicesTest_v242-1828701596</nova:project>
Aug 01 15:22:17 user nova-compute[72201]:       </nova:owner>
Aug 01 15:22:17 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:22:17 user nova-compute[72201]:       <nova:ports>
Aug 01 15:22:17 user nova-compute[72201]:         <nova:port uuid="5c6a1011-f0c2-4d1b-8559-116d9b15bdd8">
Aug 01 15:22:17 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 15:22:17 user nova-compute[72201]:         </nova:port>
Aug 01 15:22:17 user nova-compute[72201]:         <nova:port uuid="b3bdcebc-0ff7-45e1-995e-790d24bc580f">
Aug 01 15:22:17 user nova-compute[72201]:           <nova:ip type="fixed" address="10.1.1.41" ipVersion="4"/>
Aug 01 15:22:17 user nova-compute[72201]:         </nova:port>
Aug 01 15:22:17 user nova-compute[72201]:         <nova:port uuid="5eec44e9-3963-454e-931c-4f5a94548672">
Aug 01 15:22:17 user nova-compute[72201]:           <nova:ip type="fixed" address="10.1.1.248" ipVersion="4"/>
Aug 01 15:22:17 user nova-compute[72201]:         </nova:port>
Aug 01 15:22:17 user nova-compute[72201]:         <nova:port uuid="52014d35-b37b-41ec-ab07-1ec05db59785">
Aug 01 15:22:17 user nova-compute[72201]:           <nova:ip type="fixed" address="10.1.1.120" ipVersion="4"/>
Aug 01 15:22:17 user nova-compute[72201]:         </nova:port>
Aug 01 15:22:17 user nova-compute[72201]:         <nova:port uuid="892001ed-6dfd-4e71-baa0-dae05528700d">
Aug 01 15:22:17 user nova-compute[72201]:           <nova:ip type="fixed" address="10.1.1.22" ipVersion="4"/>
Aug 01 15:22:17 user nova-compute[72201]:         </nova:port>
Aug 01 15:22:17 user nova-compute[72201]:         <nova:port uuid="babde51a-fce1-4954-8aa6-2e3715330cf0">
Aug 01 15:22:17 user nova-compute[72201]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 01 15:22:17 user nova-compute[72201]:         </nova:port>
Aug 01 15:22:17 user nova-compute[72201]:         <nova:port uuid="5c3087dd-d4fb-4ec6-8ae3-7a90993941ae">
Aug 01 15:22:17 user nova-compute[72201]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 01 15:22:17 user nova-compute[72201]:         </nova:port>
Aug 01 15:22:17 user nova-compute[72201]:       </nova:ports>
Aug 01 15:22:17 user nova-compute[72201]:     </nova:instance>
Aug 01 15:22:17 user nova-compute[72201]:   </metadata>
Aug 01 15:22:17 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:22:17 user nova-compute[72201]:     <system>
Aug 01 15:22:17 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:22:17 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:22:17 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:22:17 user nova-compute[72201]:       <entry name="serial">d86ed500-ec1a-4e2c-a137-7a654ada6e11</entry>
Aug 01 15:22:17 user nova-compute[72201]:       <entry name="uuid">d86ed500-ec1a-4e2c-a137-7a654ada6e11</entry>
Aug 01 15:22:17 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:22:17 user nova-compute[72201]:     </system>
Aug 01 15:22:17 user nova-compute[72201]:   </sysinfo>
Aug 01 15:22:17 user nova-compute[72201]:   <os>
Aug 01 15:22:17 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:22:17 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:22:17 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:22:17 user nova-compute[72201]:   </os>
Aug 01 15:22:17 user nova-compute[72201]:   <features>
Aug 01 15:22:17 user nova-compute[72201]:     <acpi/>
Aug 01 15:22:17 user nova-compute[72201]:     <apic/>
Aug 01 15:22:17 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:22:17 user nova-compute[72201]:   </features>
Aug 01 15:22:17 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:22:17 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:22:17 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:22:17 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:22:17 user nova-compute[72201]:   </clock>
Aug 01 15:22:17 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:22:17 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:22:17 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:22:17 user nova-compute[72201]:   </cpu>
Aug 01 15:22:17 user nova-compute[72201]:   <devices>
Aug 01 15:22:17 user nova-compute[72201]:     <disk type="file" device="cdrom">
Aug 01 15:22:17 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 15:22:17 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/d86ed500-ec1a-4e2c-a137-7a654ada6e11/disk.config"/>
Aug 01 15:22:17 user nova-compute[72201]:       <target dev="hda" bus="ide"/>
Aug 01 15:22:17 user nova-compute[72201]:     </disk>
Aug 01 15:22:17 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:22:17 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:22:17 user nova-compute[72201]:       <source dev="/dev/sde"/>
Aug 01 15:22:17 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:22:17 user nova-compute[72201]:       <serial>01356eec-0a71-4aad-94bf-ac863bf85d00</serial>
Aug 01 15:22:17 user nova-compute[72201]:     </disk>
Aug 01 15:22:17 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:22:17 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:22:17 user nova-compute[72201]:       <source dev="/dev/sdf"/>
Aug 01 15:22:17 user nova-compute[72201]:       <target dev="vdb" bus="virtio"/>
Aug 01 15:22:17 user nova-compute[72201]:       <serial>c452cc06-1e64-4257-8ee5-7f75f4ead5c9</serial>
Aug 01 15:22:17 user nova-compute[72201]:     </disk>
Aug 01 15:22:17 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:22:17 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:22:17 user nova-compute[72201]:       <source dev="/dev/sdg"/>
Aug 01 15:22:17 user nova-compute[72201]:       <target dev="vdc" bus="virtio"/>
Aug 01 15:22:17 user nova-compute[72201]:       <serial>8043bb3d-5c99-4f42-9fa7-8bc0d09ac545</serial>
Aug 01 15:22:17 user nova-compute[72201]:     </disk>
Aug 01 15:22:17 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:22:17 user nova-compute[72201]:       <mac address="fa:16:3e:43:cd:e6"/>
Aug 01 15:22:17 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:22:17 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:22:17 user nova-compute[72201]:       <target dev="tap5c6a1011-f0"/>
Aug 01 15:22:17 user nova-compute[72201]:     </interface>
Aug 01 15:22:17 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:22:17 user nova-compute[72201]:       <mac address="fa:16:3e:e9:aa:f5"/>
Aug 01 15:22:17 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:22:17 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:22:17 user nova-compute[72201]:       <target dev="tapb3bdcebc-0f"/>
Aug 01 15:22:17 user nova-compute[72201]:     </interface>
Aug 01 15:22:17 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:22:17 user nova-compute[72201]:       <mac address="fa:16:3e:9c:5a:6f"/>
Aug 01 15:22:17 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:22:17 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:22:17 user nova-compute[72201]:       <target dev="tap5eec44e9-39"/>
Aug 01 15:22:17 user nova-compute[72201]:     </interface>
Aug 01 15:22:17 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:22:17 user nova-compute[72201]:       <mac address="fa:16:3e:f0:e7:fb"/>
Aug 01 15:22:17 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:22:17 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:22:17 user nova-compute[72201]:       <target dev="tap52014d35-b3"/>
Aug 01 15:22:17 user nova-compute[72201]:     </interface>
Aug 01 15:22:17 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:22:17 user nova-compute[72201]:       <mac address="fa:16:3e:59:ec:7a"/>
Aug 01 15:22:17 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:22:17 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:22:17 user nova-compute[72201]:       <target dev="tap892001ed-6d"/>
Aug 01 15:22:17 user nova-compute[72201]:     </interface>
Aug 01 15:22:17 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:22:17 user nova-compute[72201]:       <mac address="fa:16:3e:41:5d:45"/>
Aug 01 15:22:17 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:22:17 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:22:17 user nova-compute[72201]:       <target dev="tapbabde51a-fc"/>
Aug 01 15:22:17 user nova-compute[72201]:     </interface>
Aug 01 15:22:17 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:22:17 user nova-compute[72201]:       <mac address="fa:16:3e:bd:98:53"/>
Aug 01 15:22:17 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:22:17 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:22:17 user nova-compute[72201]:       <target dev="tap5c3087dd-d4"/>
Aug 01 15:22:17 user nova-compute[72201]:     </interface>
Aug 01 15:22:17 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:22:17 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/d86ed500-ec1a-4e2c-a137-7a654ada6e11/console.log" append="off"/>
Aug 01 15:22:17 user nova-compute[72201]:     </serial>
Aug 01 15:22:17 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:22:17 user nova-compute[72201]:     <video>
Aug 01 15:22:17 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:22:17 user nova-compute[72201]:     </video>
Aug 01 15:22:17 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:22:17 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:22:17 user nova-compute[72201]:     </rng>
Aug 01 15:22:17 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:22:17 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:22:17 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:22:17 user nova-compute[72201]:     </memballoon>
Aug 01 15:22:17 user nova-compute[72201]:   </devices>
Aug 01 15:22:17 user nova-compute[72201]: </domain>
Aug 01 15:22:17 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768097343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768097343',id=12,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgbXmP8E15q/2hc/sGGZZBtyKuuqNtJdk8Iq/aT7Y+eOcUaZn3yzcvDKh1GBxnTbvzsaqHqnI8TS1PZHT0WQ3lAxYtOiZyiWfRylI4pBb6s6CN+8bL4bsjkBNc38pPNRQ==',key_name='tempest-keypair-335494459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce0072ae6c74c3997ea40225a876c68',ramdisk_id='',reservation_id='r-temo3w1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1828701596',owner_user_name='tempest-TaggedBootDevicesTest_v242-1828701596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b68ccc67f5401b87a5951bde152dc5',uuid=d86ed500-ec1a-4e2c-a137-7a654ada6e11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "address": "fa:16:3e:43:cd:e6", "network": {"id": "43b87e91-7bb8-432c-abc5-9821f28350ef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-494863642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6a1011-f0", "ovs_interfaceid": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converting VIF {"id": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "address": "fa:16:3e:43:cd:e6", "network": {"id": "43b87e91-7bb8-432c-abc5-9821f28350ef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-494863642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6a1011-f0", "ovs_interfaceid": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:cd:e6,bridge_name='br-int',has_traffic_filtering=True,id=5c6a1011-f0c2-4d1b-8559-116d9b15bdd8,network=Network(43b87e91-7bb8-432c-abc5-9821f28350ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6a1011-f0') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG os_vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:cd:e6,bridge_name='br-int',has_traffic_filtering=True,id=5c6a1011-f0c2-4d1b-8559-116d9b15bdd8,network=Network(43b87e91-7bb8-432c-abc5-9821f28350ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6a1011-f0') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c6a1011-f0, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5c6a1011-f0, col_values=(('external_ids', {'iface-id': '5c6a1011-f0c2-4d1b-8559-116d9b15bdd8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:cd:e6', 'vm-uuid': 'd86ed500-ec1a-4e2c-a137-7a654ada6e11'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: INFO os_vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:cd:e6,bridge_name='br-int',has_traffic_filtering=True,id=5c6a1011-f0c2-4d1b-8559-116d9b15bdd8,network=Network(43b87e91-7bb8-432c-abc5-9821f28350ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6a1011-f0')
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768097343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768097343',id=12,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgbXmP8E15q/2hc/sGGZZBtyKuuqNtJdk8Iq/aT7Y+eOcUaZn3yzcvDKh1GBxnTbvzsaqHqnI8TS1PZHT0WQ3lAxYtOiZyiWfRylI4pBb6s6CN+8bL4bsjkBNc38pPNRQ==',key_name='tempest-keypair-335494459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce0072ae6c74c3997ea40225a876c68',ramdisk_id='',reservation_id='r-temo3w1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1828701596',owner_user_name='tempest-TaggedBootDevicesTest_v242-1828701596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b68ccc67f5401b87a5951bde152dc5',uuid=d86ed500-ec1a-4e2c-a137-7a654ada6e11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "address": "fa:16:3e:e9:aa:f5", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bdcebc-0f", "ovs_interfaceid": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converting VIF {"id": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "address": "fa:16:3e:e9:aa:f5", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bdcebc-0f", "ovs_interfaceid": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:aa:f5,bridge_name='br-int',has_traffic_filtering=True,id=b3bdcebc-0ff7-45e1-995e-790d24bc580f,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3bdcebc-0f') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG os_vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:aa:f5,bridge_name='br-int',has_traffic_filtering=True,id=b3bdcebc-0ff7-45e1-995e-790d24bc580f,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3bdcebc-0f') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3bdcebc-0f, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3bdcebc-0f, col_values=(('external_ids', {'iface-id': 'b3bdcebc-0ff7-45e1-995e-790d24bc580f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:aa:f5', 'vm-uuid': 'd86ed500-ec1a-4e2c-a137-7a654ada6e11'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: INFO os_vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:aa:f5,bridge_name='br-int',has_traffic_filtering=True,id=b3bdcebc-0ff7-45e1-995e-790d24bc580f,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3bdcebc-0f')
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768097343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768097343',id=12,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgbXmP8E15q/2hc/sGGZZBtyKuuqNtJdk8Iq/aT7Y+eOcUaZn3yzcvDKh1GBxnTbvzsaqHqnI8TS1PZHT0WQ3lAxYtOiZyiWfRylI4pBb6s6CN+8bL4bsjkBNc38pPNRQ==',key_name='tempest-keypair-335494459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce0072ae6c74c3997ea40225a876c68',ramdisk_id='',reservation_id='r-temo3w1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1828701596',owner_user_name='tempest-TaggedBootDevicesTest_v242-1828701596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b68ccc67f5401b87a5951bde152dc5',uuid=d86ed500-ec1a-4e2c-a137-7a654ada6e11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5eec44e9-3963-454e-931c-4f5a94548672", "address": "fa:16:3e:9c:5a:6f", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eec44e9-39", "ovs_interfaceid": "5eec44e9-3963-454e-931c-4f5a94548672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converting VIF {"id": "5eec44e9-3963-454e-931c-4f5a94548672", "address": "fa:16:3e:9c:5a:6f", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eec44e9-39", "ovs_interfaceid": "5eec44e9-3963-454e-931c-4f5a94548672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:5a:6f,bridge_name='br-int',has_traffic_filtering=True,id=5eec44e9-3963-454e-931c-4f5a94548672,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5eec44e9-39') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG os_vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:5a:6f,bridge_name='br-int',has_traffic_filtering=True,id=5eec44e9-3963-454e-931c-4f5a94548672,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5eec44e9-39') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5eec44e9-39, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5eec44e9-39, col_values=(('external_ids', {'iface-id': '5eec44e9-3963-454e-931c-4f5a94548672', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:5a:6f', 'vm-uuid': 'd86ed500-ec1a-4e2c-a137-7a654ada6e11'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: INFO os_vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:5a:6f,bridge_name='br-int',has_traffic_filtering=True,id=5eec44e9-3963-454e-931c-4f5a94548672,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5eec44e9-39')
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768097343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768097343',id=12,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgbXmP8E15q/2hc/sGGZZBtyKuuqNtJdk8Iq/aT7Y+eOcUaZn3yzcvDKh1GBxnTbvzsaqHqnI8TS1PZHT0WQ3lAxYtOiZyiWfRylI4pBb6s6CN+8bL4bsjkBNc38pPNRQ==',key_name='tempest-keypair-335494459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce0072ae6c74c3997ea40225a876c68',ramdisk_id='',reservation_id='r-temo3w1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1828701596',owner_user_name='tempest-TaggedBootDevicesTest_v242-1828701596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b68ccc67f5401b87a5951bde152dc5',uuid=d86ed500-ec1a-4e2c-a137-7a654ada6e11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52014d35-b37b-41ec-ab07-1ec05db59785", "address": "fa:16:3e:f0:e7:fb", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52014d35-b3", "ovs_interfaceid": "52014d35-b37b-41ec-ab07-1ec05db59785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converting VIF {"id": "52014d35-b37b-41ec-ab07-1ec05db59785", "address": "fa:16:3e:f0:e7:fb", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52014d35-b3", "ovs_interfaceid": "52014d35-b37b-41ec-ab07-1ec05db59785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e7:fb,bridge_name='br-int',has_traffic_filtering=True,id=52014d35-b37b-41ec-ab07-1ec05db59785,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52014d35-b3') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG os_vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e7:fb,bridge_name='br-int',has_traffic_filtering=True,id=52014d35-b37b-41ec-ab07-1ec05db59785,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52014d35-b3') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52014d35-b3, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap52014d35-b3, col_values=(('external_ids', {'iface-id': '52014d35-b37b-41ec-ab07-1ec05db59785', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:e7:fb', 'vm-uuid': 'd86ed500-ec1a-4e2c-a137-7a654ada6e11'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: INFO os_vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e7:fb,bridge_name='br-int',has_traffic_filtering=True,id=52014d35-b37b-41ec-ab07-1ec05db59785,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52014d35-b3')
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768097343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768097343',id=12,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgbXmP8E15q/2hc/sGGZZBtyKuuqNtJdk8Iq/aT7Y+eOcUaZn3yzcvDKh1GBxnTbvzsaqHqnI8TS1PZHT0WQ3lAxYtOiZyiWfRylI4pBb6s6CN+8bL4bsjkBNc38pPNRQ==',key_name='tempest-keypair-335494459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce0072ae6c74c3997ea40225a876c68',ramdisk_id='',reservation_id='r-temo3w1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1828701596',owner_user_name='tempest-TaggedBootDevicesTest_v242-1828701596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b68ccc67f5401b87a5951bde152dc5',uuid=d86ed500-ec1a-4e2c-a137-7a654ada6e11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "892001ed-6dfd-4e71-baa0-dae05528700d", "address": "fa:16:3e:59:ec:7a", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892001ed-6d", "ovs_interfaceid": "892001ed-6dfd-4e71-baa0-dae05528700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converting VIF {"id": "892001ed-6dfd-4e71-baa0-dae05528700d", "address": "fa:16:3e:59:ec:7a", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892001ed-6d", "ovs_interfaceid": "892001ed-6dfd-4e71-baa0-dae05528700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:ec:7a,bridge_name='br-int',has_traffic_filtering=True,id=892001ed-6dfd-4e71-baa0-dae05528700d,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap892001ed-6d') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG os_vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:ec:7a,bridge_name='br-int',has_traffic_filtering=True,id=892001ed-6dfd-4e71-baa0-dae05528700d,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap892001ed-6d') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap892001ed-6d, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap892001ed-6d, col_values=(('external_ids', {'iface-id': '892001ed-6dfd-4e71-baa0-dae05528700d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:ec:7a', 'vm-uuid': 'd86ed500-ec1a-4e2c-a137-7a654ada6e11'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: INFO os_vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:ec:7a,bridge_name='br-int',has_traffic_filtering=True,id=892001ed-6dfd-4e71-baa0-dae05528700d,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap892001ed-6d')
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768097343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768097343',id=12,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgbXmP8E15q/2hc/sGGZZBtyKuuqNtJdk8Iq/aT7Y+eOcUaZn3yzcvDKh1GBxnTbvzsaqHqnI8TS1PZHT0WQ3lAxYtOiZyiWfRylI4pBb6s6CN+8bL4bsjkBNc38pPNRQ==',key_name='tempest-keypair-335494459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce0072ae6c74c3997ea40225a876c68',ramdisk_id='',reservation_id='r-temo3w1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1828701596',owner_user_name='tempest-TaggedBootDevicesTest_v242-1828701596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b68ccc67f5401b87a5951bde152dc5',uuid=d86ed500-ec1a-4e2c-a137-7a654ada6e11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "babde51a-fce1-4954-8aa6-2e3715330cf0", "address": "fa:16:3e:41:5d:45", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabde51a-fc", "ovs_interfaceid": "babde51a-fce1-4954-8aa6-2e3715330cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converting VIF {"id": "babde51a-fce1-4954-8aa6-2e3715330cf0", "address": "fa:16:3e:41:5d:45", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabde51a-fc", "ovs_interfaceid": "babde51a-fce1-4954-8aa6-2e3715330cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:5d:45,bridge_name='br-int',has_traffic_filtering=True,id=babde51a-fce1-4954-8aa6-2e3715330cf0,network=Network(163285c6-73ff-4004-80ac-264355f256c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbabde51a-fc') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG os_vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:5d:45,bridge_name='br-int',has_traffic_filtering=True,id=babde51a-fce1-4954-8aa6-2e3715330cf0,network=Network(163285c6-73ff-4004-80ac-264355f256c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbabde51a-fc') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbabde51a-fc, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbabde51a-fc, col_values=(('external_ids', {'iface-id': 'babde51a-fce1-4954-8aa6-2e3715330cf0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:5d:45', 'vm-uuid': 'd86ed500-ec1a-4e2c-a137-7a654ada6e11'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: INFO os_vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:5d:45,bridge_name='br-int',has_traffic_filtering=True,id=babde51a-fce1-4954-8aa6-2e3715330cf0,network=Network(163285c6-73ff-4004-80ac-264355f256c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbabde51a-fc')
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768097343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768097343',id=12,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgbXmP8E15q/2hc/sGGZZBtyKuuqNtJdk8Iq/aT7Y+eOcUaZn3yzcvDKh1GBxnTbvzsaqHqnI8TS1PZHT0WQ3lAxYtOiZyiWfRylI4pBb6s6CN+8bL4bsjkBNc38pPNRQ==',key_name='tempest-keypair-335494459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce0072ae6c74c3997ea40225a876c68',ramdisk_id='',reservation_id='r-temo3w1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1828701596',owner_user_name='tempest-TaggedBootDevicesTest_v242-1828701596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:21:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b68ccc67f5401b87a5951bde152dc5',uuid=d86ed500-ec1a-4e2c-a137-7a654ada6e11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "address": "fa:16:3e:bd:98:53", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c3087dd-d4", "ovs_interfaceid": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converting VIF {"id": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "address": "fa:16:3e:bd:98:53", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c3087dd-d4", "ovs_interfaceid": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:98:53,bridge_name='br-int',has_traffic_filtering=True,id=5c3087dd-d4fb-4ec6-8ae3-7a90993941ae,network=Network(163285c6-73ff-4004-80ac-264355f256c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c3087dd-d4') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG os_vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:98:53,bridge_name='br-int',has_traffic_filtering=True,id=5c3087dd-d4fb-4ec6-8ae3-7a90993941ae,network=Network(163285c6-73ff-4004-80ac-264355f256c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c3087dd-d4') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c3087dd-d4, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5c3087dd-d4, col_values=(('external_ids', {'iface-id': '5c3087dd-d4fb-4ec6-8ae3-7a90993941ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:98:53', 'vm-uuid': 'd86ed500-ec1a-4e2c-a137-7a654ada6e11'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:17 user nova-compute[72201]: INFO os_vif [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:98:53,bridge_name='br-int',has_traffic_filtering=True,id=5c3087dd-d4fb-4ec6-8ae3-7a90993941ae,network=Network(163285c6-73ff-4004-80ac-264355f256c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c3087dd-d4')
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] No BDM found with device name hda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] No VIF found with MAC fa:16:3e:43:cd:e6, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] No VIF found with MAC fa:16:3e:59:ec:7a, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:22:17 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Using config drive
Aug 01 15:22:17 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Creating config drive at /opt/stack/data/nova/instances/d86ed500-ec1a-4e2c-a137-7a654ada6e11/disk.config
Aug 01 15:22:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d86ed500-ec1a-4e2c-a137-7a654ada6e11/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpprriqfu9 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d86ed500-ec1a-4e2c-a137-7a654ada6e11/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpprriqfu9" returned: 0 in 0.068s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:19 user nova-compute[72201]: DEBUG nova.compute.manager [req-c281ce16-1148-4b04-90dc-57aac364445c req-5859fb0e-c310-4a3f-9555-b1b3ad889358 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-plugged-5c6a1011-f0c2-4d1b-8559-116d9b15bdd8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c281ce16-1148-4b04-90dc-57aac364445c req-5859fb0e-c310-4a3f-9555-b1b3ad889358 service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c281ce16-1148-4b04-90dc-57aac364445c req-5859fb0e-c310-4a3f-9555-b1b3ad889358 service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c281ce16-1148-4b04-90dc-57aac364445c req-5859fb0e-c310-4a3f-9555-b1b3ad889358 service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:19 user nova-compute[72201]: DEBUG nova.compute.manager [req-c281ce16-1148-4b04-90dc-57aac364445c req-5859fb0e-c310-4a3f-9555-b1b3ad889358 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-plugged-5c6a1011-f0c2-4d1b-8559-116d9b15bdd8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:19 user nova-compute[72201]: WARNING nova.compute.manager [req-c281ce16-1148-4b04-90dc-57aac364445c req-5859fb0e-c310-4a3f-9555-b1b3ad889358 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received unexpected event network-vif-plugged-5c6a1011-f0c2-4d1b-8559-116d9b15bdd8 for instance with vm_state building and task_state spawning.
Aug 01 15:22:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:19 user nova-compute[72201]: DEBUG nova.compute.manager [req-e856806c-b43d-46d1-b451-81c79a6b9a87 req-8c9a8544-1da9-4333-8875-219647c40f00 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-plugged-b3bdcebc-0ff7-45e1-995e-790d24bc580f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e856806c-b43d-46d1-b451-81c79a6b9a87 req-8c9a8544-1da9-4333-8875-219647c40f00 service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e856806c-b43d-46d1-b451-81c79a6b9a87 req-8c9a8544-1da9-4333-8875-219647c40f00 service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e856806c-b43d-46d1-b451-81c79a6b9a87 req-8c9a8544-1da9-4333-8875-219647c40f00 service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:19 user nova-compute[72201]: DEBUG nova.compute.manager [req-e856806c-b43d-46d1-b451-81c79a6b9a87 req-8c9a8544-1da9-4333-8875-219647c40f00 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-plugged-b3bdcebc-0ff7-45e1-995e-790d24bc580f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:19 user nova-compute[72201]: WARNING nova.compute.manager [req-e856806c-b43d-46d1-b451-81c79a6b9a87 req-8c9a8544-1da9-4333-8875-219647c40f00 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received unexpected event network-vif-plugged-b3bdcebc-0ff7-45e1-995e-790d24bc580f for instance with vm_state building and task_state spawning.
Aug 01 15:22:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-43007c57-e6c1-4ee7-8397-00d51a814909 req-964e63a4-babc-4feb-a440-6d1b38581833 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-plugged-5c3087dd-d4fb-4ec6-8ae3-7a90993941ae {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-43007c57-e6c1-4ee7-8397-00d51a814909 req-964e63a4-babc-4feb-a440-6d1b38581833 service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-43007c57-e6c1-4ee7-8397-00d51a814909 req-964e63a4-babc-4feb-a440-6d1b38581833 service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-43007c57-e6c1-4ee7-8397-00d51a814909 req-964e63a4-babc-4feb-a440-6d1b38581833 service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-43007c57-e6c1-4ee7-8397-00d51a814909 req-964e63a4-babc-4feb-a440-6d1b38581833 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-plugged-5c3087dd-d4fb-4ec6-8ae3-7a90993941ae {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:21 user nova-compute[72201]: WARNING nova.compute.manager [req-43007c57-e6c1-4ee7-8397-00d51a814909 req-964e63a4-babc-4feb-a440-6d1b38581833 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received unexpected event network-vif-plugged-5c3087dd-d4fb-4ec6-8ae3-7a90993941ae for instance with vm_state building and task_state spawning.
Aug 01 15:22:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-bc8161a6-4a0c-44e8-b2a5-925186ed3816 req-a8223bf8-c7c9-4d80-9739-7a7722963fbb service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-plugged-5c6a1011-f0c2-4d1b-8559-116d9b15bdd8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bc8161a6-4a0c-44e8-b2a5-925186ed3816 req-a8223bf8-c7c9-4d80-9739-7a7722963fbb service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bc8161a6-4a0c-44e8-b2a5-925186ed3816 req-a8223bf8-c7c9-4d80-9739-7a7722963fbb service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bc8161a6-4a0c-44e8-b2a5-925186ed3816 req-a8223bf8-c7c9-4d80-9739-7a7722963fbb service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-bc8161a6-4a0c-44e8-b2a5-925186ed3816 req-a8223bf8-c7c9-4d80-9739-7a7722963fbb service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-plugged-5c6a1011-f0c2-4d1b-8559-116d9b15bdd8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:21 user nova-compute[72201]: WARNING nova.compute.manager [req-bc8161a6-4a0c-44e8-b2a5-925186ed3816 req-a8223bf8-c7c9-4d80-9739-7a7722963fbb service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received unexpected event network-vif-plugged-5c6a1011-f0c2-4d1b-8559-116d9b15bdd8 for instance with vm_state building and task_state spawning.
Aug 01 15:22:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903326.774237, 54cee809-6ad0-4a16-85cd-ebf8ef683bbe => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:22:21 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] VM Stopped (Lifecycle Event)
Aug 01 15:22:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-1efe0c64-ca2f-4b6c-a0e0-bad0997f6bda None None] [instance: 54cee809-6ad0-4a16-85cd-ebf8ef683bbe] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-plugged-b3bdcebc-0ff7-45e1-995e-790d24bc580f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-plugged-b3bdcebc-0ff7-45e1-995e-790d24bc580f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:21 user nova-compute[72201]: WARNING nova.compute.manager [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received unexpected event network-vif-plugged-b3bdcebc-0ff7-45e1-995e-790d24bc580f for instance with vm_state building and task_state spawning.
Aug 01 15:22:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-plugged-5eec44e9-3963-454e-931c-4f5a94548672 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-plugged-5eec44e9-3963-454e-931c-4f5a94548672 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:21 user nova-compute[72201]: WARNING nova.compute.manager [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received unexpected event network-vif-plugged-5eec44e9-3963-454e-931c-4f5a94548672 for instance with vm_state building and task_state spawning.
Aug 01 15:22:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-plugged-5eec44e9-3963-454e-931c-4f5a94548672 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-plugged-5eec44e9-3963-454e-931c-4f5a94548672 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:21 user nova-compute[72201]: WARNING nova.compute.manager [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received unexpected event network-vif-plugged-5eec44e9-3963-454e-931c-4f5a94548672 for instance with vm_state building and task_state spawning.
Aug 01 15:22:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-plugged-52014d35-b37b-41ec-ab07-1ec05db59785 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-plugged-52014d35-b37b-41ec-ab07-1ec05db59785 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:21 user nova-compute[72201]: WARNING nova.compute.manager [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received unexpected event network-vif-plugged-52014d35-b37b-41ec-ab07-1ec05db59785 for instance with vm_state building and task_state spawning.
Aug 01 15:22:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-plugged-52014d35-b37b-41ec-ab07-1ec05db59785 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-plugged-52014d35-b37b-41ec-ab07-1ec05db59785 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:21 user nova-compute[72201]: WARNING nova.compute.manager [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received unexpected event network-vif-plugged-52014d35-b37b-41ec-ab07-1ec05db59785 for instance with vm_state building and task_state spawning.
Aug 01 15:22:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-plugged-892001ed-6dfd-4e71-baa0-dae05528700d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-plugged-892001ed-6dfd-4e71-baa0-dae05528700d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:21 user nova-compute[72201]: WARNING nova.compute.manager [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received unexpected event network-vif-plugged-892001ed-6dfd-4e71-baa0-dae05528700d for instance with vm_state building and task_state spawning.
Aug 01 15:22:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-plugged-892001ed-6dfd-4e71-baa0-dae05528700d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-plugged-892001ed-6dfd-4e71-baa0-dae05528700d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:21 user nova-compute[72201]: WARNING nova.compute.manager [req-3cb57b67-8d96-4367-8246-9d79d396b289 req-ef48e215-6974-4594-aad9-6b3349253d9c service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received unexpected event network-vif-plugged-892001ed-6dfd-4e71-baa0-dae05528700d for instance with vm_state building and task_state spawning.
Aug 01 15:22:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903343.4722133, d86ed500-ec1a-4e2c-a137-7a654ada6e11 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:22:23 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] VM Resumed (Lifecycle Event)
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-68bb308f-bc56-42f3-91c6-b53520d9aa16 req-5c03d61d-b946-418f-8639-cf18dde99d16 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-plugged-5c3087dd-d4fb-4ec6-8ae3-7a90993941ae {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-68bb308f-bc56-42f3-91c6-b53520d9aa16 req-5c03d61d-b946-418f-8639-cf18dde99d16 service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-68bb308f-bc56-42f3-91c6-b53520d9aa16 req-5c03d61d-b946-418f-8639-cf18dde99d16 service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-68bb308f-bc56-42f3-91c6-b53520d9aa16 req-5c03d61d-b946-418f-8639-cf18dde99d16 service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-68bb308f-bc56-42f3-91c6-b53520d9aa16 req-5c03d61d-b946-418f-8639-cf18dde99d16 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-plugged-5c3087dd-d4fb-4ec6-8ae3-7a90993941ae {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:23 user nova-compute[72201]: WARNING nova.compute.manager [req-68bb308f-bc56-42f3-91c6-b53520d9aa16 req-5c03d61d-b946-418f-8639-cf18dde99d16 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received unexpected event network-vif-plugged-5c3087dd-d4fb-4ec6-8ae3-7a90993941ae for instance with vm_state building and task_state spawning.
Aug 01 15:22:23 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Instance spawned successfully.
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:22:23 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903343.4742622, d86ed500-ec1a-4e2c-a137-7a654ada6e11 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:22:23 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] VM Started (Lifecycle Event)
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:22:23 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:22:23 user nova-compute[72201]: INFO nova.compute.manager [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Took 10.83 seconds to spawn the instance on the hypervisor.
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:22:23 user nova-compute[72201]: INFO nova.compute.manager [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Took 41.22 seconds to build instance.
Aug 01 15:22:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed0314d4-ad55-4ac6-9bd0-d82e98d6cb08 tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.338s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-c39a54d2-3faa-454c-8f1b-735a01546f11 req-d19caddd-a9e6-471e-a7c6-9122715aca56 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-plugged-babde51a-fce1-4954-8aa6-2e3715330cf0 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c39a54d2-3faa-454c-8f1b-735a01546f11 req-d19caddd-a9e6-471e-a7c6-9122715aca56 service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c39a54d2-3faa-454c-8f1b-735a01546f11 req-d19caddd-a9e6-471e-a7c6-9122715aca56 service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c39a54d2-3faa-454c-8f1b-735a01546f11 req-d19caddd-a9e6-471e-a7c6-9122715aca56 service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-c39a54d2-3faa-454c-8f1b-735a01546f11 req-d19caddd-a9e6-471e-a7c6-9122715aca56 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-plugged-babde51a-fce1-4954-8aa6-2e3715330cf0 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:23 user nova-compute[72201]: WARNING nova.compute.manager [req-c39a54d2-3faa-454c-8f1b-735a01546f11 req-d19caddd-a9e6-471e-a7c6-9122715aca56 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received unexpected event network-vif-plugged-babde51a-fce1-4954-8aa6-2e3715330cf0 for instance with vm_state active and task_state None.
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-c39a54d2-3faa-454c-8f1b-735a01546f11 req-d19caddd-a9e6-471e-a7c6-9122715aca56 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-plugged-babde51a-fce1-4954-8aa6-2e3715330cf0 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c39a54d2-3faa-454c-8f1b-735a01546f11 req-d19caddd-a9e6-471e-a7c6-9122715aca56 service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c39a54d2-3faa-454c-8f1b-735a01546f11 req-d19caddd-a9e6-471e-a7c6-9122715aca56 service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c39a54d2-3faa-454c-8f1b-735a01546f11 req-d19caddd-a9e6-471e-a7c6-9122715aca56 service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-c39a54d2-3faa-454c-8f1b-735a01546f11 req-d19caddd-a9e6-471e-a7c6-9122715aca56 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-plugged-babde51a-fce1-4954-8aa6-2e3715330cf0 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:23 user nova-compute[72201]: WARNING nova.compute.manager [req-c39a54d2-3faa-454c-8f1b-735a01546f11 req-d19caddd-a9e6-471e-a7c6-9122715aca56 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received unexpected event network-vif-plugged-babde51a-fce1-4954-8aa6-2e3715330cf0 for instance with vm_state active and task_state None.
Aug 01 15:22:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-4b995599-087f-433a-9e75-250cf909179a req-b1118989-d31c-4b7e-8a67-7460566656ac service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Received event network-changed-4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-4b995599-087f-433a-9e75-250cf909179a req-b1118989-d31c-4b7e-8a67-7460566656ac service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Refreshing instance network info cache due to event network-changed-4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:22:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4b995599-087f-433a-9e75-250cf909179a req-b1118989-d31c-4b7e-8a67-7460566656ac service nova] Acquiring lock "refresh_cache-02d227b0-2b25-467f-a318-ab46aa391a31" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:22:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4b995599-087f-433a-9e75-250cf909179a req-b1118989-d31c-4b7e-8a67-7460566656ac service nova] Acquired lock "refresh_cache-02d227b0-2b25-467f-a318-ab46aa391a31" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:22:29 user nova-compute[72201]: DEBUG nova.network.neutron [req-4b995599-087f-433a-9e75-250cf909179a req-b1118989-d31c-4b7e-8a67-7460566656ac service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Refreshing network info cache for port 4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:22:30 user nova-compute[72201]: DEBUG nova.network.neutron [req-4b995599-087f-433a-9e75-250cf909179a req-b1118989-d31c-4b7e-8a67-7460566656ac service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Updated VIF entry in instance network info cache for port 4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:22:30 user nova-compute[72201]: DEBUG nova.network.neutron [req-4b995599-087f-433a-9e75-250cf909179a req-b1118989-d31c-4b7e-8a67-7460566656ac service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Updating instance_info_cache with network_info: [{"id": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "address": "fa:16:3e:dc:2e:04", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd9ef98-ad", "ovs_interfaceid": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:22:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4b995599-087f-433a-9e75-250cf909179a req-b1118989-d31c-4b7e-8a67-7460566656ac service nova] Releasing lock "refresh_cache-02d227b0-2b25-467f-a318-ab46aa391a31" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:22:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-82f35d9b-669a-45ea-aa97-1498d82471d4 req-4c2516d4-8e81-4c9f-a25b-f6b8a223cae4 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] Received event network-changed-511788fe-0c9e-486f-a19f-88012fe9005a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-82f35d9b-669a-45ea-aa97-1498d82471d4 req-4c2516d4-8e81-4c9f-a25b-f6b8a223cae4 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] Refreshing instance network info cache due to event network-changed-511788fe-0c9e-486f-a19f-88012fe9005a. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:22:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-82f35d9b-669a-45ea-aa97-1498d82471d4 req-4c2516d4-8e81-4c9f-a25b-f6b8a223cae4 service nova] Acquiring lock "refresh_cache-e2846f03-5074-495b-831f-734dd477dc18" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:22:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-82f35d9b-669a-45ea-aa97-1498d82471d4 req-4c2516d4-8e81-4c9f-a25b-f6b8a223cae4 service nova] Acquired lock "refresh_cache-e2846f03-5074-495b-831f-734dd477dc18" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:22:31 user nova-compute[72201]: DEBUG nova.network.neutron [req-82f35d9b-669a-45ea-aa97-1498d82471d4 req-4c2516d4-8e81-4c9f-a25b-f6b8a223cae4 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] Refreshing network info cache for port 511788fe-0c9e-486f-a19f-88012fe9005a {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:22:32 user nova-compute[72201]: DEBUG nova.network.neutron [req-82f35d9b-669a-45ea-aa97-1498d82471d4 req-4c2516d4-8e81-4c9f-a25b-f6b8a223cae4 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] Updated VIF entry in instance network info cache for port 511788fe-0c9e-486f-a19f-88012fe9005a. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:22:32 user nova-compute[72201]: DEBUG nova.network.neutron [req-82f35d9b-669a-45ea-aa97-1498d82471d4 req-4c2516d4-8e81-4c9f-a25b-f6b8a223cae4 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] Updating instance_info_cache with network_info: [{"id": "511788fe-0c9e-486f-a19f-88012fe9005a", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "b7744e37-5b24-4946-90ab-b6481a3ba3e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-948989826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "470dd7d54793417288d2ba2fd8f06dbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511788fe-0c", "ovs_interfaceid": "511788fe-0c9e-486f-a19f-88012fe9005a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:22:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-82f35d9b-669a-45ea-aa97-1498d82471d4 req-4c2516d4-8e81-4c9f-a25b-f6b8a223cae4 service nova] Releasing lock "refresh_cache-e2846f03-5074-495b-831f-734dd477dc18" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:22:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG nova.compute.manager [req-77283024-79a2-4403-9307-ab48a8d8db11 req-394bfcc7-2aec-44dd-9ff8-2261dffb393f service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Received event network-changed-9fa0e19a-91cd-4217-805e-f16384cdc202 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG nova.compute.manager [req-77283024-79a2-4403-9307-ab48a8d8db11 req-394bfcc7-2aec-44dd-9ff8-2261dffb393f service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Refreshing instance network info cache due to event network-changed-9fa0e19a-91cd-4217-805e-f16384cdc202. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-77283024-79a2-4403-9307-ab48a8d8db11 req-394bfcc7-2aec-44dd-9ff8-2261dffb393f service nova] Acquiring lock "refresh_cache-c918ea78-9bf8-421c-9a31-0da4104cd032" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-77283024-79a2-4403-9307-ab48a8d8db11 req-394bfcc7-2aec-44dd-9ff8-2261dffb393f service nova] Acquired lock "refresh_cache-c918ea78-9bf8-421c-9a31-0da4104cd032" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG nova.network.neutron [req-77283024-79a2-4403-9307-ab48a8d8db11 req-394bfcc7-2aec-44dd-9ff8-2261dffb393f service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Refreshing network info cache for port 9fa0e19a-91cd-4217-805e-f16384cdc202 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Acquiring lock "c918ea78-9bf8-421c-9a31-0da4104cd032" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG nova.objects.instance [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lazy-loading 'flavor' on Instance uuid c918ea78-9bf8-421c-9a31-0da4104cd032 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "02d227b0-2b25-467f-a318-ab46aa391a31" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "02d227b0-2b25-467f-a318-ab46aa391a31" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG nova.objects.instance [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lazy-loading 'flavor' on Instance uuid 02d227b0-2b25-467f-a318-ab46aa391a31 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "02d227b0-2b25-467f-a318-ab46aa391a31" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.137s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG nova.network.neutron [req-77283024-79a2-4403-9307-ab48a8d8db11 req-394bfcc7-2aec-44dd-9ff8-2261dffb393f service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Updated VIF entry in instance network info cache for port 9fa0e19a-91cd-4217-805e-f16384cdc202. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG nova.network.neutron [req-77283024-79a2-4403-9307-ab48a8d8db11 req-394bfcc7-2aec-44dd-9ff8-2261dffb393f service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Updating instance_info_cache with network_info: [{"id": "9fa0e19a-91cd-4217-805e-f16384cdc202", "address": "fa:16:3e:ed:51:e0", "network": {"id": "e2b28e3d-396a-4811-9197-38a25d473000", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1150356177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72226dbcf9349bbbedd3303f48f5182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa0e19a-91", "ovs_interfaceid": "9fa0e19a-91cd-4217-805e-f16384cdc202", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-77283024-79a2-4403-9307-ab48a8d8db11 req-394bfcc7-2aec-44dd-9ff8-2261dffb393f service nova] Releasing lock "refresh_cache-c918ea78-9bf8-421c-9a31-0da4104cd032" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Acquiring lock "c918ea78-9bf8-421c-9a31-0da4104cd032" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:33 user nova-compute[72201]: INFO nova.compute.manager [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Attaching volume ed367a8f-c51c-4cbf-8d75-92424ab21173 to /dev/vdb
Aug 01 15:22:33 user nova-compute[72201]: DEBUG os_brick.utils [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "02d227b0-2b25-467f-a318-ab46aa391a31" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "02d227b0-2b25-467f-a318-ab46aa391a31" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:33 user nova-compute[72201]: INFO nova.compute.manager [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Attaching volume 9ec19442-68c2-45bf-952d-f6a13394a085 to /dev/vdb
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[51527f96-51a9-4ca8-a5fe-f01de4c10ecc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d40b30-1fe6-4983-bd22-0ce9decf46eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[74682c6f-0898-4ffd-b279-bbdd418a0fa4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac10677-e8f0-4f21-b0d4-de1304f7b228]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG os_brick.utils [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf25022-05bd-4945-ade4-7b14af6aaba3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:22:34 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:22:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b058b5-6af7-4541-b14c-2abd1c84d647]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG os_brick.utils [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Updating existing volume attachment record: 110aff70-b7f1-43c8-a655-1c0afcdb0a6e {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ee44ea-c60e-4b8d-9a84-1add8d007221]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d91ab7a-48b1-4bfb-bb0d-f9ba773dff9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6719786-38a7-4c91-9998-00bcdb2f88d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:22:34 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:22:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e34f94b-701a-49e6-a3f5-8e01240d70ce]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG os_brick.utils [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:22:34 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Updating existing volume attachment record: f12976cb-3699-4e89-977f-3c6e9c08eb9c {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:22:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Acquiring lock "e2846f03-5074-495b-831f-734dd477dc18" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "e2846f03-5074-495b-831f-734dd477dc18" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:35 user nova-compute[72201]: DEBUG nova.objects.instance [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lazy-loading 'flavor' on Instance uuid e2846f03-5074-495b-831f-734dd477dc18 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "e2846f03-5074-495b-831f-734dd477dc18" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Acquiring lock "e2846f03-5074-495b-831f-734dd477dc18" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "e2846f03-5074-495b-831f-734dd477dc18" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:35 user nova-compute[72201]: INFO nova.compute.manager [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Attaching volume 991b25cb-7c2e-4989-bc57-6f208a520719 to /dev/sdc
Aug 01 15:22:36 user nova-compute[72201]: DEBUG os_brick.utils [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:22:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:36 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e38a9a7-8c92-4cf5-b37b-377af5b49e8b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:36 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b61cea-414f-40d4-b503-b6959b20c794]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:36 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f60fcbc-4b4c-4547-a04a-065f4b258bdb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:36 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd88cb02-d132-4cb9-b57f-ed74caa5ea20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:22:36 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:22:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:22:36 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:22:36 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f41ec41-f8a9-42e5-ae8c-68420ccd2519]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:36 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:22:36 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:22:36 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:22:36 user nova-compute[72201]: DEBUG os_brick.utils [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:22:36 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Updating existing volume attachment record: 992f1b60-a2b1-49af-92a3-0dbdee75104e {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:22:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:37 user nova-compute[72201]: DEBUG nova.compute.manager [req-e12f1fef-47cc-4569-9c1f-b7b45c10db52 req-b71bdc1c-dba6-4742-bb21-b7f42f482c5d service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Received event network-changed-1740420d-31a4-494e-a19f-965960ba2b7c {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:37 user nova-compute[72201]: DEBUG nova.compute.manager [req-e12f1fef-47cc-4569-9c1f-b7b45c10db52 req-b71bdc1c-dba6-4742-bb21-b7f42f482c5d service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Refreshing instance network info cache due to event network-changed-1740420d-31a4-494e-a19f-965960ba2b7c. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:22:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e12f1fef-47cc-4569-9c1f-b7b45c10db52 req-b71bdc1c-dba6-4742-bb21-b7f42f482c5d service nova] Acquiring lock "refresh_cache-0331ddd6-3aa1-47df-b1a3-4d539d26c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:22:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e12f1fef-47cc-4569-9c1f-b7b45c10db52 req-b71bdc1c-dba6-4742-bb21-b7f42f482c5d service nova] Acquired lock "refresh_cache-0331ddd6-3aa1-47df-b1a3-4d539d26c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:22:37 user nova-compute[72201]: DEBUG nova.network.neutron [req-e12f1fef-47cc-4569-9c1f-b7b45c10db52 req-b71bdc1c-dba6-4742-bb21-b7f42f482c5d service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Refreshing network info cache for port 1740420d-31a4-494e-a19f-965960ba2b7c {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:22:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquiring lock "interface-0331ddd6-3aa1-47df-b1a3-4d539d26c708-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "interface-0331ddd6-3aa1-47df-b1a3-4d539d26c708-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:38 user nova-compute[72201]: DEBUG nova.objects.instance [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lazy-loading 'flavor' on Instance uuid 0331ddd6-3aa1-47df-b1a3-4d539d26c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:38 user nova-compute[72201]: DEBUG nova.network.neutron [req-e12f1fef-47cc-4569-9c1f-b7b45c10db52 req-b71bdc1c-dba6-4742-bb21-b7f42f482c5d service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Updated VIF entry in instance network info cache for port 1740420d-31a4-494e-a19f-965960ba2b7c. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:22:38 user nova-compute[72201]: DEBUG nova.network.neutron [req-e12f1fef-47cc-4569-9c1f-b7b45c10db52 req-b71bdc1c-dba6-4742-bb21-b7f42f482c5d service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Updating instance_info_cache with network_info: [{"id": "1740420d-31a4-494e-a19f-965960ba2b7c", "address": "fa:16:3e:b4:92:64", "network": {"id": "acf9d14a-8412-4dc0-80f9-ddfe2774470e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2056245363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1740420d-31", "ovs_interfaceid": "1740420d-31a4-494e-a19f-965960ba2b7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:22:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e12f1fef-47cc-4569-9c1f-b7b45c10db52 req-b71bdc1c-dba6-4742-bb21-b7f42f482c5d service nova] Releasing lock "refresh_cache-0331ddd6-3aa1-47df-b1a3-4d539d26c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:22:38 user nova-compute[72201]: DEBUG nova.objects.instance [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lazy-loading 'pci_requests' on Instance uuid 0331ddd6-3aa1-47df-b1a3-4d539d26c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:38 user nova-compute[72201]: DEBUG nova.network.neutron [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:22:38 user nova-compute[72201]: DEBUG nova.policy [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecc1134a7e7a4eca98878addce19027b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec3967bfce4075a5b38e1f0ec13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:22:39 user nova-compute[72201]: DEBUG nova.network.neutron [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Successfully created port: 09878043-d7f1-4c0e-9c59-30eb516eb05a {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:22:40 user nova-compute[72201]: DEBUG nova.network.neutron [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Successfully updated port: 09878043-d7f1-4c0e-9c59-30eb516eb05a {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:22:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquiring lock "refresh_cache-0331ddd6-3aa1-47df-b1a3-4d539d26c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:22:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquired lock "refresh_cache-0331ddd6-3aa1-47df-b1a3-4d539d26c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:22:40 user nova-compute[72201]: DEBUG nova.network.neutron [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:22:40 user nova-compute[72201]: DEBUG nova.compute.manager [req-9e74cdfc-0641-4936-8fd6-cacd169e94c4 req-0fd41e3d-6572-47c5-ba7f-5836852f8cc8 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Received event network-changed-09878043-d7f1-4c0e-9c59-30eb516eb05a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:40 user nova-compute[72201]: DEBUG nova.compute.manager [req-9e74cdfc-0641-4936-8fd6-cacd169e94c4 req-0fd41e3d-6572-47c5-ba7f-5836852f8cc8 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Refreshing instance network info cache due to event network-changed-09878043-d7f1-4c0e-9c59-30eb516eb05a. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:22:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9e74cdfc-0641-4936-8fd6-cacd169e94c4 req-0fd41e3d-6572-47c5-ba7f-5836852f8cc8 service nova] Acquiring lock "refresh_cache-0331ddd6-3aa1-47df-b1a3-4d539d26c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG nova.network.neutron [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Updating instance_info_cache with network_info: [{"id": "1740420d-31a4-494e-a19f-965960ba2b7c", "address": "fa:16:3e:b4:92:64", "network": {"id": "acf9d14a-8412-4dc0-80f9-ddfe2774470e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2056245363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1740420d-31", "ovs_interfaceid": "1740420d-31a4-494e-a19f-965960ba2b7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "address": "fa:16:3e:04:b9:af", "network": {"id": "67aa96c4-5c47-4351-98f2-d12a3d541e4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-672712741", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09878043-d7", "ovs_interfaceid": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Releasing lock "refresh_cache-0331ddd6-3aa1-47df-b1a3-4d539d26c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9e74cdfc-0641-4936-8fd6-cacd169e94c4 req-0fd41e3d-6572-47c5-ba7f-5836852f8cc8 service nova] Acquired lock "refresh_cache-0331ddd6-3aa1-47df-b1a3-4d539d26c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG nova.network.neutron [req-9e74cdfc-0641-4936-8fd6-cacd169e94c4 req-0fd41e3d-6572-47c5-ba7f-5836852f8cc8 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Refreshing network info cache for port 09878043-d7f1-4c0e-9c59-30eb516eb05a {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550987008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550987008',id=9,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKW0L2BXVsQ16XJ1IgW7J0+ugbX8pR23c/F0Bw5rv53o6+cDAxLCYwwmfBY+G8LBeeB3d6298OqDBKDi82m1vX50J7S1dTl4hFC+o+fm8gp01ukaYRBYhLpJ7oFuNVTSw==',key_name='tempest-keypair-1696360347',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:20:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1ec3967bfce4075a5b38e1f0ec13907',ramdisk_id='',reservation_id='r-7ql6n7s4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1871630489',owner_user_name='tempest-TaggedAttachmentsTest-1871630489-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:20:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecc1134a7e7a4eca98878addce19027b',uuid=0331ddd6-3aa1-47df-b1a3-4d539d26c708,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "address": "fa:16:3e:04:b9:af", "network": {"id": "67aa96c4-5c47-4351-98f2-d12a3d541e4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-672712741", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09878043-d7", "ovs_interfaceid": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Converting VIF {"id": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "address": "fa:16:3e:04:b9:af", "network": {"id": "67aa96c4-5c47-4351-98f2-d12a3d541e4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-672712741", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09878043-d7", "ovs_interfaceid": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:b9:af,bridge_name='br-int',has_traffic_filtering=True,id=09878043-d7f1-4c0e-9c59-30eb516eb05a,network=Network(67aa96c4-5c47-4351-98f2-d12a3d541e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09878043-d7') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG os_vif [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:b9:af,bridge_name='br-int',has_traffic_filtering=True,id=09878043-d7f1-4c0e-9c59-30eb516eb05a,network=Network(67aa96c4-5c47-4351-98f2-d12a3d541e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09878043-d7') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09878043-d7, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09878043-d7, col_values=(('external_ids', {'iface-id': '09878043-d7f1-4c0e-9c59-30eb516eb05a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:b9:af', 'vm-uuid': '0331ddd6-3aa1-47df-b1a3-4d539d26c708'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:41 user nova-compute[72201]: INFO os_vif [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:b9:af,bridge_name='br-int',has_traffic_filtering=True,id=09878043-d7f1-4c0e-9c59-30eb516eb05a,network=Network(67aa96c4-5c47-4351-98f2-d12a3d541e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09878043-d7')
Aug 01 15:22:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550987008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550987008',id=9,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKW0L2BXVsQ16XJ1IgW7J0+ugbX8pR23c/F0Bw5rv53o6+cDAxLCYwwmfBY+G8LBeeB3d6298OqDBKDi82m1vX50J7S1dTl4hFC+o+fm8gp01ukaYRBYhLpJ7oFuNVTSw==',key_name='tempest-keypair-1696360347',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:20:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1ec3967bfce4075a5b38e1f0ec13907',ramdisk_id='',reservation_id='r-7ql6n7s4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1871630489',owner_user_name='tempest-TaggedAttachmentsTest-1871630489-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:20:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecc1134a7e7a4eca98878addce19027b',uuid=0331ddd6-3aa1-47df-b1a3-4d539d26c708,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "address": "fa:16:3e:04:b9:af", "network": {"id": "67aa96c4-5c47-4351-98f2-d12a3d541e4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-672712741", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09878043-d7", "ovs_interfaceid": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Converting VIF {"id": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "address": "fa:16:3e:04:b9:af", "network": {"id": "67aa96c4-5c47-4351-98f2-d12a3d541e4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-672712741", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09878043-d7", "ovs_interfaceid": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:b9:af,bridge_name='br-int',has_traffic_filtering=True,id=09878043-d7f1-4c0e-9c59-30eb516eb05a,network=Network(67aa96c4-5c47-4351-98f2-d12a3d541e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09878043-d7') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] attach device xml: <interface type="ethernet">
Aug 01 15:22:41 user nova-compute[72201]:   <mac address="fa:16:3e:04:b9:af"/>
Aug 01 15:22:41 user nova-compute[72201]:   <model type="virtio"/>
Aug 01 15:22:41 user nova-compute[72201]:   <mtu size="1442"/>
Aug 01 15:22:41 user nova-compute[72201]:   <target dev="tap09878043-d7"/>
Aug 01 15:22:41 user nova-compute[72201]: </interface>
Aug 01 15:22:41 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-430407ab-e182-446f-a5eb-11caf62bf9ca req-b1f64c49-1054-4907-9ac9-c19d4762e652 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Received event network-vif-plugged-09878043-d7f1-4c0e-9c59-30eb516eb05a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-430407ab-e182-446f-a5eb-11caf62bf9ca req-b1f64c49-1054-4907-9ac9-c19d4762e652 service nova] Acquiring lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-430407ab-e182-446f-a5eb-11caf62bf9ca req-b1f64c49-1054-4907-9ac9-c19d4762e652 service nova] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-430407ab-e182-446f-a5eb-11caf62bf9ca req-b1f64c49-1054-4907-9ac9-c19d4762e652 service nova] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-430407ab-e182-446f-a5eb-11caf62bf9ca req-b1f64c49-1054-4907-9ac9-c19d4762e652 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] No waiting events found dispatching network-vif-plugged-09878043-d7f1-4c0e-9c59-30eb516eb05a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:41 user nova-compute[72201]: WARNING nova.compute.manager [req-430407ab-e182-446f-a5eb-11caf62bf9ca req-b1f64c49-1054-4907-9ac9-c19d4762e652 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Received unexpected event network-vif-plugged-09878043-d7f1-4c0e-9c59-30eb516eb05a for instance with vm_state active and task_state None.
Aug 01 15:22:42 user nova-compute[72201]: DEBUG nova.network.neutron [req-9e74cdfc-0641-4936-8fd6-cacd169e94c4 req-0fd41e3d-6572-47c5-ba7f-5836852f8cc8 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Updated VIF entry in instance network info cache for port 09878043-d7f1-4c0e-9c59-30eb516eb05a. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:22:42 user nova-compute[72201]: DEBUG nova.network.neutron [req-9e74cdfc-0641-4936-8fd6-cacd169e94c4 req-0fd41e3d-6572-47c5-ba7f-5836852f8cc8 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Updating instance_info_cache with network_info: [{"id": "1740420d-31a4-494e-a19f-965960ba2b7c", "address": "fa:16:3e:b4:92:64", "network": {"id": "acf9d14a-8412-4dc0-80f9-ddfe2774470e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2056245363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1740420d-31", "ovs_interfaceid": "1740420d-31a4-494e-a19f-965960ba2b7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "address": "fa:16:3e:04:b9:af", "network": {"id": "67aa96c4-5c47-4351-98f2-d12a3d541e4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-672712741", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09878043-d7", "ovs_interfaceid": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:22:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:22:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] No BDM found with device name hda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:22:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] No VIF found with MAC fa:16:3e:b4:92:64, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:22:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9e74cdfc-0641-4936-8fd6-cacd169e94c4 req-0fd41e3d-6572-47c5-ba7f-5836852f8cc8 service nova] Releasing lock "refresh_cache-0331ddd6-3aa1-47df-b1a3-4d539d26c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:22:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:22:42 user nova-compute[72201]:   <nova:package version="0.0.0"/>
Aug 01 15:22:42 user nova-compute[72201]:   <nova:name>tempest-device-tagging-server-550987008</nova:name>
Aug 01 15:22:42 user nova-compute[72201]:   <nova:creationTime>2023-08-01 15:22:42</nova:creationTime>
Aug 01 15:22:42 user nova-compute[72201]:   <nova:flavor name="m1.tiny">
Aug 01 15:22:42 user nova-compute[72201]:     <nova:memory>512</nova:memory>
Aug 01 15:22:42 user nova-compute[72201]:     <nova:disk>1</nova:disk>
Aug 01 15:22:42 user nova-compute[72201]:     <nova:swap>0</nova:swap>
Aug 01 15:22:42 user nova-compute[72201]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:22:42 user nova-compute[72201]:     <nova:vcpus>1</nova:vcpus>
Aug 01 15:22:42 user nova-compute[72201]:   </nova:flavor>
Aug 01 15:22:42 user nova-compute[72201]:   <nova:owner>
Aug 01 15:22:42 user nova-compute[72201]:     <nova:user uuid="ecc1134a7e7a4eca98878addce19027b">tempest-TaggedAttachmentsTest-1871630489-project-member</nova:user>
Aug 01 15:22:42 user nova-compute[72201]:     <nova:project uuid="a1ec3967bfce4075a5b38e1f0ec13907">tempest-TaggedAttachmentsTest-1871630489</nova:project>
Aug 01 15:22:42 user nova-compute[72201]:   </nova:owner>
Aug 01 15:22:42 user nova-compute[72201]:   <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:22:42 user nova-compute[72201]:   <nova:ports>
Aug 01 15:22:42 user nova-compute[72201]:     <nova:port uuid="1740420d-31a4-494e-a19f-965960ba2b7c">
Aug 01 15:22:42 user nova-compute[72201]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 15:22:42 user nova-compute[72201]:     </nova:port>
Aug 01 15:22:42 user nova-compute[72201]:     <nova:port uuid="09878043-d7f1-4c0e-9c59-30eb516eb05a">
Aug 01 15:22:42 user nova-compute[72201]:       <nova:ip type="fixed" address="10.10.10.110" ipVersion="4"/>
Aug 01 15:22:42 user nova-compute[72201]:     </nova:port>
Aug 01 15:22:42 user nova-compute[72201]:   </nova:ports>
Aug 01 15:22:42 user nova-compute[72201]: </nova:instance>
Aug 01 15:22:42 user nova-compute[72201]:  {{(pid=72201) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 01 15:22:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be2b541b-caeb-4fe9-a531-96bf53c62876 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "interface-0331ddd6-3aa1-47df-b1a3-4d539d26c708-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.112s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HYzKEbrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:22:43 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:43 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:43 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d08b44-ebf5-4691-9be1-e42c6520b3c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:22:43 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbd36a7-4df8-48d6-83d6-59807e001c0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085] added
Aug 01 15:22:43 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a024b47-d8a9-4ae3-a898-6a3a749a562e]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba39526-9149-459b-8b16-4978a17bfa6b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HYzKEbrT {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HYzKEbrT" returned: 0 in 0.027s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3625856-ef3f-4ca9-9f8e-4b38927981fc]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HYzKEbrT'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[21eaa1bd-3a2d-4cbb-85a4-b37bcdc56c9a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Acquiring lock "cb684e00-1740-402d-b3c5-c14eaf7e8054" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Lock "cb684e00-1740-402d-b3c5-c14eaf7e8054" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Acquiring lock "cb684e00-1740-402d-b3c5-c14eaf7e8054-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Lock "cb684e00-1740-402d-b3c5-c14eaf7e8054-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Lock "cb684e00-1740-402d-b3c5-c14eaf7e8054-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:43 user nova-compute[72201]: INFO nova.compute.manager [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Terminating instance
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0a2117-5d34-436f-83c7-3a6a8e29fdff]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG nova.compute.manager [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquiring lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG nova.objects.instance [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lazy-loading 'flavor' on Instance uuid 0331ddd6-3aa1-47df-b1a3-4d539d26c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd2a9f1-9cf4-42b9-b66e-c7170b7d287b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085, portal: 172.16.0.220,3260]
Aug 01 15:22:43 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085, portal: 172.16.0.220,3260] successful.
Aug 01 15:22:43 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[04efb8e4-e3a8-4555-b96d-5a45ce551a39]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[801e96aa-9b70-402c-a7ff-7ffc092d9c43]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 (non-flash)
Aug 01 15:22:43 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bbafac-1bc2-48c7-bd88-869134f59f23]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HYzKEbrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquiring lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:43 user nova-compute[72201]: INFO nova.compute.manager [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Attaching volume c3c317e2-0f0f-4e81-804f-9660034363fc to /dev/vdb
Aug 01 15:22:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-5f863f7b-836f-4392-9b1f-85449c3baa44 req-17ec06e7-655d-4ecb-b78d-d88d46d5ecee service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Received event network-vif-plugged-09878043-d7f1-4c0e-9c59-30eb516eb05a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5f863f7b-836f-4392-9b1f-85449c3baa44 req-17ec06e7-655d-4ecb-b78d-d88d46d5ecee service nova] Acquiring lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5f863f7b-836f-4392-9b1f-85449c3baa44 req-17ec06e7-655d-4ecb-b78d-d88d46d5ecee service nova] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5f863f7b-836f-4392-9b1f-85449c3baa44 req-17ec06e7-655d-4ecb-b78d-d88d46d5ecee service nova] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-5f863f7b-836f-4392-9b1f-85449c3baa44 req-17ec06e7-655d-4ecb-b78d-d88d46d5ecee service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] No waiting events found dispatching network-vif-plugged-09878043-d7f1-4c0e-9c59-30eb516eb05a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:44 user nova-compute[72201]: WARNING nova.compute.manager [req-5f863f7b-836f-4392-9b1f-85449c3baa44 req-17ec06e7-655d-4ecb-b78d-d88d46d5ecee service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Received unexpected event network-vif-plugged-09878043-d7f1-4c0e-9c59-30eb516eb05a for instance with vm_state active and task_state None.
Aug 01 15:22:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-5f863f7b-836f-4392-9b1f-85449c3baa44 req-17ec06e7-655d-4ecb-b78d-d88d46d5ecee service nova] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Received event network-vif-unplugged-b1af805e-79e9-469b-a431-6938abe1b0e5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5f863f7b-836f-4392-9b1f-85449c3baa44 req-17ec06e7-655d-4ecb-b78d-d88d46d5ecee service nova] Acquiring lock "cb684e00-1740-402d-b3c5-c14eaf7e8054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5f863f7b-836f-4392-9b1f-85449c3baa44 req-17ec06e7-655d-4ecb-b78d-d88d46d5ecee service nova] Lock "cb684e00-1740-402d-b3c5-c14eaf7e8054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5f863f7b-836f-4392-9b1f-85449c3baa44 req-17ec06e7-655d-4ecb-b78d-d88d46d5ecee service nova] Lock "cb684e00-1740-402d-b3c5-c14eaf7e8054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-5f863f7b-836f-4392-9b1f-85449c3baa44 req-17ec06e7-655d-4ecb-b78d-d88d46d5ecee service nova] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] No waiting events found dispatching network-vif-unplugged-b1af805e-79e9-469b-a431-6938abe1b0e5 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-5f863f7b-836f-4392-9b1f-85449c3baa44 req-17ec06e7-655d-4ecb-b78d-d88d46d5ecee service nova] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Received event network-vif-unplugged-b1af805e-79e9-469b-a431-6938abe1b0e5 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_brick.utils [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZgXQRfoz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:22:44 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0b83c0-037b-4cb4-bf75-a10a68833af6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.037s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f736f7-dfce-43ac-8bde-cd1316ce913e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[97216a7c-fb2d-4417-8718-833072e2d12e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc8adde-2fe8-4490-9cb0-bd190d22b1ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:22:44 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5d44a6-6e53-43e6-bfa9-7b64bd2f3c12]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_brick.utils [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Updating existing volume attachment record: 2cab70bd-66af-44fb-9ba7-3eb8e5646595 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:22:44 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Instance destroyed successfully.
Aug 01 15:22:44 user nova-compute[72201]: DEBUG nova.objects.instance [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Lazy-loading 'resources' on Instance uuid cb684e00-1740-402d-b3c5-c14eaf7e8054 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:20:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-111241312',display_name='tempest-VolumesActionsTest-instance-111241312',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-111241312',id=5,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:20:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ccc7e3cf771f4b0f8c6245914bcf6c1a',ramdisk_id='',reservation_id='r-ryudup0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1082766106',owner_user_name='tempest-VolumesActionsTest-1082766106-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:20:51Z,user_data=None,user_id='225522eaf2aa474792143e7e4c6a5bc9',uuid=cb684e00-1740-402d-b3c5-c14eaf7e8054,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1af805e-79e9-469b-a431-6938abe1b0e5", "address": "fa:16:3e:84:48:12", "network": {"id": "72ebf2cb-4850-4634-b582-23fe6abdc8ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301879152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccc7e3cf771f4b0f8c6245914bcf6c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af805e-79", "ovs_interfaceid": "b1af805e-79e9-469b-a431-6938abe1b0e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Converting VIF {"id": "b1af805e-79e9-469b-a431-6938abe1b0e5", "address": "fa:16:3e:84:48:12", "network": {"id": "72ebf2cb-4850-4634-b582-23fe6abdc8ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-301879152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccc7e3cf771f4b0f8c6245914bcf6c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af805e-79", "ovs_interfaceid": "b1af805e-79e9-469b-a431-6938abe1b0e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:48:12,bridge_name='br-int',has_traffic_filtering=True,id=b1af805e-79e9-469b-a431-6938abe1b0e5,network=Network(72ebf2cb-4850-4634-b582-23fe6abdc8ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1af805e-79') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_vif [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:48:12,bridge_name='br-int',has_traffic_filtering=True,id=b1af805e-79e9-469b-a431-6938abe1b0e5,network=Network(72ebf2cb-4850-4634-b582-23fe6abdc8ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1af805e-79') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1af805e-79, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:22:44 user nova-compute[72201]: INFO os_vif [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:48:12,bridge_name='br-int',has_traffic_filtering=True,id=b1af805e-79e9-469b-a431-6938abe1b0e5,network=Network(72ebf2cb-4850-4634-b582-23fe6abdc8ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1af805e-79')
Aug 01 15:22:44 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Deleting instance files /opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054_del
Aug 01 15:22:44 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Deletion of /opt/stack/data/nova/instances/cb684e00-1740-402d-b3c5-c14eaf7e8054_del complete
Aug 01 15:22:44 user nova-compute[72201]: INFO nova.compute.manager [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '26664326661623764', 'path': '/dev/sdh'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664326661623764', 'path': '/dev/sdh'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.686s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:44 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:44 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG nova.objects.instance [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lazy-loading 'flavor' on Instance uuid 02d227b0-2b25-467f-a318-ab46aa391a31 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a66b6a6-4405-40d5-a9ca-dcf334525cff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:22:44 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:22:44 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:22:44 user nova-compute[72201]:   <source dev="/dev/sdh"/>
Aug 01 15:22:44 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:22:44 user nova-compute[72201]:   <serial>9ec19442-68c2-45bf-952d-f6a13394a085</serial>
Aug 01 15:22:44 user nova-compute[72201]: </disk>
Aug 01 15:22:44 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f907a49d-f6b5-4bf9-9087-43ccc3a845bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173] added
Aug 01 15:22:44 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3968a271-9f55-46cb-9b0c-a0c97468eaa2]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e2b781-33c8-4d19-9d55-10a0d819a07b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZgXQRfoz {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZgXQRfoz" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b0b6ac-1a8b-4058-afe4-11268c1ecffc]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZgXQRfoz'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4404b22f-9c77-48a1-ada0-83c2e6d44a75]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ddf3fa-0d2e-43d4-8a0e-c8afebb4b2d1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:44 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:44 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:44 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:44 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:44 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:44 user nova-compute[72201]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 (non-flash)
Aug 01 15:22:44 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:44 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:44 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:44 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:44 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:44 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:44 user nova-compute[72201]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 (non-flash)
Aug 01 15:22:44 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20ccbca-fcb3-4e8b-acdf-3b1154a6151b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173, portal: 172.16.0.220,3260]
Aug 01 15:22:45 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173, portal: 172.16.0.220,3260] successful.
Aug 01 15:22:45 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c752fa-79b9-49e4-a9ce-a76598d97696]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[585a0560-f028-47df-8fa5-bb9513180de0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:22:45 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:45 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:45 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:45 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:45 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:45 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:45 user nova-compute[72201]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 (non-flash)
Aug 01 15:22:45 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:22:45 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:45 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:45 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:45 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:45 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:45 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:45 user nova-compute[72201]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 (non-flash)
Aug 01 15:22:45 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-aac1e015-02f9-44b5-9a4e-b9a7651913b0 req-63e9e592-8b5e-4e68-8619-f12f092c935d service nova] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Received event network-vif-deleted-b1af805e-79e9-469b-a431-6938abe1b0e5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:45 user nova-compute[72201]: INFO nova.compute.manager [req-aac1e015-02f9-44b5-9a4e-b9a7651913b0 req-63e9e592-8b5e-4e68-8619-f12f092c935d service nova] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Neutron deleted interface b1af805e-79e9-469b-a431-6938abe1b0e5; detaching it from the instance and deleting it from the info cache
Aug 01 15:22:45 user nova-compute[72201]: DEBUG nova.network.neutron [req-aac1e015-02f9-44b5-9a4e-b9a7651913b0 req-63e9e592-8b5e-4e68-8619-f12f092c935d service nova] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:22:45 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Took 0.63 seconds to deallocate network for instance.
Aug 01 15:22:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b306a20-5608-4568-9003-c14c6c806603]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZgXQRfoz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-aac1e015-02f9-44b5-9a4e-b9a7651913b0 req-63e9e592-8b5e-4e68-8619-f12f092c935d service nova] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Detach interface failed, port_id=b1af805e-79e9-469b-a431-6938abe1b0e5, reason: Instance cb684e00-1740-402d-b3c5-c14eaf7e8054 could not be found. {{(pid=72201) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] No VIF found with MAC fa:16:3e:dc:2e:04, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d6506ee8-7cef-4196-a133-f874fbdfdca7 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "02d227b0-2b25-467f-a318-ab46aa391a31" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.568s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dekULmDZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:22:45 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:22:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:45 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Deleted allocations for instance cb684e00-1740-402d-b3c5-c14eaf7e8054
Aug 01 15:22:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eefd91b9-cd0a-45eb-87d5-feb82d6e3931 tempest-VolumesActionsTest-1082766106 tempest-VolumesActionsTest-1082766106-project-member] Lock "cb684e00-1740-402d-b3c5-c14eaf7e8054" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.252s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG nova.compute.manager [req-5fb1d9d5-2a71-4592-ad1b-dcb488604201 req-35a94f15-28e0-4a41-bdc2-43fd7fc2900d service nova] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Received event network-vif-plugged-b1af805e-79e9-469b-a431-6938abe1b0e5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5fb1d9d5-2a71-4592-ad1b-dcb488604201 req-35a94f15-28e0-4a41-bdc2-43fd7fc2900d service nova] Acquiring lock "cb684e00-1740-402d-b3c5-c14eaf7e8054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5fb1d9d5-2a71-4592-ad1b-dcb488604201 req-35a94f15-28e0-4a41-bdc2-43fd7fc2900d service nova] Lock "cb684e00-1740-402d-b3c5-c14eaf7e8054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5fb1d9d5-2a71-4592-ad1b-dcb488604201 req-35a94f15-28e0-4a41-bdc2-43fd7fc2900d service nova] Lock "cb684e00-1740-402d-b3c5-c14eaf7e8054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG nova.compute.manager [req-5fb1d9d5-2a71-4592-ad1b-dcb488604201 req-35a94f15-28e0-4a41-bdc2-43fd7fc2900d service nova] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] No waiting events found dispatching network-vif-plugged-b1af805e-79e9-469b-a431-6938abe1b0e5 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:46 user nova-compute[72201]: WARNING nova.compute.manager [req-5fb1d9d5-2a71-4592-ad1b-dcb488604201 req-35a94f15-28e0-4a41-bdc2-43fd7fc2900d service nova] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Received unexpected event network-vif-plugged-b1af805e-79e9-469b-a431-6938abe1b0e5 for instance with vm_state deleted and task_state None.
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] <== connect_volume: return (2119ms) {'type': 'block', 'scsi_wwn': '26430396131346539', 'path': '/dev/sdi'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430396131346539', 'path': '/dev/sdi'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.697s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:46 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:46 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG nova.objects.instance [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lazy-loading 'flavor' on Instance uuid c918ea78-9bf8-421c-9a31-0da4104cd032 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a2412e-f67d-45c4-a0bc-f262976d4b60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:22:46 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:22:46 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:22:46 user nova-compute[72201]:   <source dev="/dev/sdi"/>
Aug 01 15:22:46 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:22:46 user nova-compute[72201]:   <serial>ed367a8f-c51c-4cbf-8d75-92424ab21173</serial>
Aug 01 15:22:46 user nova-compute[72201]: </disk>
Aug 01 15:22:46 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5342982a-4a6b-443f-821f-daa5c73d8e30]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719] added
Aug 01 15:22:46 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72d2c46-62bc-4137-a585-61cdb6da0cf9]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[855a526c-9702-4d07-9f1f-e6aa3ef62e52]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dekULmDZ {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "02d227b0-2b25-467f-a318-ab46aa391a31" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "02d227b0-2b25-467f-a318-ab46aa391a31" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dekULmDZ" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cf7824-5b94-4544-8150-413758fd3450]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dekULmDZ'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:46 user nova-compute[72201]: INFO nova.compute.manager [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Detaching volume 9ec19442-68c2-45bf-952d-f6a13394a085
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc589d3-aeb4-40a5-a0b5-24922311c8f7]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7371a0f1-d016-45f6-a0ff-4d803dcf115c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:46 user nova-compute[72201]: INFO nova.virt.block_device [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Attempting to driver detach volume 9ec19442-68c2-45bf-952d-f6a13394a085 from mountpoint /dev/vdb
Aug 01 15:22:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Attempting to detach device vdb from instance 02d227b0-2b25-467f-a318-ab46aa391a31 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:22:46 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:22:46 user nova-compute[72201]:   <source dev="/dev/sdh"/>
Aug 01 15:22:46 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:22:46 user nova-compute[72201]:   <serial>9ec19442-68c2-45bf-952d-f6a13394a085</serial>
Aug 01 15:22:46 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:22:46 user nova-compute[72201]: </disk>
Aug 01 15:22:46 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:22:46 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Successfully detached device vdb from instance 02d227b0-2b25-467f-a318-ab46aa391a31 from the persistent domain config.
Aug 01 15:22:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 02d227b0-2b25-467f-a318-ab46aa391a31 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:22:46 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:22:46 user nova-compute[72201]:   <source dev="/dev/sdh"/>
Aug 01 15:22:46 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:22:46 user nova-compute[72201]:   <serial>9ec19442-68c2-45bf-952d-f6a13394a085</serial>
Aug 01 15:22:46 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:22:46 user nova-compute[72201]: </disk>
Aug 01 15:22:46 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2003f3b-66d9-49d9-9401-e97e91d8a118]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719, portal: 172.16.0.220,3260]
Aug 01 15:22:46 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719, portal: 172.16.0.220,3260] successful.
Aug 01 15:22:46 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4016c133-4323-403d-8a9b-99dd377f51c3]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1cf15e-e644-432e-8157-bfbf9cd49bc5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 (non-flash)
Aug 01 15:22:46 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b15dc0-05ba-4357-9d17-7bd6a2c9acc1]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dekULmDZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] No VIF found with MAC fa:16:3e:ed:51:e0, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b411b101-e307-4343-bef3-18e039e5ffed tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.080s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690903366.9817073, 02d227b0-2b25-467f-a318-ab46aa391a31 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 02d227b0-2b25-467f-a318-ab46aa391a31 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:22:46 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Successfully detached device vdb from instance 02d227b0-2b25-467f-a318-ab46aa391a31 from the live domain config.
Aug 01 15:22:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HYzKEbrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:22:46 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] <== connect_volume: return (2089ms) {'type': 'block', 'scsi_wwn': '23636343064393861', 'path': '/dev/sdj'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636343064393861', 'path': '/dev/sdj'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.609s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG nova.objects.instance [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lazy-loading 'flavor' on Instance uuid e2846f03-5074-495b-831f-734dd477dc18 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b51930f-3494-4834-9566-0cc967fa179b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:22:47 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:22:47 user nova-compute[72201]:   <source dev="/dev/sdj"/>
Aug 01 15:22:47 user nova-compute[72201]:   <target dev="sdc" bus="scsi"/>
Aug 01 15:22:47 user nova-compute[72201]:   <serial>991b25cb-7c2e-4989-bc57-6f208a520719</serial>
Aug 01 15:22:47 user nova-compute[72201]:   <address type="drive" controller="0" unit="2"/>
Aug 01 15:22:47 user nova-compute[72201]: </disk>
Aug 01 15:22:47 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.067s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[840de8bd-9828-4420-8c02-7f074369a725]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:22:47 user nova-compute[72201]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 (non-flash)
Aug 01 15:22:47 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:47 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:47 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:47 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:47 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:47 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:47 user nova-compute[72201]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 (non-flash)
Aug 01 15:22:47 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:22:47 user nova-compute[72201]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 (non-flash)
Aug 01 15:22:47 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:47 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:47 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:47 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:47 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:47 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:47 user nova-compute[72201]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 (non-flash)
Aug 01 15:22:47 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc549da5c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085'): ({'sdh'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Removing single pathed devices sdh {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7e08d9-3c13-4df7-b225-88139c3e2e78]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[139ac782-db90-4ba7-84cd-722523fb60f4]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Flushing IO for device /dev/sdh {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1025aa87-e5e6-414c-a7c4-e37173e5430f]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0225d151-3d2a-4715-bd0f-650d8a50ca25]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] SCSI volumes sdh have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a13fef7-2431-4903-907b-58f9d4e7f3e0]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0be9f8-ada0-439c-8837-b5a3713be64c]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085, portal: 172.16.0.220,3260]
Aug 01 15:22:47 user nova-compute[72201]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085, portal: 172.16.0.220,3260] successful.
Aug 01 15:22:47 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec19442-68c2-45bf-952d-f6a13394a085 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d3b9fa-1024-4d17-9751-ef34b58b8a28]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] <== disconnect_volume: return (961ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:22:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] No BDM found with device name sda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] No VIF found with MAC fa:16:3e:2e:c8:2b, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-47116103-92bb-4588-8b58-7198189875db tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "e2846f03-5074-495b-831f-734dd477dc18" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.335s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Acquiring lock "c918ea78-9bf8-421c-9a31-0da4104cd032" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG os_brick.utils [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8079bae1-b0a3-41f7-9a5a-f6f4b7a85631]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0634207c-c442-41d4-b831-b45b35f77abe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[447c5386-ed1f-4bd0-a280-7729b61d8e66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe04bd8c-75ca-46a0-bbd5-519f4180e6b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:22:48 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:22:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcb8d57-0124-401a-9487-d05b86690553]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG os_brick.utils [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:22:48 user nova-compute[72201]: INFO nova.compute.manager [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Swapping volume ed367a8f-c51c-4cbf-8d75-92424ab21173 for ad0b1fd0-5b38-4413-b8c1-c2249dc2af29
Aug 01 15:22:48 user nova-compute[72201]: DEBUG nova.objects.instance [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lazy-loading 'flavor' on Instance uuid 02d227b0-2b25-467f-a318-ab46aa391a31 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-75c86ab8-3118-4ab6-b294-9e2a4d2f2730 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "02d227b0-2b25-467f-a318-ab46aa391a31" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.430s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Acquiring lock "e2846f03-5074-495b-831f-734dd477dc18" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "e2846f03-5074-495b-831f-734dd477dc18" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:49 user nova-compute[72201]: INFO nova.compute.manager [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Detaching volume 991b25cb-7c2e-4989-bc57-6f208a520719
Aug 01 15:22:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:49 user nova-compute[72201]: INFO nova.virt.block_device [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Attempting to driver detach volume 991b25cb-7c2e-4989-bc57-6f208a520719 from mountpoint /dev/sdc
Aug 01 15:22:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Attempting to detach device sdc from instance e2846f03-5074-495b-831f-734dd477dc18 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:22:49 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:22:49 user nova-compute[72201]:   <source dev="/dev/sdj"/>
Aug 01 15:22:49 user nova-compute[72201]:   <target dev="sdc" bus="scsi"/>
Aug 01 15:22:49 user nova-compute[72201]:   <serial>991b25cb-7c2e-4989-bc57-6f208a520719</serial>
Aug 01 15:22:49 user nova-compute[72201]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 01 15:22:49 user nova-compute[72201]: </disk>
Aug 01 15:22:49 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:22:49 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Successfully detached device sdc from instance e2846f03-5074-495b-831f-734dd477dc18 from the persistent domain config.
Aug 01 15:22:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance e2846f03-5074-495b-831f-734dd477dc18 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:22:49 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:22:49 user nova-compute[72201]:   <source dev="/dev/sdj"/>
Aug 01 15:22:49 user nova-compute[72201]:   <target dev="sdc" bus="scsi"/>
Aug 01 15:22:49 user nova-compute[72201]:   <serial>991b25cb-7c2e-4989-bc57-6f208a520719</serial>
Aug 01 15:22:49 user nova-compute[72201]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 01 15:22:49 user nova-compute[72201]: </disk>
Aug 01 15:22:49 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690903369.823437, e2846f03-5074-495b-831f-734dd477dc18 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance e2846f03-5074-495b-831f-734dd477dc18 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:22:49 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Successfully detached device sdc from instance e2846f03-5074-495b-831f-734dd477dc18 from the live domain config.
Aug 01 15:22:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dekULmDZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:22:49 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b672a4-d03a-472d-99b6-609b750d05d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[83934507-1ff3-4229-811d-e6acfdc8407b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:22:49 user nova-compute[72201]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 (non-flash)
Aug 01 15:22:49 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:49 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:49 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:49 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:49 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:49 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:49 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:22:49 user nova-compute[72201]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 (non-flash)
Aug 01 15:22:49 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:49 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:49 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:49 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:49 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:49 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:49 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc549da4430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719'): ({'sdj'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Removing single pathed devices sdj {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[623d7597-633e-40a8-b2a9-8a0157f99649]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[46af4cc1-d07e-445d-9f88-8d3380f334db]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Flushing IO for device /dev/sdj {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[945d17df-43d9-4639-ac24-112ec4f3da4d]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:22:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.059s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5492de97-9227-44b1-a79e-ff5614783155]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] SCSI volumes sdj have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc902a68-1f4f-473e-9501-e4699b8b6beb]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b14878-d633-4513-a06c-cb2672ff37c0]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719, portal: 172.16.0.220,3260]
Aug 01 15:22:50 user nova-compute[72201]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719, portal: 172.16.0.220,3260] successful.
Aug 01 15:22:50 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:991b25cb-7c2e-4989-bc57-6f208a520719 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d740f2-1743-4bb8-81be-f054be346b85]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] <== disconnect_volume: return (355ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG nova.objects.instance [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lazy-loading 'flavor' on Instance uuid e2846f03-5074-495b-831f-734dd477dc18 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b7236e0e-bc20-4ac6-8224-9240447455d4 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "e2846f03-5074-495b-831f-734dd477dc18" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.621s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Acquiring lock "e2846f03-5074-495b-831f-734dd477dc18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "e2846f03-5074-495b-831f-734dd477dc18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Acquiring lock "e2846f03-5074-495b-831f-734dd477dc18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "e2846f03-5074-495b-831f-734dd477dc18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "e2846f03-5074-495b-831f-734dd477dc18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:51 user nova-compute[72201]: INFO nova.compute.manager [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Terminating instance
Aug 01 15:22:51 user nova-compute[72201]: DEBUG nova.compute.manager [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:22:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:51 user nova-compute[72201]: DEBUG nova.compute.manager [req-b398a1e6-f06c-465f-a74c-14090f637396 req-0a9613c5-d478-4de6-9cad-dd891c44a384 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] Received event network-vif-unplugged-511788fe-0c9e-486f-a19f-88012fe9005a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b398a1e6-f06c-465f-a74c-14090f637396 req-0a9613c5-d478-4de6-9cad-dd891c44a384 service nova] Acquiring lock "e2846f03-5074-495b-831f-734dd477dc18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b398a1e6-f06c-465f-a74c-14090f637396 req-0a9613c5-d478-4de6-9cad-dd891c44a384 service nova] Lock "e2846f03-5074-495b-831f-734dd477dc18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b398a1e6-f06c-465f-a74c-14090f637396 req-0a9613c5-d478-4de6-9cad-dd891c44a384 service nova] Lock "e2846f03-5074-495b-831f-734dd477dc18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:51 user nova-compute[72201]: DEBUG nova.compute.manager [req-b398a1e6-f06c-465f-a74c-14090f637396 req-0a9613c5-d478-4de6-9cad-dd891c44a384 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] No waiting events found dispatching network-vif-unplugged-511788fe-0c9e-486f-a19f-88012fe9005a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:51 user nova-compute[72201]: DEBUG nova.compute.manager [req-b398a1e6-f06c-465f-a74c-14090f637396 req-0a9613c5-d478-4de6-9cad-dd891c44a384 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] Received event network-vif-unplugged-511788fe-0c9e-486f-a19f-88012fe9005a for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:22:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:52 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: e2846f03-5074-495b-831f-734dd477dc18] Instance destroyed successfully.
Aug 01 15:22:52 user nova-compute[72201]: DEBUG nova.objects.instance [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lazy-loading 'resources' on Instance uuid e2846f03-5074-495b-831f-734dd477dc18 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-76910196',display_name='tempest-AttachSCSIVolumeTestJSON-server-76910196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-76910196',id=7,image_ref='dec6d2d9-190f-4dee-8bdf-e0f5edb3c58f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAohWxp5tcF4Nc5AIyB3GvB3SxwThNHKjwr9PclyRJVCuuhMlNDhU9t1XjJsPdRHv2p8dtNXzEfk98XNhfmzdQFn8nEleCpqHr3HkFeg/cZdDBqM9HdkPZa1LW4PgG+yRQ==',key_name='tempest-keypair-695897665',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:20:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='470dd7d54793417288d2ba2fd8f06dbf',ramdisk_id='',reservation_id='r-hhv4m63t',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dec6d2d9-190f-4dee-8bdf-e0f5edb3c58f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-353984061',owner_user_name='tempest-AttachSCSIVolumeTestJSON-353984061-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:20:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d80e50103134cc9908a7ad6763460af',uuid=e2846f03-5074-495b-831f-734dd477dc18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "511788fe-0c9e-486f-a19f-88012fe9005a", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "b7744e37-5b24-4946-90ab-b6481a3ba3e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-948989826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "470dd7d54793417288d2ba2fd8f06dbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511788fe-0c", "ovs_interfaceid": "511788fe-0c9e-486f-a19f-88012fe9005a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:22:52 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Converting VIF {"id": "511788fe-0c9e-486f-a19f-88012fe9005a", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "b7744e37-5b24-4946-90ab-b6481a3ba3e7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-948989826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "470dd7d54793417288d2ba2fd8f06dbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511788fe-0c", "ovs_interfaceid": "511788fe-0c9e-486f-a19f-88012fe9005a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:52 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:c8:2b,bridge_name='br-int',has_traffic_filtering=True,id=511788fe-0c9e-486f-a19f-88012fe9005a,network=Network(b7744e37-5b24-4946-90ab-b6481a3ba3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511788fe-0c') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:52 user nova-compute[72201]: DEBUG os_vif [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:c8:2b,bridge_name='br-int',has_traffic_filtering=True,id=511788fe-0c9e-486f-a19f-88012fe9005a,network=Network(b7744e37-5b24-4946-90ab-b6481a3ba3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511788fe-0c') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:22:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap511788fe-0c, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:52 user nova-compute[72201]: INFO os_vif [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:c8:2b,bridge_name='br-int',has_traffic_filtering=True,id=511788fe-0c9e-486f-a19f-88012fe9005a,network=Network(b7744e37-5b24-4946-90ab-b6481a3ba3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511788fe-0c')
Aug 01 15:22:52 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Deleting instance files /opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18_del
Aug 01 15:22:52 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Deletion of /opt/stack/data/nova/instances/e2846f03-5074-495b-831f-734dd477dc18_del complete
Aug 01 15:22:52 user nova-compute[72201]: INFO nova.compute.manager [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] [instance: e2846f03-5074-495b-831f-734dd477dc18] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 01 15:22:52 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:22:52 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: e2846f03-5074-495b-831f-734dd477dc18] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:22:52 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: e2846f03-5074-495b-831f-734dd477dc18] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'upkGPZeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:22:53 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:53 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:53 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ace06f-8b9e-4efa-b046-af7aef7e1ccc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:22:53 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cda9ef-0aac-4c92-8ed4-0f141ba74c28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc] added
Aug 01 15:22:53 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[48602df3-980e-42b6-847f-6d1dd6818ab4]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a634d2b-9721-4b29-ba8f-64e563057d36]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v upkGPZeE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v upkGPZeE" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1067f766-ac8e-401a-9548-66001309cb21]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'upkGPZeE'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e718c20-eb00-41a3-a590-40cf51a5adc1]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[59805eba-10e6-4999-a6d3-f28806697202]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: e2846f03-5074-495b-831f-734dd477dc18] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade0a29a-ede1-4898-81ac-177873552986]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc, portal: 172.16.0.220,3260]
Aug 01 15:22:53 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc, portal: 172.16.0.220,3260] successful.
Aug 01 15:22:53 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:53 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: e2846f03-5074-495b-831f-734dd477dc18] Took 1.15 seconds to deallocate network for instance.
Aug 01 15:22:53 user nova-compute[72201]: DEBUG nova.compute.manager [req-02a709ee-8ac4-4ef4-a339-d0b75960c2fc req-183f33aa-ea37-48e9-a394-ac4fe4cc3add service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] Received event network-vif-deleted-511788fe-0c9e-486f-a19f-88012fe9005a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[93753d64-1472-4ab7-9d05-b41bac124fa1]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0074df-4e93-474a-a096-2d44a87b7d15]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:53 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] HCTL ('39', '-', '-', 0) found on session 12 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fed37ac-f3d0-4bcf-819f-a2557671789a]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: None {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG nova.compute.manager [req-93fd035d-4866-42e3-946e-f3e8dc825de2 req-c54bae4c-ea7b-4239-aa04-968e753b8337 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] Received event network-vif-plugged-511788fe-0c9e-486f-a19f-88012fe9005a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-93fd035d-4866-42e3-946e-f3e8dc825de2 req-c54bae4c-ea7b-4239-aa04-968e753b8337 service nova] Acquiring lock "e2846f03-5074-495b-831f-734dd477dc18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-93fd035d-4866-42e3-946e-f3e8dc825de2 req-c54bae4c-ea7b-4239-aa04-968e753b8337 service nova] Lock "e2846f03-5074-495b-831f-734dd477dc18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-93fd035d-4866-42e3-946e-f3e8dc825de2 req-c54bae4c-ea7b-4239-aa04-968e753b8337 service nova] Lock "e2846f03-5074-495b-831f-734dd477dc18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG nova.compute.manager [req-93fd035d-4866-42e3-946e-f3e8dc825de2 req-c54bae4c-ea7b-4239-aa04-968e753b8337 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] No waiting events found dispatching network-vif-plugged-511788fe-0c9e-486f-a19f-88012fe9005a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:53 user nova-compute[72201]: WARNING nova.compute.manager [req-93fd035d-4866-42e3-946e-f3e8dc825de2 req-c54bae4c-ea7b-4239-aa04-968e753b8337 service nova] [instance: e2846f03-5074-495b-831f-734dd477dc18] Received unexpected event network-vif-plugged-511788fe-0c9e-486f-a19f-88012fe9005a for instance with vm_state deleted and task_state None.
Aug 01 15:22:53 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:22:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:53 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Deleted allocations for instance e2846f03-5074-495b-831f-734dd477dc18
Aug 01 15:22:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2016aa4f-1f5e-4ba5-9384-e4c03f427ee3 tempest-AttachSCSIVolumeTestJSON-353984061 tempest-AttachSCSIVolumeTestJSON-353984061-project-member] Lock "e2846f03-5074-495b-831f-734dd477dc18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.632s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:54 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:22:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'upkGPZeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:22:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23930323337376136', 'path': '/dev/sdh'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:22:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930323337376136', 'path': '/dev/sdh'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:22:54 user nova-compute[72201]: DEBUG nova.objects.instance [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lazy-loading 'flavor' on Instance uuid 0331ddd6-3aa1-47df-b1a3-4d539d26c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:22:54 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:22:54 user nova-compute[72201]:   <source dev="/dev/sdh"/>
Aug 01 15:22:54 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:22:54 user nova-compute[72201]:   <serial>c3c317e2-0f0f-4e81-804f-9660034363fc</serial>
Aug 01 15:22:54 user nova-compute[72201]: </disk>
Aug 01 15:22:54 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:22:55 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:22:55 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] No BDM found with device name hda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:22:55 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] No VIF found with MAC fa:16:3e:b4:92:64, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:22:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1d69b201-f7a1-4090-9fd1-3b28ca18f3e8 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.251s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquiring lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:56 user nova-compute[72201]: INFO nova.compute.manager [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Detaching volume c3c317e2-0f0f-4e81-804f-9660034363fc
Aug 01 15:22:56 user nova-compute[72201]: INFO nova.virt.block_device [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Attempting to driver detach volume c3c317e2-0f0f-4e81-804f-9660034363fc from mountpoint /dev/vdb
Aug 01 15:22:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Attempting to detach device vdb from instance 0331ddd6-3aa1-47df-b1a3-4d539d26c708 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:22:56 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:22:56 user nova-compute[72201]:   <source dev="/dev/sdh"/>
Aug 01 15:22:56 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:22:56 user nova-compute[72201]:   <serial>c3c317e2-0f0f-4e81-804f-9660034363fc</serial>
Aug 01 15:22:56 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 15:22:56 user nova-compute[72201]: </disk>
Aug 01 15:22:56 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:22:56 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Successfully detached device vdb from instance 0331ddd6-3aa1-47df-b1a3-4d539d26c708 from the persistent domain config.
Aug 01 15:22:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0331ddd6-3aa1-47df-b1a3-4d539d26c708 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:22:56 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:22:56 user nova-compute[72201]:   <source dev="/dev/sdh"/>
Aug 01 15:22:56 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:22:56 user nova-compute[72201]:   <serial>c3c317e2-0f0f-4e81-804f-9660034363fc</serial>
Aug 01 15:22:56 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 15:22:56 user nova-compute[72201]: </disk>
Aug 01 15:22:56 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690903376.6160932, 0331ddd6-3aa1-47df-b1a3-4d539d26c708 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0331ddd6-3aa1-47df-b1a3-4d539d26c708 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:22:56 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Successfully detached device vdb from instance 0331ddd6-3aa1-47df-b1a3-4d539d26c708 from the live domain config.
Aug 01 15:22:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'upkGPZeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:22:56 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd88089-e874-4253-b508-4acfb8fb5389]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30f41ed-6a0f-47a7-9e37-f6b93c6da4e8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:22:56 user nova-compute[72201]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc (non-flash)
Aug 01 15:22:56 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:56 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:56 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:56 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:56 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:56 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:56 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:22:56 user nova-compute[72201]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc (non-flash)
Aug 01 15:22:56 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:56 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:56 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:56 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:56 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:56 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:56 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc549d15000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc'): ({'sdh'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Removing single pathed devices sdh {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcedf461-0672-4dfa-ad0b-914bc70846be]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e3cc08-4107-4518-8f48-2490421a63c1]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Flushing IO for device /dev/sdh {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e8c2cf-3f46-4ad2-9674-0b20173fda4a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.047s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba835a60-2882-4874-a208-58490f65b393]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] SCSI volumes sdh have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b44dc0-543e-42ea-bf9f-4338e660d617]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d67e1d-e5a4-4765-8cac-fcfc131cb35c]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc, portal: 172.16.0.220,3260]
Aug 01 15:22:56 user nova-compute[72201]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc, portal: 172.16.0.220,3260] successful.
Aug 01 15:22:56 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3c317e2-0f0f-4e81-804f-9660034363fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cad382-3377-4572-bda4-2caab48d7464]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] <== disconnect_volume: return (325ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnpbEAPS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c918ea78-9bf8-421c-9a31-0da4104cd032', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad0b1fd0-5b38-4413-b8c1-c2249dc2af29', 'serial': 'ad0b1fd0-5b38-4413-b8c1-c2249dc2af29'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZgXQRfoz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'c918ea78-9bf8-421c-9a31-0da4104cd032', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed367a8f-c51c-4cbf-8d75-92424ab21173', 'serial'} {{(pid=72201) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnpbEAPS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:22:56 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:56 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:22:56 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[782ce573-eb02-4a44-a595-9292003b4c41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:22:56 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[762d9b1e-de99-46e1-a67e-71bfe086d3fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29] added
Aug 01 15:22:57 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f71b442-8149-415a-a47a-fe97df9d2973]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce7a7e5-bc14-4e5e-bf44-a588b5a87ddc]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnpbEAPS {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnpbEAPS" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[906a6c98-0e8e-4606-8f65-9ecf014c055d]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jnpbEAPS'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ae4587-f7c4-4836-8b5a-86f41c848cc5]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7646678-040b-413a-a5e1-6329bb2c6f66]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c1b51b-068d-45ad-bdd9-0026e5062e53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29, portal: 172.16.0.220,3260]
Aug 01 15:22:57 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29, portal: 172.16.0.220,3260] successful.
Aug 01 15:22:57 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa37dc85-c216-4c44-9a7a-73353952c2d7]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bc0d49-ced8-44f9-8b5e-4c01931470d8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:22:57 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] HCTL ('39', '-', '-', 0) found on session 13 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2d7b8b-3f3e-4438-9063-003a72b0e208]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Searching for a device in session 13 and hctl ['39', '*', '*', 0] yield: None {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG nova.objects.instance [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lazy-loading 'flavor' on Instance uuid 0331ddd6-3aa1-47df-b1a3-4d539d26c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-466f1c0e-e11c-4899-8dd7-d7cb115dec57 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.871s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquiring lock "interface-0331ddd6-3aa1-47df-b1a3-4d539d26c708-09878043-d7f1-4c0e-9c59-30eb516eb05a" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "interface-0331ddd6-3aa1-47df-b1a3-4d539d26c708-09878043-d7f1-4c0e-9c59-30eb516eb05a" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.objects.instance [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lazy-loading 'flavor' on Instance uuid 0331ddd6-3aa1-47df-b1a3-4d539d26c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550987008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550987008',id=9,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKW0L2BXVsQ16XJ1IgW7J0+ugbX8pR23c/F0Bw5rv53o6+cDAxLCYwwmfBY+G8LBeeB3d6298OqDBKDi82m1vX50J7S1dTl4hFC+o+fm8gp01ukaYRBYhLpJ7oFuNVTSw==',key_name='tempest-keypair-1696360347',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:20:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1ec3967bfce4075a5b38e1f0ec13907',ramdisk_id='',reservation_id='r-7ql6n7s4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1871630489',owner_user_name='tempest-TaggedAttachmentsTest-1871630489-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:20:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecc1134a7e7a4eca98878addce19027b',uuid=0331ddd6-3aa1-47df-b1a3-4d539d26c708,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "address": "fa:16:3e:04:b9:af", "network": {"id": "67aa96c4-5c47-4351-98f2-d12a3d541e4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-672712741", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09878043-d7", "ovs_interfaceid": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Converting VIF {"id": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "address": "fa:16:3e:04:b9:af", "network": {"id": "67aa96c4-5c47-4351-98f2-d12a3d541e4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-672712741", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09878043-d7", "ovs_interfaceid": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:b9:af,bridge_name='br-int',has_traffic_filtering=True,id=09878043-d7f1-4c0e-9c59-30eb516eb05a,network=Network(67aa96c4-5c47-4351-98f2-d12a3d541e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09878043-d7') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:04:b9:af"/><model type="virtio"/><mtu size="1442"/><target dev="tap09878043-d7"/></interface> {{(pid=72201) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:04:b9:af"/><model type="virtio"/><mtu size="1442"/><target dev="tap09878043-d7"/></interface> {{(pid=72201) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Attempting to detach device tap09878043-d7 from instance 0331ddd6-3aa1-47df-b1a3-4d539d26c708 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] detach device xml: <interface type="ethernet">
Aug 01 15:22:58 user nova-compute[72201]:   <mac address="fa:16:3e:04:b9:af"/>
Aug 01 15:22:58 user nova-compute[72201]:   <model type="virtio"/>
Aug 01 15:22:58 user nova-compute[72201]:   <mtu size="1442"/>
Aug 01 15:22:58 user nova-compute[72201]:   <target dev="tap09878043-d7"/>
Aug 01 15:22:58 user nova-compute[72201]: </interface>
Aug 01 15:22:58 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:04:b9:af"/><model type="virtio"/><mtu size="1442"/><target dev="tap09878043-d7"/></interface> {{(pid=72201) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:04:b9:af"/><model type="virtio"/><mtu size="1442"/><target dev="tap09878043-d7"/></interface>not found in domain: <domain type='kvm' id='9'>
Aug 01 15:22:58 user nova-compute[72201]:   <name>instance-00000009</name>
Aug 01 15:22:58 user nova-compute[72201]:   <uuid>0331ddd6-3aa1-47df-b1a3-4d539d26c708</uuid>
Aug 01 15:22:58 user nova-compute[72201]:   <metadata>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:22:58 user nova-compute[72201]:   <nova:package version="0.0.0"/>
Aug 01 15:22:58 user nova-compute[72201]:   <nova:name>tempest-device-tagging-server-550987008</nova:name>
Aug 01 15:22:58 user nova-compute[72201]:   <nova:creationTime>2023-08-01 15:22:42</nova:creationTime>
Aug 01 15:22:58 user nova-compute[72201]:   <nova:flavor name="m1.tiny">
Aug 01 15:22:58 user nova-compute[72201]:     <nova:memory>512</nova:memory>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:disk>1</nova:disk>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:swap>0</nova:swap>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:vcpus>1</nova:vcpus>
Aug 01 15:22:58 user nova-compute[72201]:   </nova:flavor>
Aug 01 15:22:58 user nova-compute[72201]:   <nova:owner>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:user uuid="ecc1134a7e7a4eca98878addce19027b">tempest-TaggedAttachmentsTest-1871630489-project-member</nova:user>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:project uuid="a1ec3967bfce4075a5b38e1f0ec13907">tempest-TaggedAttachmentsTest-1871630489</nova:project>
Aug 01 15:22:58 user nova-compute[72201]:   </nova:owner>
Aug 01 15:22:58 user nova-compute[72201]:   <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:22:58 user nova-compute[72201]:   <nova:ports>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:port uuid="1740420d-31a4-494e-a19f-965960ba2b7c">
Aug 01 15:22:58 user nova-compute[72201]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 15:22:58 user nova-compute[72201]:     </nova:port>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:port uuid="09878043-d7f1-4c0e-9c59-30eb516eb05a">
Aug 01 15:22:58 user nova-compute[72201]:       <nova:ip type="fixed" address="10.10.10.110" ipVersion="4"/>
Aug 01 15:22:58 user nova-compute[72201]:     </nova:port>
Aug 01 15:22:58 user nova-compute[72201]:   </nova:ports>
Aug 01 15:22:58 user nova-compute[72201]: </nova:instance>
Aug 01 15:22:58 user nova-compute[72201]:   </metadata>
Aug 01 15:22:58 user nova-compute[72201]:   <memory unit='KiB'>524288</memory>
Aug 01 15:22:58 user nova-compute[72201]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 15:22:58 user nova-compute[72201]:   <vcpu placement='static'>1</vcpu>
Aug 01 15:22:58 user nova-compute[72201]:   <resource>
Aug 01 15:22:58 user nova-compute[72201]:     <partition>/machine</partition>
Aug 01 15:22:58 user nova-compute[72201]:   </resource>
Aug 01 15:22:58 user nova-compute[72201]:   <sysinfo type='smbios'>
Aug 01 15:22:58 user nova-compute[72201]:     <system>
Aug 01 15:22:58 user nova-compute[72201]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 15:22:58 user nova-compute[72201]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 15:22:58 user nova-compute[72201]:       <entry name='version'>0.0.0</entry>
Aug 01 15:22:58 user nova-compute[72201]:       <entry name='serial'>0331ddd6-3aa1-47df-b1a3-4d539d26c708</entry>
Aug 01 15:22:58 user nova-compute[72201]:       <entry name='uuid'>0331ddd6-3aa1-47df-b1a3-4d539d26c708</entry>
Aug 01 15:22:58 user nova-compute[72201]:       <entry name='family'>Virtual Machine</entry>
Aug 01 15:22:58 user nova-compute[72201]:     </system>
Aug 01 15:22:58 user nova-compute[72201]:   </sysinfo>
Aug 01 15:22:58 user nova-compute[72201]:   <os>
Aug 01 15:22:58 user nova-compute[72201]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 15:22:58 user nova-compute[72201]:     <boot dev='hd'/>
Aug 01 15:22:58 user nova-compute[72201]:     <smbios mode='sysinfo'/>
Aug 01 15:22:58 user nova-compute[72201]:   </os>
Aug 01 15:22:58 user nova-compute[72201]:   <features>
Aug 01 15:22:58 user nova-compute[72201]:     <acpi/>
Aug 01 15:22:58 user nova-compute[72201]:     <apic/>
Aug 01 15:22:58 user nova-compute[72201]:     <vmcoreinfo state='on'/>
Aug 01 15:22:58 user nova-compute[72201]:   </features>
Aug 01 15:22:58 user nova-compute[72201]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 15:22:58 user nova-compute[72201]:     <model fallback='forbid'>Nehalem</model>
Aug 01 15:22:58 user nova-compute[72201]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 15:22:58 user nova-compute[72201]:     <feature policy='require' name='vme'/>
Aug 01 15:22:58 user nova-compute[72201]:     <feature policy='require' name='x2apic'/>
Aug 01 15:22:58 user nova-compute[72201]:     <feature policy='require' name='hypervisor'/>
Aug 01 15:22:58 user nova-compute[72201]:   </cpu>
Aug 01 15:22:58 user nova-compute[72201]:   <clock offset='utc'>
Aug 01 15:22:58 user nova-compute[72201]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 15:22:58 user nova-compute[72201]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 15:22:58 user nova-compute[72201]:     <timer name='hpet' present='no'/>
Aug 01 15:22:58 user nova-compute[72201]:   </clock>
Aug 01 15:22:58 user nova-compute[72201]:   <on_poweroff>destroy</on_poweroff>
Aug 01 15:22:58 user nova-compute[72201]:   <on_reboot>restart</on_reboot>
Aug 01 15:22:58 user nova-compute[72201]:   <on_crash>destroy</on_crash>
Aug 01 15:22:58 user nova-compute[72201]:   <devices>
Aug 01 15:22:58 user nova-compute[72201]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 15:22:58 user nova-compute[72201]:     <disk type='file' device='disk'>
Aug 01 15:22:58 user nova-compute[72201]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 15:22:58 user nova-compute[72201]:       <source file='/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk' index='2'/>
Aug 01 15:22:58 user nova-compute[72201]:       <backingStore type='file' index='3'>
Aug 01 15:22:58 user nova-compute[72201]:         <format type='raw'/>
Aug 01 15:22:58 user nova-compute[72201]:         <source file='/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba'/>
Aug 01 15:22:58 user nova-compute[72201]:         <backingStore/>
Aug 01 15:22:58 user nova-compute[72201]:       </backingStore>
Aug 01 15:22:58 user nova-compute[72201]:       <target dev='vda' bus='virtio'/>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='virtio-disk0'/>
Aug 01 15:22:58 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </disk>
Aug 01 15:22:58 user nova-compute[72201]:     <disk type='file' device='cdrom'>
Aug 01 15:22:58 user nova-compute[72201]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 15:22:58 user nova-compute[72201]:       <source file='/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk.config' index='1'/>
Aug 01 15:22:58 user nova-compute[72201]:       <backingStore/>
Aug 01 15:22:58 user nova-compute[72201]:       <target dev='hda' bus='ide'/>
Aug 01 15:22:58 user nova-compute[72201]:       <readonly/>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='ide0-0-0'/>
Aug 01 15:22:58 user nova-compute[72201]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </disk>
Aug 01 15:22:58 user nova-compute[72201]:     <controller type='usb' index='0' model='none'>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='usb'/>
Aug 01 15:22:58 user nova-compute[72201]:     </controller>
Aug 01 15:22:58 user nova-compute[72201]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='pci.0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </controller>
Aug 01 15:22:58 user nova-compute[72201]:     <controller type='ide' index='0'>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='ide'/>
Aug 01 15:22:58 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 15:22:58 user nova-compute[72201]:     </controller>
Aug 01 15:22:58 user nova-compute[72201]:     <interface type='ethernet'>
Aug 01 15:22:58 user nova-compute[72201]:       <mac address='fa:16:3e:b4:92:64'/>
Aug 01 15:22:58 user nova-compute[72201]:       <target dev='tap1740420d-31'/>
Aug 01 15:22:58 user nova-compute[72201]:       <model type='virtio'/>
Aug 01 15:22:58 user nova-compute[72201]:       <mtu size='1442'/>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='net0'/>
Aug 01 15:22:58 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </interface>
Aug 01 15:22:58 user nova-compute[72201]:     <interface type='ethernet'>
Aug 01 15:22:58 user nova-compute[72201]:       <mac address='fa:16:3e:04:b9:af'/>
Aug 01 15:22:58 user nova-compute[72201]:       <target dev='tap09878043-d7'/>
Aug 01 15:22:58 user nova-compute[72201]:       <model type='virtio'/>
Aug 01 15:22:58 user nova-compute[72201]:       <mtu size='1442'/>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='net1'/>
Aug 01 15:22:58 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </interface>
Aug 01 15:22:58 user nova-compute[72201]:     <serial type='pty'>
Aug 01 15:22:58 user nova-compute[72201]:       <source path='/dev/pts/8'/>
Aug 01 15:22:58 user nova-compute[72201]:       <log file='/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/console.log' append='off'/>
Aug 01 15:22:58 user nova-compute[72201]:       <target type='isa-serial' port='0'>
Aug 01 15:22:58 user nova-compute[72201]:         <model name='isa-serial'/>
Aug 01 15:22:58 user nova-compute[72201]:       </target>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='serial0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </serial>
Aug 01 15:22:58 user nova-compute[72201]:     <console type='pty' tty='/dev/pts/8'>
Aug 01 15:22:58 user nova-compute[72201]:       <source path='/dev/pts/8'/>
Aug 01 15:22:58 user nova-compute[72201]:       <log file='/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/console.log' append='off'/>
Aug 01 15:22:58 user nova-compute[72201]:       <target type='serial' port='0'/>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='serial0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </console>
Aug 01 15:22:58 user nova-compute[72201]:     <input type='mouse' bus='ps2'>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='input0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </input>
Aug 01 15:22:58 user nova-compute[72201]:     <input type='keyboard' bus='ps2'>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='input1'/>
Aug 01 15:22:58 user nova-compute[72201]:     </input>
Aug 01 15:22:58 user nova-compute[72201]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 01 15:22:58 user nova-compute[72201]:       <listen type='address' address='0.0.0.0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </graphics>
Aug 01 15:22:58 user nova-compute[72201]:     <audio id='1' type='none'/>
Aug 01 15:22:58 user nova-compute[72201]:     <video>
Aug 01 15:22:58 user nova-compute[72201]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='video0'/>
Aug 01 15:22:58 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </video>
Aug 01 15:22:58 user nova-compute[72201]:     <memballoon model='virtio'>
Aug 01 15:22:58 user nova-compute[72201]:       <stats period='10'/>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='balloon0'/>
Aug 01 15:22:58 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </memballoon>
Aug 01 15:22:58 user nova-compute[72201]:     <rng model='virtio'>
Aug 01 15:22:58 user nova-compute[72201]:       <backend model='random'>/dev/urandom</backend>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='rng0'/>
Aug 01 15:22:58 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </rng>
Aug 01 15:22:58 user nova-compute[72201]:   </devices>
Aug 01 15:22:58 user nova-compute[72201]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 15:22:58 user nova-compute[72201]:     <label>libvirt-0331ddd6-3aa1-47df-b1a3-4d539d26c708</label>
Aug 01 15:22:58 user nova-compute[72201]:     <imagelabel>libvirt-0331ddd6-3aa1-47df-b1a3-4d539d26c708</imagelabel>
Aug 01 15:22:58 user nova-compute[72201]:   </seclabel>
Aug 01 15:22:58 user nova-compute[72201]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 15:22:58 user nova-compute[72201]:     <label>+64055:+108</label>
Aug 01 15:22:58 user nova-compute[72201]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 15:22:58 user nova-compute[72201]:   </seclabel>
Aug 01 15:22:58 user nova-compute[72201]: </domain>
Aug 01 15:22:58 user nova-compute[72201]:  {{(pid=72201) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 15:22:58 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Successfully detached device tap09878043-d7 from instance 0331ddd6-3aa1-47df-b1a3-4d539d26c708 from the persistent domain config.
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] (1/8): Attempting to detach device tap09878043-d7 with device alias net1 from instance 0331ddd6-3aa1-47df-b1a3-4d539d26c708 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] detach device xml: <interface type="ethernet">
Aug 01 15:22:58 user nova-compute[72201]:   <mac address="fa:16:3e:04:b9:af"/>
Aug 01 15:22:58 user nova-compute[72201]:   <model type="virtio"/>
Aug 01 15:22:58 user nova-compute[72201]:   <mtu size="1442"/>
Aug 01 15:22:58 user nova-compute[72201]:   <target dev="tap09878043-d7"/>
Aug 01 15:22:58 user nova-compute[72201]: </interface>
Aug 01 15:22:58 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Searching for a device in session 13 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnpbEAPS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26637333438356639', 'path': '/dev/sdh'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637333438356639', 'path': '/dev/sdh'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.objects.instance [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Lazy-loading 'flavor' on Instance uuid c918ea78-9bf8-421c-9a31-0da4104cd032 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690903378.595292, 0331ddd6-3aa1-47df-b1a3-4d539d26c708 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Start waiting for the detach event from libvirt for device tap09878043-d7 with device alias net1 for instance 0331ddd6-3aa1-47df-b1a3-4d539d26c708 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:04:b9:af"/><model type="virtio"/><mtu size="1442"/><target dev="tap09878043-d7"/></interface> {{(pid=72201) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:04:b9:af"/><model type="virtio"/><mtu size="1442"/><target dev="tap09878043-d7"/></interface>not found in domain: <domain type='kvm' id='9'>
Aug 01 15:22:58 user nova-compute[72201]:   <name>instance-00000009</name>
Aug 01 15:22:58 user nova-compute[72201]:   <uuid>0331ddd6-3aa1-47df-b1a3-4d539d26c708</uuid>
Aug 01 15:22:58 user nova-compute[72201]:   <metadata>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:22:58 user nova-compute[72201]:   <nova:package version="0.0.0"/>
Aug 01 15:22:58 user nova-compute[72201]:   <nova:name>tempest-device-tagging-server-550987008</nova:name>
Aug 01 15:22:58 user nova-compute[72201]:   <nova:creationTime>2023-08-01 15:22:42</nova:creationTime>
Aug 01 15:22:58 user nova-compute[72201]:   <nova:flavor name="m1.tiny">
Aug 01 15:22:58 user nova-compute[72201]:     <nova:memory>512</nova:memory>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:disk>1</nova:disk>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:swap>0</nova:swap>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:vcpus>1</nova:vcpus>
Aug 01 15:22:58 user nova-compute[72201]:   </nova:flavor>
Aug 01 15:22:58 user nova-compute[72201]:   <nova:owner>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:user uuid="ecc1134a7e7a4eca98878addce19027b">tempest-TaggedAttachmentsTest-1871630489-project-member</nova:user>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:project uuid="a1ec3967bfce4075a5b38e1f0ec13907">tempest-TaggedAttachmentsTest-1871630489</nova:project>
Aug 01 15:22:58 user nova-compute[72201]:   </nova:owner>
Aug 01 15:22:58 user nova-compute[72201]:   <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:22:58 user nova-compute[72201]:   <nova:ports>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:port uuid="1740420d-31a4-494e-a19f-965960ba2b7c">
Aug 01 15:22:58 user nova-compute[72201]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 15:22:58 user nova-compute[72201]:     </nova:port>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:port uuid="09878043-d7f1-4c0e-9c59-30eb516eb05a">
Aug 01 15:22:58 user nova-compute[72201]:       <nova:ip type="fixed" address="10.10.10.110" ipVersion="4"/>
Aug 01 15:22:58 user nova-compute[72201]:     </nova:port>
Aug 01 15:22:58 user nova-compute[72201]:   </nova:ports>
Aug 01 15:22:58 user nova-compute[72201]: </nova:instance>
Aug 01 15:22:58 user nova-compute[72201]:   </metadata>
Aug 01 15:22:58 user nova-compute[72201]:   <memory unit='KiB'>524288</memory>
Aug 01 15:22:58 user nova-compute[72201]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 15:22:58 user nova-compute[72201]:   <vcpu placement='static'>1</vcpu>
Aug 01 15:22:58 user nova-compute[72201]:   <resource>
Aug 01 15:22:58 user nova-compute[72201]:     <partition>/machine</partition>
Aug 01 15:22:58 user nova-compute[72201]:   </resource>
Aug 01 15:22:58 user nova-compute[72201]:   <sysinfo type='smbios'>
Aug 01 15:22:58 user nova-compute[72201]:     <system>
Aug 01 15:22:58 user nova-compute[72201]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 15:22:58 user nova-compute[72201]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 15:22:58 user nova-compute[72201]:       <entry name='version'>0.0.0</entry>
Aug 01 15:22:58 user nova-compute[72201]:       <entry name='serial'>0331ddd6-3aa1-47df-b1a3-4d539d26c708</entry>
Aug 01 15:22:58 user nova-compute[72201]:       <entry name='uuid'>0331ddd6-3aa1-47df-b1a3-4d539d26c708</entry>
Aug 01 15:22:58 user nova-compute[72201]:       <entry name='family'>Virtual Machine</entry>
Aug 01 15:22:58 user nova-compute[72201]:     </system>
Aug 01 15:22:58 user nova-compute[72201]:   </sysinfo>
Aug 01 15:22:58 user nova-compute[72201]:   <os>
Aug 01 15:22:58 user nova-compute[72201]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 15:22:58 user nova-compute[72201]:     <boot dev='hd'/>
Aug 01 15:22:58 user nova-compute[72201]:     <smbios mode='sysinfo'/>
Aug 01 15:22:58 user nova-compute[72201]:   </os>
Aug 01 15:22:58 user nova-compute[72201]:   <features>
Aug 01 15:22:58 user nova-compute[72201]:     <acpi/>
Aug 01 15:22:58 user nova-compute[72201]:     <apic/>
Aug 01 15:22:58 user nova-compute[72201]:     <vmcoreinfo state='on'/>
Aug 01 15:22:58 user nova-compute[72201]:   </features>
Aug 01 15:22:58 user nova-compute[72201]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 15:22:58 user nova-compute[72201]:     <model fallback='forbid'>Nehalem</model>
Aug 01 15:22:58 user nova-compute[72201]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 15:22:58 user nova-compute[72201]:     <feature policy='require' name='vme'/>
Aug 01 15:22:58 user nova-compute[72201]:     <feature policy='require' name='x2apic'/>
Aug 01 15:22:58 user nova-compute[72201]:     <feature policy='require' name='hypervisor'/>
Aug 01 15:22:58 user nova-compute[72201]:   </cpu>
Aug 01 15:22:58 user nova-compute[72201]:   <clock offset='utc'>
Aug 01 15:22:58 user nova-compute[72201]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 15:22:58 user nova-compute[72201]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 15:22:58 user nova-compute[72201]:     <timer name='hpet' present='no'/>
Aug 01 15:22:58 user nova-compute[72201]:   </clock>
Aug 01 15:22:58 user nova-compute[72201]:   <on_poweroff>destroy</on_poweroff>
Aug 01 15:22:58 user nova-compute[72201]:   <on_reboot>restart</on_reboot>
Aug 01 15:22:58 user nova-compute[72201]:   <on_crash>destroy</on_crash>
Aug 01 15:22:58 user nova-compute[72201]:   <devices>
Aug 01 15:22:58 user nova-compute[72201]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 15:22:58 user nova-compute[72201]:     <disk type='file' device='disk'>
Aug 01 15:22:58 user nova-compute[72201]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 15:22:58 user nova-compute[72201]:       <source file='/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk' index='2'/>
Aug 01 15:22:58 user nova-compute[72201]:       <backingStore type='file' index='3'>
Aug 01 15:22:58 user nova-compute[72201]:         <format type='raw'/>
Aug 01 15:22:58 user nova-compute[72201]:         <source file='/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba'/>
Aug 01 15:22:58 user nova-compute[72201]:         <backingStore/>
Aug 01 15:22:58 user nova-compute[72201]:       </backingStore>
Aug 01 15:22:58 user nova-compute[72201]:       <target dev='vda' bus='virtio'/>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='virtio-disk0'/>
Aug 01 15:22:58 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </disk>
Aug 01 15:22:58 user nova-compute[72201]:     <disk type='file' device='cdrom'>
Aug 01 15:22:58 user nova-compute[72201]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 15:22:58 user nova-compute[72201]:       <source file='/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk.config' index='1'/>
Aug 01 15:22:58 user nova-compute[72201]:       <backingStore/>
Aug 01 15:22:58 user nova-compute[72201]:       <target dev='hda' bus='ide'/>
Aug 01 15:22:58 user nova-compute[72201]:       <readonly/>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='ide0-0-0'/>
Aug 01 15:22:58 user nova-compute[72201]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </disk>
Aug 01 15:22:58 user nova-compute[72201]:     <controller type='usb' index='0' model='none'>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='usb'/>
Aug 01 15:22:58 user nova-compute[72201]:     </controller>
Aug 01 15:22:58 user nova-compute[72201]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='pci.0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </controller>
Aug 01 15:22:58 user nova-compute[72201]:     <controller type='ide' index='0'>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='ide'/>
Aug 01 15:22:58 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 15:22:58 user nova-compute[72201]:     </controller>
Aug 01 15:22:58 user nova-compute[72201]:     <interface type='ethernet'>
Aug 01 15:22:58 user nova-compute[72201]:       <mac address='fa:16:3e:b4:92:64'/>
Aug 01 15:22:58 user nova-compute[72201]:       <target dev='tap1740420d-31'/>
Aug 01 15:22:58 user nova-compute[72201]:       <model type='virtio'/>
Aug 01 15:22:58 user nova-compute[72201]:       <mtu size='1442'/>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='net0'/>
Aug 01 15:22:58 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </interface>
Aug 01 15:22:58 user nova-compute[72201]:     <serial type='pty'>
Aug 01 15:22:58 user nova-compute[72201]:       <source path='/dev/pts/8'/>
Aug 01 15:22:58 user nova-compute[72201]:       <log file='/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/console.log' append='off'/>
Aug 01 15:22:58 user nova-compute[72201]:       <target type='isa-serial' port='0'>
Aug 01 15:22:58 user nova-compute[72201]:         <model name='isa-serial'/>
Aug 01 15:22:58 user nova-compute[72201]:       </target>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='serial0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </serial>
Aug 01 15:22:58 user nova-compute[72201]:     <console type='pty' tty='/dev/pts/8'>
Aug 01 15:22:58 user nova-compute[72201]:       <source path='/dev/pts/8'/>
Aug 01 15:22:58 user nova-compute[72201]:       <log file='/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/console.log' append='off'/>
Aug 01 15:22:58 user nova-compute[72201]:       <target type='serial' port='0'/>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='serial0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </console>
Aug 01 15:22:58 user nova-compute[72201]:     <input type='mouse' bus='ps2'>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='input0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </input>
Aug 01 15:22:58 user nova-compute[72201]:     <input type='keyboard' bus='ps2'>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='input1'/>
Aug 01 15:22:58 user nova-compute[72201]:     </input>
Aug 01 15:22:58 user nova-compute[72201]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 01 15:22:58 user nova-compute[72201]:       <listen type='address' address='0.0.0.0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </graphics>
Aug 01 15:22:58 user nova-compute[72201]:     <audio id='1' type='none'/>
Aug 01 15:22:58 user nova-compute[72201]:     <video>
Aug 01 15:22:58 user nova-compute[72201]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='video0'/>
Aug 01 15:22:58 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </video>
Aug 01 15:22:58 user nova-compute[72201]:     <memballoon model='virtio'>
Aug 01 15:22:58 user nova-compute[72201]:       <stats period='10'/>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='balloon0'/>
Aug 01 15:22:58 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </memballoon>
Aug 01 15:22:58 user nova-compute[72201]:     <rng model='virtio'>
Aug 01 15:22:58 user nova-compute[72201]:       <backend model='random'>/dev/urandom</backend>
Aug 01 15:22:58 user nova-compute[72201]:       <alias name='rng0'/>
Aug 01 15:22:58 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 15:22:58 user nova-compute[72201]:     </rng>
Aug 01 15:22:58 user nova-compute[72201]:   </devices>
Aug 01 15:22:58 user nova-compute[72201]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 15:22:58 user nova-compute[72201]:     <label>libvirt-0331ddd6-3aa1-47df-b1a3-4d539d26c708</label>
Aug 01 15:22:58 user nova-compute[72201]:     <imagelabel>libvirt-0331ddd6-3aa1-47df-b1a3-4d539d26c708</imagelabel>
Aug 01 15:22:58 user nova-compute[72201]:   </seclabel>
Aug 01 15:22:58 user nova-compute[72201]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 15:22:58 user nova-compute[72201]:     <label>+64055:+108</label>
Aug 01 15:22:58 user nova-compute[72201]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 15:22:58 user nova-compute[72201]:   </seclabel>
Aug 01 15:22:58 user nova-compute[72201]: </domain>
Aug 01 15:22:58 user nova-compute[72201]:  {{(pid=72201) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 15:22:58 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Successfully detached device tap09878043-d7 from instance 0331ddd6-3aa1-47df-b1a3-4d539d26c708 from the live domain config.
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550987008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550987008',id=9,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKW0L2BXVsQ16XJ1IgW7J0+ugbX8pR23c/F0Bw5rv53o6+cDAxLCYwwmfBY+G8LBeeB3d6298OqDBKDi82m1vX50J7S1dTl4hFC+o+fm8gp01ukaYRBYhLpJ7oFuNVTSw==',key_name='tempest-keypair-1696360347',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:20:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1ec3967bfce4075a5b38e1f0ec13907',ramdisk_id='',reservation_id='r-7ql6n7s4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1871630489',owner_user_name='tempest-TaggedAttachmentsTest-1871630489-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:20:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecc1134a7e7a4eca98878addce19027b',uuid=0331ddd6-3aa1-47df-b1a3-4d539d26c708,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "address": "fa:16:3e:04:b9:af", "network": {"id": "67aa96c4-5c47-4351-98f2-d12a3d541e4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-672712741", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09878043-d7", "ovs_interfaceid": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Converting VIF {"id": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "address": "fa:16:3e:04:b9:af", "network": {"id": "67aa96c4-5c47-4351-98f2-d12a3d541e4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-672712741", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09878043-d7", "ovs_interfaceid": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:b9:af,bridge_name='br-int',has_traffic_filtering=True,id=09878043-d7f1-4c0e-9c59-30eb516eb05a,network=Network(67aa96c4-5c47-4351-98f2-d12a3d541e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09878043-d7') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG os_vif [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:b9:af,bridge_name='br-int',has_traffic_filtering=True,id=09878043-d7f1-4c0e-9c59-30eb516eb05a,network=Network(67aa96c4-5c47-4351-98f2-d12a3d541e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09878043-d7') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09878043-d7, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:58 user nova-compute[72201]: INFO os_vif [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:b9:af,bridge_name='br-int',has_traffic_filtering=True,id=09878043-d7f1-4c0e-9c59-30eb516eb05a,network=Network(67aa96c4-5c47-4351-98f2-d12a3d541e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09878043-d7')
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:22:58 user nova-compute[72201]:   <nova:package version="0.0.0"/>
Aug 01 15:22:58 user nova-compute[72201]:   <nova:name>tempest-device-tagging-server-550987008</nova:name>
Aug 01 15:22:58 user nova-compute[72201]:   <nova:creationTime>2023-08-01 15:22:58</nova:creationTime>
Aug 01 15:22:58 user nova-compute[72201]:   <nova:flavor name="m1.tiny">
Aug 01 15:22:58 user nova-compute[72201]:     <nova:memory>512</nova:memory>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:disk>1</nova:disk>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:swap>0</nova:swap>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:vcpus>1</nova:vcpus>
Aug 01 15:22:58 user nova-compute[72201]:   </nova:flavor>
Aug 01 15:22:58 user nova-compute[72201]:   <nova:owner>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:user uuid="ecc1134a7e7a4eca98878addce19027b">tempest-TaggedAttachmentsTest-1871630489-project-member</nova:user>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:project uuid="a1ec3967bfce4075a5b38e1f0ec13907">tempest-TaggedAttachmentsTest-1871630489</nova:project>
Aug 01 15:22:58 user nova-compute[72201]:   </nova:owner>
Aug 01 15:22:58 user nova-compute[72201]:   <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:22:58 user nova-compute[72201]:   <nova:ports>
Aug 01 15:22:58 user nova-compute[72201]:     <nova:port uuid="1740420d-31a4-494e-a19f-965960ba2b7c">
Aug 01 15:22:58 user nova-compute[72201]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 15:22:58 user nova-compute[72201]:     </nova:port>
Aug 01 15:22:58 user nova-compute[72201]:   </nova:ports>
Aug 01 15:22:58 user nova-compute[72201]: </nova:instance>
Aug 01 15:22:58 user nova-compute[72201]:  {{(pid=72201) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.compute.manager [req-7f561da7-c7f2-4e17-97f0-f575450e34dd req-2de804e8-6c9c-412d-b5fa-39688bf81a42 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Received event network-vif-unplugged-09878043-d7f1-4c0e-9c59-30eb516eb05a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7f561da7-c7f2-4e17-97f0-f575450e34dd req-2de804e8-6c9c-412d-b5fa-39688bf81a42 service nova] Acquiring lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7f561da7-c7f2-4e17-97f0-f575450e34dd req-2de804e8-6c9c-412d-b5fa-39688bf81a42 service nova] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7f561da7-c7f2-4e17-97f0-f575450e34dd req-2de804e8-6c9c-412d-b5fa-39688bf81a42 service nova] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.compute.manager [req-7f561da7-c7f2-4e17-97f0-f575450e34dd req-2de804e8-6c9c-412d-b5fa-39688bf81a42 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] No waiting events found dispatching network-vif-unplugged-09878043-d7f1-4c0e-9c59-30eb516eb05a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:22:58 user nova-compute[72201]: WARNING nova.compute.manager [req-7f561da7-c7f2-4e17-97f0-f575450e34dd req-2de804e8-6c9c-412d-b5fa-39688bf81a42 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Received unexpected event network-vif-unplugged-09878043-d7f1-4c0e-9c59-30eb516eb05a for instance with vm_state active and task_state None.
Aug 01 15:22:58 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] COPY block job progress, current cursor: 177209344 final cursor: 1073741824 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903364.3485036, cb684e00-1740-402d-b3c5-c14eaf7e8054 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:22:59 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] VM Stopped (Lifecycle Event)
Aug 01 15:22:59 user nova-compute[72201]: DEBUG nova.compute.manager [req-bd26b39a-9571-4188-899a-d8d208a45166 req-df12b857-a50c-4b09-b0bb-109e528e48fd service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Received event network-vif-deleted-09878043-d7f1-4c0e-9c59-30eb516eb05a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:22:59 user nova-compute[72201]: INFO nova.compute.manager [req-bd26b39a-9571-4188-899a-d8d208a45166 req-df12b857-a50c-4b09-b0bb-109e528e48fd service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Neutron deleted interface 09878043-d7f1-4c0e-9c59-30eb516eb05a; detaching it from the instance and deleting it from the info cache
Aug 01 15:22:59 user nova-compute[72201]: DEBUG nova.network.neutron [req-bd26b39a-9571-4188-899a-d8d208a45166 req-df12b857-a50c-4b09-b0bb-109e528e48fd service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Updating instance_info_cache with network_info: [{"id": "1740420d-31a4-494e-a19f-965960ba2b7c", "address": "fa:16:3e:b4:92:64", "network": {"id": "acf9d14a-8412-4dc0-80f9-ddfe2774470e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2056245363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1740420d-31", "ovs_interfaceid": "1740420d-31a4-494e-a19f-965960ba2b7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-58d18858-9de9-4eb8-9356-01832ad427e3 None None] [instance: cb684e00-1740-402d-b3c5-c14eaf7e8054] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG nova.objects.instance [req-bd26b39a-9571-4188-899a-d8d208a45166 req-df12b857-a50c-4b09-b0bb-109e528e48fd service nova] Lazy-loading 'system_metadata' on Instance uuid 0331ddd6-3aa1-47df-b1a3-4d539d26c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquiring lock "refresh_cache-0331ddd6-3aa1-47df-b1a3-4d539d26c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquired lock "refresh_cache-0331ddd6-3aa1-47df-b1a3-4d539d26c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG nova.network.neutron [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG nova.objects.instance [req-bd26b39a-9571-4188-899a-d8d208a45166 req-df12b857-a50c-4b09-b0bb-109e528e48fd service nova] Lazy-loading 'flavor' on Instance uuid 0331ddd6-3aa1-47df-b1a3-4d539d26c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [req-bd26b39a-9571-4188-899a-d8d208a45166 req-df12b857-a50c-4b09-b0bb-109e528e48fd service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550987008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550987008',id=9,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKW0L2BXVsQ16XJ1IgW7J0+ugbX8pR23c/F0Bw5rv53o6+cDAxLCYwwmfBY+G8LBeeB3d6298OqDBKDi82m1vX50J7S1dTl4hFC+o+fm8gp01ukaYRBYhLpJ7oFuNVTSw==',key_name='tempest-keypair-1696360347',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:20:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1ec3967bfce4075a5b38e1f0ec13907',ramdisk_id='',reservation_id='r-7ql6n7s4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1871630489',owner_user_name='tempest-TaggedAttachmentsTest-1871630489-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:20:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecc1134a7e7a4eca98878addce19027b',uuid=0331ddd6-3aa1-47df-b1a3-4d539d26c708,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "address": "fa:16:3e:04:b9:af", "network": {"id": "67aa96c4-5c47-4351-98f2-d12a3d541e4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-672712741", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09878043-d7", "ovs_interfaceid": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [req-bd26b39a-9571-4188-899a-d8d208a45166 req-df12b857-a50c-4b09-b0bb-109e528e48fd service nova] Converting VIF {"id": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "address": "fa:16:3e:04:b9:af", "network": {"id": "67aa96c4-5c47-4351-98f2-d12a3d541e4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-672712741", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09878043-d7", "ovs_interfaceid": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [req-bd26b39a-9571-4188-899a-d8d208a45166 req-df12b857-a50c-4b09-b0bb-109e528e48fd service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:b9:af,bridge_name='br-int',has_traffic_filtering=True,id=09878043-d7f1-4c0e-9c59-30eb516eb05a,network=Network(67aa96c4-5c47-4351-98f2-d12a3d541e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09878043-d7') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [req-bd26b39a-9571-4188-899a-d8d208a45166 req-df12b857-a50c-4b09-b0bb-109e528e48fd service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:04:b9:af"/><model type="virtio"/><mtu size="1442"/><target dev="tap09878043-d7"/></interface> {{(pid=72201) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [req-bd26b39a-9571-4188-899a-d8d208a45166 req-df12b857-a50c-4b09-b0bb-109e528e48fd service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:04:b9:af"/><model type="virtio"/><mtu size="1442"/><target dev="tap09878043-d7"/></interface>not found in domain: <domain type='kvm' id='9'>
Aug 01 15:22:59 user nova-compute[72201]:   <name>instance-00000009</name>
Aug 01 15:22:59 user nova-compute[72201]:   <uuid>0331ddd6-3aa1-47df-b1a3-4d539d26c708</uuid>
Aug 01 15:22:59 user nova-compute[72201]:   <metadata>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:22:59 user nova-compute[72201]:   <nova:package version="0.0.0"/>
Aug 01 15:22:59 user nova-compute[72201]:   <nova:name>tempest-device-tagging-server-550987008</nova:name>
Aug 01 15:22:59 user nova-compute[72201]:   <nova:creationTime>2023-08-01 15:22:58</nova:creationTime>
Aug 01 15:22:59 user nova-compute[72201]:   <nova:flavor name="m1.tiny">
Aug 01 15:22:59 user nova-compute[72201]:     <nova:memory>512</nova:memory>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:disk>1</nova:disk>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:swap>0</nova:swap>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:vcpus>1</nova:vcpus>
Aug 01 15:22:59 user nova-compute[72201]:   </nova:flavor>
Aug 01 15:22:59 user nova-compute[72201]:   <nova:owner>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:user uuid="ecc1134a7e7a4eca98878addce19027b">tempest-TaggedAttachmentsTest-1871630489-project-member</nova:user>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:project uuid="a1ec3967bfce4075a5b38e1f0ec13907">tempest-TaggedAttachmentsTest-1871630489</nova:project>
Aug 01 15:22:59 user nova-compute[72201]:   </nova:owner>
Aug 01 15:22:59 user nova-compute[72201]:   <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:22:59 user nova-compute[72201]:   <nova:ports>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:port uuid="1740420d-31a4-494e-a19f-965960ba2b7c">
Aug 01 15:22:59 user nova-compute[72201]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 15:22:59 user nova-compute[72201]:     </nova:port>
Aug 01 15:22:59 user nova-compute[72201]:   </nova:ports>
Aug 01 15:22:59 user nova-compute[72201]: </nova:instance>
Aug 01 15:22:59 user nova-compute[72201]:   </metadata>
Aug 01 15:22:59 user nova-compute[72201]:   <memory unit='KiB'>524288</memory>
Aug 01 15:22:59 user nova-compute[72201]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 15:22:59 user nova-compute[72201]:   <vcpu placement='static'>1</vcpu>
Aug 01 15:22:59 user nova-compute[72201]:   <resource>
Aug 01 15:22:59 user nova-compute[72201]:     <partition>/machine</partition>
Aug 01 15:22:59 user nova-compute[72201]:   </resource>
Aug 01 15:22:59 user nova-compute[72201]:   <sysinfo type='smbios'>
Aug 01 15:22:59 user nova-compute[72201]:     <system>
Aug 01 15:22:59 user nova-compute[72201]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 15:22:59 user nova-compute[72201]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 15:22:59 user nova-compute[72201]:       <entry name='version'>0.0.0</entry>
Aug 01 15:22:59 user nova-compute[72201]:       <entry name='serial'>0331ddd6-3aa1-47df-b1a3-4d539d26c708</entry>
Aug 01 15:22:59 user nova-compute[72201]:       <entry name='uuid'>0331ddd6-3aa1-47df-b1a3-4d539d26c708</entry>
Aug 01 15:22:59 user nova-compute[72201]:       <entry name='family'>Virtual Machine</entry>
Aug 01 15:22:59 user nova-compute[72201]:     </system>
Aug 01 15:22:59 user nova-compute[72201]:   </sysinfo>
Aug 01 15:22:59 user nova-compute[72201]:   <os>
Aug 01 15:22:59 user nova-compute[72201]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 15:22:59 user nova-compute[72201]:     <boot dev='hd'/>
Aug 01 15:22:59 user nova-compute[72201]:     <smbios mode='sysinfo'/>
Aug 01 15:22:59 user nova-compute[72201]:   </os>
Aug 01 15:22:59 user nova-compute[72201]:   <features>
Aug 01 15:22:59 user nova-compute[72201]:     <acpi/>
Aug 01 15:22:59 user nova-compute[72201]:     <apic/>
Aug 01 15:22:59 user nova-compute[72201]:     <vmcoreinfo state='on'/>
Aug 01 15:22:59 user nova-compute[72201]:   </features>
Aug 01 15:22:59 user nova-compute[72201]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 15:22:59 user nova-compute[72201]:     <model fallback='forbid'>Nehalem</model>
Aug 01 15:22:59 user nova-compute[72201]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 15:22:59 user nova-compute[72201]:     <feature policy='require' name='vme'/>
Aug 01 15:22:59 user nova-compute[72201]:     <feature policy='require' name='x2apic'/>
Aug 01 15:22:59 user nova-compute[72201]:     <feature policy='require' name='hypervisor'/>
Aug 01 15:22:59 user nova-compute[72201]:   </cpu>
Aug 01 15:22:59 user nova-compute[72201]:   <clock offset='utc'>
Aug 01 15:22:59 user nova-compute[72201]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 15:22:59 user nova-compute[72201]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 15:22:59 user nova-compute[72201]:     <timer name='hpet' present='no'/>
Aug 01 15:22:59 user nova-compute[72201]:   </clock>
Aug 01 15:22:59 user nova-compute[72201]:   <on_poweroff>destroy</on_poweroff>
Aug 01 15:22:59 user nova-compute[72201]:   <on_reboot>restart</on_reboot>
Aug 01 15:22:59 user nova-compute[72201]:   <on_crash>destroy</on_crash>
Aug 01 15:22:59 user nova-compute[72201]:   <devices>
Aug 01 15:22:59 user nova-compute[72201]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 15:22:59 user nova-compute[72201]:     <disk type='file' device='disk'>
Aug 01 15:22:59 user nova-compute[72201]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 15:22:59 user nova-compute[72201]:       <source file='/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk' index='2'/>
Aug 01 15:22:59 user nova-compute[72201]:       <backingStore type='file' index='3'>
Aug 01 15:22:59 user nova-compute[72201]:         <format type='raw'/>
Aug 01 15:22:59 user nova-compute[72201]:         <source file='/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba'/>
Aug 01 15:22:59 user nova-compute[72201]:         <backingStore/>
Aug 01 15:22:59 user nova-compute[72201]:       </backingStore>
Aug 01 15:22:59 user nova-compute[72201]:       <target dev='vda' bus='virtio'/>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='virtio-disk0'/>
Aug 01 15:22:59 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </disk>
Aug 01 15:22:59 user nova-compute[72201]:     <disk type='file' device='cdrom'>
Aug 01 15:22:59 user nova-compute[72201]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 15:22:59 user nova-compute[72201]:       <source file='/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk.config' index='1'/>
Aug 01 15:22:59 user nova-compute[72201]:       <backingStore/>
Aug 01 15:22:59 user nova-compute[72201]:       <target dev='hda' bus='ide'/>
Aug 01 15:22:59 user nova-compute[72201]:       <readonly/>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='ide0-0-0'/>
Aug 01 15:22:59 user nova-compute[72201]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </disk>
Aug 01 15:22:59 user nova-compute[72201]:     <controller type='usb' index='0' model='none'>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='usb'/>
Aug 01 15:22:59 user nova-compute[72201]:     </controller>
Aug 01 15:22:59 user nova-compute[72201]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='pci.0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </controller>
Aug 01 15:22:59 user nova-compute[72201]:     <controller type='ide' index='0'>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='ide'/>
Aug 01 15:22:59 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 15:22:59 user nova-compute[72201]:     </controller>
Aug 01 15:22:59 user nova-compute[72201]:     <interface type='ethernet'>
Aug 01 15:22:59 user nova-compute[72201]:       <mac address='fa:16:3e:b4:92:64'/>
Aug 01 15:22:59 user nova-compute[72201]:       <target dev='tap1740420d-31'/>
Aug 01 15:22:59 user nova-compute[72201]:       <model type='virtio'/>
Aug 01 15:22:59 user nova-compute[72201]:       <mtu size='1442'/>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='net0'/>
Aug 01 15:22:59 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </interface>
Aug 01 15:22:59 user nova-compute[72201]:     <serial type='pty'>
Aug 01 15:22:59 user nova-compute[72201]:       <source path='/dev/pts/8'/>
Aug 01 15:22:59 user nova-compute[72201]:       <log file='/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/console.log' append='off'/>
Aug 01 15:22:59 user nova-compute[72201]:       <target type='isa-serial' port='0'>
Aug 01 15:22:59 user nova-compute[72201]:         <model name='isa-serial'/>
Aug 01 15:22:59 user nova-compute[72201]:       </target>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='serial0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </serial>
Aug 01 15:22:59 user nova-compute[72201]:     <console type='pty' tty='/dev/pts/8'>
Aug 01 15:22:59 user nova-compute[72201]:       <source path='/dev/pts/8'/>
Aug 01 15:22:59 user nova-compute[72201]:       <log file='/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/console.log' append='off'/>
Aug 01 15:22:59 user nova-compute[72201]:       <target type='serial' port='0'/>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='serial0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </console>
Aug 01 15:22:59 user nova-compute[72201]:     <input type='mouse' bus='ps2'>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='input0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </input>
Aug 01 15:22:59 user nova-compute[72201]:     <input type='keyboard' bus='ps2'>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='input1'/>
Aug 01 15:22:59 user nova-compute[72201]:     </input>
Aug 01 15:22:59 user nova-compute[72201]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 01 15:22:59 user nova-compute[72201]:       <listen type='address' address='0.0.0.0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </graphics>
Aug 01 15:22:59 user nova-compute[72201]:     <audio id='1' type='none'/>
Aug 01 15:22:59 user nova-compute[72201]:     <video>
Aug 01 15:22:59 user nova-compute[72201]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='video0'/>
Aug 01 15:22:59 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </video>
Aug 01 15:22:59 user nova-compute[72201]:     <memballoon model='virtio'>
Aug 01 15:22:59 user nova-compute[72201]:       <stats period='10'/>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='balloon0'/>
Aug 01 15:22:59 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </memballoon>
Aug 01 15:22:59 user nova-compute[72201]:     <rng model='virtio'>
Aug 01 15:22:59 user nova-compute[72201]:       <backend model='random'>/dev/urandom</backend>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='rng0'/>
Aug 01 15:22:59 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </rng>
Aug 01 15:22:59 user nova-compute[72201]:   </devices>
Aug 01 15:22:59 user nova-compute[72201]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 15:22:59 user nova-compute[72201]:     <label>libvirt-0331ddd6-3aa1-47df-b1a3-4d539d26c708</label>
Aug 01 15:22:59 user nova-compute[72201]:     <imagelabel>libvirt-0331ddd6-3aa1-47df-b1a3-4d539d26c708</imagelabel>
Aug 01 15:22:59 user nova-compute[72201]:   </seclabel>
Aug 01 15:22:59 user nova-compute[72201]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 15:22:59 user nova-compute[72201]:     <label>+64055:+108</label>
Aug 01 15:22:59 user nova-compute[72201]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 15:22:59 user nova-compute[72201]:   </seclabel>
Aug 01 15:22:59 user nova-compute[72201]: </domain>
Aug 01 15:22:59 user nova-compute[72201]:  {{(pid=72201) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [req-bd26b39a-9571-4188-899a-d8d208a45166 req-df12b857-a50c-4b09-b0bb-109e528e48fd service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:04:b9:af"/><model type="virtio"/><mtu size="1442"/><target dev="tap09878043-d7"/></interface> {{(pid=72201) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [req-bd26b39a-9571-4188-899a-d8d208a45166 req-df12b857-a50c-4b09-b0bb-109e528e48fd service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:04:b9:af"/><model type="virtio"/><mtu size="1442"/><target dev="tap09878043-d7"/></interface>not found in domain: <domain type='kvm' id='9'>
Aug 01 15:22:59 user nova-compute[72201]:   <name>instance-00000009</name>
Aug 01 15:22:59 user nova-compute[72201]:   <uuid>0331ddd6-3aa1-47df-b1a3-4d539d26c708</uuid>
Aug 01 15:22:59 user nova-compute[72201]:   <metadata>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:22:59 user nova-compute[72201]:   <nova:package version="0.0.0"/>
Aug 01 15:22:59 user nova-compute[72201]:   <nova:name>tempest-device-tagging-server-550987008</nova:name>
Aug 01 15:22:59 user nova-compute[72201]:   <nova:creationTime>2023-08-01 15:22:58</nova:creationTime>
Aug 01 15:22:59 user nova-compute[72201]:   <nova:flavor name="m1.tiny">
Aug 01 15:22:59 user nova-compute[72201]:     <nova:memory>512</nova:memory>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:disk>1</nova:disk>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:swap>0</nova:swap>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:vcpus>1</nova:vcpus>
Aug 01 15:22:59 user nova-compute[72201]:   </nova:flavor>
Aug 01 15:22:59 user nova-compute[72201]:   <nova:owner>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:user uuid="ecc1134a7e7a4eca98878addce19027b">tempest-TaggedAttachmentsTest-1871630489-project-member</nova:user>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:project uuid="a1ec3967bfce4075a5b38e1f0ec13907">tempest-TaggedAttachmentsTest-1871630489</nova:project>
Aug 01 15:22:59 user nova-compute[72201]:   </nova:owner>
Aug 01 15:22:59 user nova-compute[72201]:   <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:22:59 user nova-compute[72201]:   <nova:ports>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:port uuid="1740420d-31a4-494e-a19f-965960ba2b7c">
Aug 01 15:22:59 user nova-compute[72201]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 15:22:59 user nova-compute[72201]:     </nova:port>
Aug 01 15:22:59 user nova-compute[72201]:   </nova:ports>
Aug 01 15:22:59 user nova-compute[72201]: </nova:instance>
Aug 01 15:22:59 user nova-compute[72201]:   </metadata>
Aug 01 15:22:59 user nova-compute[72201]:   <memory unit='KiB'>524288</memory>
Aug 01 15:22:59 user nova-compute[72201]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 15:22:59 user nova-compute[72201]:   <vcpu placement='static'>1</vcpu>
Aug 01 15:22:59 user nova-compute[72201]:   <resource>
Aug 01 15:22:59 user nova-compute[72201]:     <partition>/machine</partition>
Aug 01 15:22:59 user nova-compute[72201]:   </resource>
Aug 01 15:22:59 user nova-compute[72201]:   <sysinfo type='smbios'>
Aug 01 15:22:59 user nova-compute[72201]:     <system>
Aug 01 15:22:59 user nova-compute[72201]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 15:22:59 user nova-compute[72201]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 15:22:59 user nova-compute[72201]:       <entry name='version'>0.0.0</entry>
Aug 01 15:22:59 user nova-compute[72201]:       <entry name='serial'>0331ddd6-3aa1-47df-b1a3-4d539d26c708</entry>
Aug 01 15:22:59 user nova-compute[72201]:       <entry name='uuid'>0331ddd6-3aa1-47df-b1a3-4d539d26c708</entry>
Aug 01 15:22:59 user nova-compute[72201]:       <entry name='family'>Virtual Machine</entry>
Aug 01 15:22:59 user nova-compute[72201]:     </system>
Aug 01 15:22:59 user nova-compute[72201]:   </sysinfo>
Aug 01 15:22:59 user nova-compute[72201]:   <os>
Aug 01 15:22:59 user nova-compute[72201]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 15:22:59 user nova-compute[72201]:     <boot dev='hd'/>
Aug 01 15:22:59 user nova-compute[72201]:     <smbios mode='sysinfo'/>
Aug 01 15:22:59 user nova-compute[72201]:   </os>
Aug 01 15:22:59 user nova-compute[72201]:   <features>
Aug 01 15:22:59 user nova-compute[72201]:     <acpi/>
Aug 01 15:22:59 user nova-compute[72201]:     <apic/>
Aug 01 15:22:59 user nova-compute[72201]:     <vmcoreinfo state='on'/>
Aug 01 15:22:59 user nova-compute[72201]:   </features>
Aug 01 15:22:59 user nova-compute[72201]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 15:22:59 user nova-compute[72201]:     <model fallback='forbid'>Nehalem</model>
Aug 01 15:22:59 user nova-compute[72201]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 15:22:59 user nova-compute[72201]:     <feature policy='require' name='vme'/>
Aug 01 15:22:59 user nova-compute[72201]:     <feature policy='require' name='x2apic'/>
Aug 01 15:22:59 user nova-compute[72201]:     <feature policy='require' name='hypervisor'/>
Aug 01 15:22:59 user nova-compute[72201]:   </cpu>
Aug 01 15:22:59 user nova-compute[72201]:   <clock offset='utc'>
Aug 01 15:22:59 user nova-compute[72201]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 15:22:59 user nova-compute[72201]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 15:22:59 user nova-compute[72201]:     <timer name='hpet' present='no'/>
Aug 01 15:22:59 user nova-compute[72201]:   </clock>
Aug 01 15:22:59 user nova-compute[72201]:   <on_poweroff>destroy</on_poweroff>
Aug 01 15:22:59 user nova-compute[72201]:   <on_reboot>restart</on_reboot>
Aug 01 15:22:59 user nova-compute[72201]:   <on_crash>destroy</on_crash>
Aug 01 15:22:59 user nova-compute[72201]:   <devices>
Aug 01 15:22:59 user nova-compute[72201]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 15:22:59 user nova-compute[72201]:     <disk type='file' device='disk'>
Aug 01 15:22:59 user nova-compute[72201]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 15:22:59 user nova-compute[72201]:       <source file='/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk' index='2'/>
Aug 01 15:22:59 user nova-compute[72201]:       <backingStore type='file' index='3'>
Aug 01 15:22:59 user nova-compute[72201]:         <format type='raw'/>
Aug 01 15:22:59 user nova-compute[72201]:         <source file='/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba'/>
Aug 01 15:22:59 user nova-compute[72201]:         <backingStore/>
Aug 01 15:22:59 user nova-compute[72201]:       </backingStore>
Aug 01 15:22:59 user nova-compute[72201]:       <target dev='vda' bus='virtio'/>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='virtio-disk0'/>
Aug 01 15:22:59 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </disk>
Aug 01 15:22:59 user nova-compute[72201]:     <disk type='file' device='cdrom'>
Aug 01 15:22:59 user nova-compute[72201]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 15:22:59 user nova-compute[72201]:       <source file='/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk.config' index='1'/>
Aug 01 15:22:59 user nova-compute[72201]:       <backingStore/>
Aug 01 15:22:59 user nova-compute[72201]:       <target dev='hda' bus='ide'/>
Aug 01 15:22:59 user nova-compute[72201]:       <readonly/>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='ide0-0-0'/>
Aug 01 15:22:59 user nova-compute[72201]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </disk>
Aug 01 15:22:59 user nova-compute[72201]:     <controller type='usb' index='0' model='none'>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='usb'/>
Aug 01 15:22:59 user nova-compute[72201]:     </controller>
Aug 01 15:22:59 user nova-compute[72201]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='pci.0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </controller>
Aug 01 15:22:59 user nova-compute[72201]:     <controller type='ide' index='0'>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='ide'/>
Aug 01 15:22:59 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 15:22:59 user nova-compute[72201]:     </controller>
Aug 01 15:22:59 user nova-compute[72201]:     <interface type='ethernet'>
Aug 01 15:22:59 user nova-compute[72201]:       <mac address='fa:16:3e:b4:92:64'/>
Aug 01 15:22:59 user nova-compute[72201]:       <target dev='tap1740420d-31'/>
Aug 01 15:22:59 user nova-compute[72201]:       <model type='virtio'/>
Aug 01 15:22:59 user nova-compute[72201]:       <mtu size='1442'/>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='net0'/>
Aug 01 15:22:59 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </interface>
Aug 01 15:22:59 user nova-compute[72201]:     <serial type='pty'>
Aug 01 15:22:59 user nova-compute[72201]:       <source path='/dev/pts/8'/>
Aug 01 15:22:59 user nova-compute[72201]:       <log file='/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/console.log' append='off'/>
Aug 01 15:22:59 user nova-compute[72201]:       <target type='isa-serial' port='0'>
Aug 01 15:22:59 user nova-compute[72201]:         <model name='isa-serial'/>
Aug 01 15:22:59 user nova-compute[72201]:       </target>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='serial0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </serial>
Aug 01 15:22:59 user nova-compute[72201]:     <console type='pty' tty='/dev/pts/8'>
Aug 01 15:22:59 user nova-compute[72201]:       <source path='/dev/pts/8'/>
Aug 01 15:22:59 user nova-compute[72201]:       <log file='/opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/console.log' append='off'/>
Aug 01 15:22:59 user nova-compute[72201]:       <target type='serial' port='0'/>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='serial0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </console>
Aug 01 15:22:59 user nova-compute[72201]:     <input type='mouse' bus='ps2'>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='input0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </input>
Aug 01 15:22:59 user nova-compute[72201]:     <input type='keyboard' bus='ps2'>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='input1'/>
Aug 01 15:22:59 user nova-compute[72201]:     </input>
Aug 01 15:22:59 user nova-compute[72201]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 01 15:22:59 user nova-compute[72201]:       <listen type='address' address='0.0.0.0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </graphics>
Aug 01 15:22:59 user nova-compute[72201]:     <audio id='1' type='none'/>
Aug 01 15:22:59 user nova-compute[72201]:     <video>
Aug 01 15:22:59 user nova-compute[72201]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='video0'/>
Aug 01 15:22:59 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </video>
Aug 01 15:22:59 user nova-compute[72201]:     <memballoon model='virtio'>
Aug 01 15:22:59 user nova-compute[72201]:       <stats period='10'/>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='balloon0'/>
Aug 01 15:22:59 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </memballoon>
Aug 01 15:22:59 user nova-compute[72201]:     <rng model='virtio'>
Aug 01 15:22:59 user nova-compute[72201]:       <backend model='random'>/dev/urandom</backend>
Aug 01 15:22:59 user nova-compute[72201]:       <alias name='rng0'/>
Aug 01 15:22:59 user nova-compute[72201]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 15:22:59 user nova-compute[72201]:     </rng>
Aug 01 15:22:59 user nova-compute[72201]:   </devices>
Aug 01 15:22:59 user nova-compute[72201]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 15:22:59 user nova-compute[72201]:     <label>libvirt-0331ddd6-3aa1-47df-b1a3-4d539d26c708</label>
Aug 01 15:22:59 user nova-compute[72201]:     <imagelabel>libvirt-0331ddd6-3aa1-47df-b1a3-4d539d26c708</imagelabel>
Aug 01 15:22:59 user nova-compute[72201]:   </seclabel>
Aug 01 15:22:59 user nova-compute[72201]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 15:22:59 user nova-compute[72201]:     <label>+64055:+108</label>
Aug 01 15:22:59 user nova-compute[72201]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 15:22:59 user nova-compute[72201]:   </seclabel>
Aug 01 15:22:59 user nova-compute[72201]: </domain>
Aug 01 15:22:59 user nova-compute[72201]:  {{(pid=72201) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 15:22:59 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [req-bd26b39a-9571-4188-899a-d8d208a45166 req-df12b857-a50c-4b09-b0bb-109e528e48fd service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Detaching interface fa:16:3e:04:b9:af failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap09878043-d7' not found.
Aug 01 15:22:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [req-bd26b39a-9571-4188-899a-d8d208a45166 req-df12b857-a50c-4b09-b0bb-109e528e48fd service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550987008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550987008',id=9,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKW0L2BXVsQ16XJ1IgW7J0+ugbX8pR23c/F0Bw5rv53o6+cDAxLCYwwmfBY+G8LBeeB3d6298OqDBKDi82m1vX50J7S1dTl4hFC+o+fm8gp01ukaYRBYhLpJ7oFuNVTSw==',key_name='tempest-keypair-1696360347',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:20:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1ec3967bfce4075a5b38e1f0ec13907',ramdisk_id='',reservation_id='r-7ql6n7s4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1871630489',owner_user_name='tempest-TaggedAttachmentsTest-1871630489-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:20:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecc1134a7e7a4eca98878addce19027b',uuid=0331ddd6-3aa1-47df-b1a3-4d539d26c708,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "address": "fa:16:3e:04:b9:af", "network": {"id": "67aa96c4-5c47-4351-98f2-d12a3d541e4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-672712741", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09878043-d7", "ovs_interfaceid": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [req-bd26b39a-9571-4188-899a-d8d208a45166 req-df12b857-a50c-4b09-b0bb-109e528e48fd service nova] Converting VIF {"id": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "address": "fa:16:3e:04:b9:af", "network": {"id": "67aa96c4-5c47-4351-98f2-d12a3d541e4c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-672712741", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09878043-d7", "ovs_interfaceid": "09878043-d7f1-4c0e-9c59-30eb516eb05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [req-bd26b39a-9571-4188-899a-d8d208a45166 req-df12b857-a50c-4b09-b0bb-109e528e48fd service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:b9:af,bridge_name='br-int',has_traffic_filtering=True,id=09878043-d7f1-4c0e-9c59-30eb516eb05a,network=Network(67aa96c4-5c47-4351-98f2-d12a3d541e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09878043-d7') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG os_vif [req-bd26b39a-9571-4188-899a-d8d208a45166 req-df12b857-a50c-4b09-b0bb-109e528e48fd service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:b9:af,bridge_name='br-int',has_traffic_filtering=True,id=09878043-d7f1-4c0e-9c59-30eb516eb05a,network=Network(67aa96c4-5c47-4351-98f2-d12a3d541e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09878043-d7') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09878043-d7, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:22:59 user nova-compute[72201]: INFO os_vif [req-bd26b39a-9571-4188-899a-d8d208a45166 req-df12b857-a50c-4b09-b0bb-109e528e48fd service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:b9:af,bridge_name='br-int',has_traffic_filtering=True,id=09878043-d7f1-4c0e-9c59-30eb516eb05a,network=Network(67aa96c4-5c47-4351-98f2-d12a3d541e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09878043-d7')
Aug 01 15:22:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [req-bd26b39a-9571-4188-899a-d8d208a45166 req-df12b857-a50c-4b09-b0bb-109e528e48fd service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:22:59 user nova-compute[72201]:   <nova:package version="0.0.0"/>
Aug 01 15:22:59 user nova-compute[72201]:   <nova:name>tempest-device-tagging-server-550987008</nova:name>
Aug 01 15:22:59 user nova-compute[72201]:   <nova:creationTime>2023-08-01 15:22:59</nova:creationTime>
Aug 01 15:22:59 user nova-compute[72201]:   <nova:flavor name="m1.tiny">
Aug 01 15:22:59 user nova-compute[72201]:     <nova:memory>512</nova:memory>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:disk>1</nova:disk>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:swap>0</nova:swap>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:vcpus>1</nova:vcpus>
Aug 01 15:22:59 user nova-compute[72201]:   </nova:flavor>
Aug 01 15:22:59 user nova-compute[72201]:   <nova:owner>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:user uuid="ecc1134a7e7a4eca98878addce19027b">tempest-TaggedAttachmentsTest-1871630489-project-member</nova:user>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:project uuid="a1ec3967bfce4075a5b38e1f0ec13907">tempest-TaggedAttachmentsTest-1871630489</nova:project>
Aug 01 15:22:59 user nova-compute[72201]:   </nova:owner>
Aug 01 15:22:59 user nova-compute[72201]:   <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:22:59 user nova-compute[72201]:   <nova:ports>
Aug 01 15:22:59 user nova-compute[72201]:     <nova:port uuid="1740420d-31a4-494e-a19f-965960ba2b7c">
Aug 01 15:22:59 user nova-compute[72201]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 15:22:59 user nova-compute[72201]:     </nova:port>
Aug 01 15:22:59 user nova-compute[72201]:   </nova:ports>
Aug 01 15:22:59 user nova-compute[72201]: </nova:instance>
Aug 01 15:22:59 user nova-compute[72201]:  {{(pid=72201) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 01 15:22:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] COPY block job progress, current cursor: 326107136 final cursor: 1073741824 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:23:00 user nova-compute[72201]: DEBUG nova.network.neutron [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Updating instance_info_cache with network_info: [{"id": "1740420d-31a4-494e-a19f-965960ba2b7c", "address": "fa:16:3e:b4:92:64", "network": {"id": "acf9d14a-8412-4dc0-80f9-ddfe2774470e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2056245363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1740420d-31", "ovs_interfaceid": "1740420d-31a4-494e-a19f-965960ba2b7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:23:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Releasing lock "refresh_cache-0331ddd6-3aa1-47df-b1a3-4d539d26c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:23:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-98025219-e8c3-445f-bc36-973bd019ea81 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "interface-0331ddd6-3aa1-47df-b1a3-4d539d26c708-09878043-d7f1-4c0e-9c59-30eb516eb05a" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.083s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] COPY block job progress, current cursor: 506462208 final cursor: 1073741824 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:23:00 user nova-compute[72201]: DEBUG nova.compute.manager [req-304271d4-6a93-44f7-8180-00e1f118c469 req-439039a1-0c2c-47b6-b172-3b68f0b4ee19 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Received event network-vif-plugged-09878043-d7f1-4c0e-9c59-30eb516eb05a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-304271d4-6a93-44f7-8180-00e1f118c469 req-439039a1-0c2c-47b6-b172-3b68f0b4ee19 service nova] Acquiring lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-304271d4-6a93-44f7-8180-00e1f118c469 req-439039a1-0c2c-47b6-b172-3b68f0b4ee19 service nova] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-304271d4-6a93-44f7-8180-00e1f118c469 req-439039a1-0c2c-47b6-b172-3b68f0b4ee19 service nova] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:00 user nova-compute[72201]: DEBUG nova.compute.manager [req-304271d4-6a93-44f7-8180-00e1f118c469 req-439039a1-0c2c-47b6-b172-3b68f0b4ee19 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] No waiting events found dispatching network-vif-plugged-09878043-d7f1-4c0e-9c59-30eb516eb05a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:00 user nova-compute[72201]: WARNING nova.compute.manager [req-304271d4-6a93-44f7-8180-00e1f118c469 req-439039a1-0c2c-47b6-b172-3b68f0b4ee19 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Received unexpected event network-vif-plugged-09878043-d7f1-4c0e-9c59-30eb516eb05a for instance with vm_state active and task_state None.
Aug 01 15:23:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] COPY block job progress, current cursor: 679477248 final cursor: 1073741824 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:23:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] COPY block job progress, current cursor: 831520768 final cursor: 1073741824 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:23:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] COPY block job progress, current cursor: 979369984 final cursor: 1073741824 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZgXQRfoz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:23:02 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:23:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9fcf39-7559-4617-9ad8-c7f01114ce18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4315a8bf-1e28-4b84-8474-cb4cb0af0447]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:23:02 user nova-compute[72201]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 (non-flash)
Aug 01 15:23:02 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:23:02 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:23:02 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:23:02 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:23:02 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:02 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:23:02 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:23:02 user nova-compute[72201]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 (non-flash)
Aug 01 15:23:02 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:23:02 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:23:02 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:23:02 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:23:02 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:02 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:23:02 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc549da6170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173'): ({'sdi'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Removing single pathed devices sdi {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea0b6a0-898f-40b9-b9c4-362e18bd211e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ede3f8d-6a45-497c-9474-9025f265f7f4]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Flushing IO for device /dev/sdi {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47e041e-ec08-4c0c-89d1-388b0d5548be]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.037s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[794f9c3b-1650-45d4-9ad3-6ec223772a14]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] SCSI volumes sdi have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4b8a2b-7e11-47fe-8541-9c6f3611c1f4]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdeab7f-5c5f-4296-a083-66766c74f6a6]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173, portal: 172.16.0.220,3260]
Aug 01 15:23:02 user nova-compute[72201]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173, portal: 172.16.0.220,3260] successful.
Aug 01 15:23:02 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa22a21d-d920-4eec-9215-5a95d93d76b9]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] <== disconnect_volume: return (335ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnpbEAPS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'c918ea78-9bf8-421c-9a31-0da4104cd032', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad0b1fd0-5b38-4413-b8c1-c2249dc2af29', 'serial'} {{(pid=72201) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 01 15:23:02 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] swap_volume: removing Cinder connection for volume ed367a8f-c51c-4cbf-8d75-92424ab21173 {{(pid=72201) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 01 15:23:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:03 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] swap_volume: Updating volume ed367a8f-c51c-4cbf-8d75-92424ab21173 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "jnpbEAPS", "auth_password": "AFeZ20s6LvhCHD", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "ad0b1fd0-5b38-4413-b8c1-c2249dc2af29"}, "status": "reserved", "instance": "c918ea78-9bf8-421c-9a31-0da4104cd032", "attached_at": "", "detached_at": "", "volume_id": "ad0b1fd0-5b38-4413-b8c1-c2249dc2af29", "serial": "ad0b1fd0-5b38-4413-b8c1-c2249dc2af29"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ad0b1fd0-5b38-4413-b8c1-c2249dc2af29', 'no_device': None, 'attachment_id': '5203753a-1066-426f-886b-45b878be8f27'} {{(pid=72201) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 01 15:23:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9027ca76-e896-438c-9604-6d7ac473e42b tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.333s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Acquiring lock "c918ea78-9bf8-421c-9a31-0da4104cd032" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG os_brick.utils [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfaac9e3-f485-4901-a988-ff206e9405c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[282a486d-3872-4211-883f-d2d73e920c51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[615a7a57-3550-4c09-a895-3faf6b451503]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[132b9559-e034-45f9-9256-45a2a90428a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:23:04 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:23:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b498b6d-eccd-4321-8202-e8edb6f169c9]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:23:04 user nova-compute[72201]: DEBUG os_brick.utils [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:23:04 user nova-compute[72201]: INFO nova.compute.manager [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Swapping volume ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 for ed367a8f-c51c-4cbf-8d75-92424ab21173
Aug 01 15:23:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:07 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903372.17352, e2846f03-5074-495b-831f-734dd477dc18 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:23:07 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: e2846f03-5074-495b-831f-734dd477dc18] VM Stopped (Lifecycle Event)
Aug 01 15:23:07 user nova-compute[72201]: DEBUG nova.compute.manager [None req-b1285756-e7f2-452e-a487-bd957269f8e3 None None] [instance: e2846f03-5074-495b-831f-734dd477dc18] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:23:07 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:23:07 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:23:07 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:23:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-e2ca19ea-868c-40ad-a453-f6e348cfac15" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:23:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-e2ca19ea-868c-40ad-a453-f6e348cfac15" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:23:07 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Updating instance_info_cache with network_info: [{"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-e2ca19ea-868c-40ad-a453-f6e348cfac15" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.243s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:23:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:23:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:23:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:23:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:23:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:23:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:23:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:11 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:23:11 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:23:11 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=6966MB free_disk=25.584033966064453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:23:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:11 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance b64f1cfb-64f2-4493-8721-fc63fcd93bb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:23:11 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e2ca19ea-868c-40ad-a453-f6e348cfac15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:23:11 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 0f059ccc-f609-4cf3-a644-c3d1305ae26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:23:11 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 02d227b0-2b25-467f-a318-ab46aa391a31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:23:11 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance c918ea78-9bf8-421c-9a31-0da4104cd032 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:23:11 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 0331ddd6-3aa1-47df-b1a3-4d539d26c708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:23:11 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 45a40359-7496-44f6-ae86-a77f991e5106 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:23:11 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 44cde39a-a94b-4fd8-8747-def0a68d77df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:23:11 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance d86ed500-ec1a-4e2c-a137-7a654ada6e11 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:23:11 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 3e869e37-c921-48e3-b89a-946bbcc1a5ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:23:11 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:23:11 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:23:12 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:23:12 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:23:12 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:23:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZgXQRfoz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c918ea78-9bf8-421c-9a31-0da4104cd032', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed367a8f-c51c-4cbf-8d75-92424ab21173', 'serial': 'ed367a8f-c51c-4cbf-8d75-92424ab21173'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnpbEAPS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'ad0b1fd0-5b38-4413-b8c1-c2249dc2af29'}, 'status': 'reserved', 'instance': 'c918ea78-9bf8-421c-9a31-0da4104cd032', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad0b1fd0-5b38-4413-b8c1-c2249dc2af29', 'serial'} {{(pid=72201) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 01 15:23:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:23:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZgXQRfoz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:23:12 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:23:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:23:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:23:12 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:23:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:23:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:23:12 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:23:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf50d13-b7bb-4529-b164-9c132be42525]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:23:12 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d797cbfa-6804-4096-8f39-6c3c717cd267]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173] added
Aug 01 15:23:12 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a49265-c717-470f-a10c-0a1373d129d9]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e218576a-4c31-479b-836d-64620280f55f]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZgXQRfoz {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZgXQRfoz" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a807be0-6fe8-45f5-ab5d-50055ccd1ca8]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZgXQRfoz'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60a98bd-6edd-4c32-8298-2c0c06499673]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56a4fb4-4eed-4ce1-8cfd-9f6d527627ce]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d865bf5-3243-4ed0-ae9b-da2db70d19ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173, portal: 172.16.0.220,3260]
Aug 01 15:23:13 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173, portal: 172.16.0.220,3260] successful.
Aug 01 15:23:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db09587-9dbc-4f6e-b3ac-5d8bae74fa8a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[209d4b94-9bc0-4b7e-a086-40db925c86b5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:23:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] HCTL ('40', '-', '-', 0) found on session 14 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c21207-d5f8-4344-afe2-a5bfb8ad150b]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Searching for a device in session 14 and hctl ['40', '*', '*', 0] yield: None {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Searching for a device in session 14 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:23:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZgXQRfoz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:23:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:23:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26430396131346539', 'path': '/dev/sdi'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:23:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430396131346539', 'path': '/dev/sdi'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:23:14 user nova-compute[72201]: DEBUG nova.objects.instance [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Lazy-loading 'flavor' on Instance uuid c918ea78-9bf8-421c-9a31-0da4104cd032 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:23:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:23:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] COPY block job progress, current cursor: 182452224 final cursor: 1073741824 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:23:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] COPY block job progress, current cursor: 373293056 final cursor: 1073741824 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:23:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] COPY block job progress, current cursor: 502267904 final cursor: 1073741824 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:23:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] COPY block job progress, current cursor: 641728512 final cursor: 1073741824 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:23:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "d4146775-a271-4822-84ec-e723ff09c386" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "d4146775-a271-4822-84ec-e723ff09c386" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:23:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:17 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:23:17 user nova-compute[72201]: INFO nova.compute.claims [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Claim successful on node user
Aug 01 15:23:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] COPY block job progress, current cursor: 794820608 final cursor: 1073741824 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:23:17 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:23:17 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:23:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] COPY block job progress, current cursor: 988807168 final cursor: 1073741824 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:23:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.687s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:23:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:23:17 user nova-compute[72201]: DEBUG nova.network.neutron [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:23:17 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:23:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:23:18 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Creating image(s)
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "/opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "/opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG nova.policy [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fd505dbb02e4d3d8e8f97839b25ed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548641aee9954aa48c567e798b4be247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.147s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnpbEAPS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'ad0b1fd0-5b38-4413-b8c1-c2249dc2af29'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:23:18 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:23:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk 1073741824" returned: 0 in 0.046s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc40b6b-5d3a-4217-b60c-2ddcae298ddb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceea89df-6f5e-478f-8622-cd33fd3b61af]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 (non-flash)
Aug 01 15:23:18 user nova-compute[72201]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:23:18 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:23:18 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:23:18 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:23:18 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:23:18 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:18 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:23:18 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 (non-flash)
Aug 01 15:23:18 user nova-compute[72201]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:23:18 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:23:18 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:23:18 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:23:18 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:23:18 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:18 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:23:18 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc549da5990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29'): ({'sdh'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Removing single pathed devices sdh {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcaf2de-4129-430a-8acb-264afb4cb68c]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c0cf02-fec6-4174-9940-9be679416730]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Flushing IO for device /dev/sdh {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.131s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b340560c-6713-4b30-8e96-2f140029f45f]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG nova.compute.manager [req-15eb31aa-2870-4d05-99cd-15fb35a6111b req-443f9330-d5f3-499a-b157-191e416608a9 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-changed-12cc53e2-1a6d-455c-9737-dd4a14957fa0 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG nova.compute.manager [req-15eb31aa-2870-4d05-99cd-15fb35a6111b req-443f9330-d5f3-499a-b157-191e416608a9 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Refreshing instance network info cache due to event network-changed-12cc53e2-1a6d-455c-9737-dd4a14957fa0. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-15eb31aa-2870-4d05-99cd-15fb35a6111b req-443f9330-d5f3-499a-b157-191e416608a9 service nova] Acquiring lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-15eb31aa-2870-4d05-99cd-15fb35a6111b req-443f9330-d5f3-499a-b157-191e416608a9 service nova] Acquired lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG nova.network.neutron [req-15eb31aa-2870-4d05-99cd-15fb35a6111b req-443f9330-d5f3-499a-b157-191e416608a9 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Refreshing network info cache for port 12cc53e2-1a6d-455c-9737-dd4a14957fa0 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.059s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[22decdff-96c4-4aa2-97a8-c20380480922]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] SCSI volumes sdh have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[14474839-2400-408c-b0f8-8b0fb1983a26]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Cannot resize image /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG nova.objects.instance [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lazy-loading 'migration_context' on Instance uuid d4146775-a271-4822-84ec-e723ff09c386 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Ensure instance console log exists: /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG nova.network.neutron [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Successfully created port: befcc650-86a7-49a1-b877-7fd179b494e4 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18ba752-e7b0-4843-932a-3f5ae4e9711f]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29, portal: 172.16.0.220,3260]
Aug 01 15:23:18 user nova-compute[72201]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29, portal: 172.16.0.220,3260] successful.
Aug 01 15:23:18 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb111a5-e088-4a58-a703-8ce123ba86ee]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] <== disconnect_volume: return (384ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZgXQRfoz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'c918ea78-9bf8-421c-9a31-0da4104cd032', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed367a8f-c51c-4cbf-8d75-92424ab21173', 'serial'} {{(pid=72201) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 01 15:23:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] swap_volume: removing Cinder connection for volume ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 {{(pid=72201) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 01 15:23:19 user nova-compute[72201]: DEBUG nova.network.neutron [req-15eb31aa-2870-4d05-99cd-15fb35a6111b req-443f9330-d5f3-499a-b157-191e416608a9 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Updated VIF entry in instance network info cache for port 12cc53e2-1a6d-455c-9737-dd4a14957fa0. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:23:19 user nova-compute[72201]: DEBUG nova.network.neutron [req-15eb31aa-2870-4d05-99cd-15fb35a6111b req-443f9330-d5f3-499a-b157-191e416608a9 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Updating instance_info_cache with network_info: [{"id": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "address": "fa:16:3e:5c:9c:8c", "network": {"id": "dd813b4b-a3e3-44c9-839b-1eab4b536882", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1931202477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12cc53e2-1a", "ovs_interfaceid": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e420509-edf8-4398-892b-ee3e4ebb450d", "address": "fa:16:3e:b2:af:3c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e420509-ed", "ovs_interfaceid": "6e420509-edf8-4398-892b-ee3e4ebb450d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28037956-d408-4d2b-9ea8-76dda5239b9b", "address": "fa:16:3e:3f:1c:0c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28037956-d4", "ovs_interfaceid": "28037956-d408-4d2b-9ea8-76dda5239b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "address": "fa:16:3e:c9:09:37", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3cbe0f-91", "ovs_interfaceid": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "address": "fa:16:3e:49:dc:99", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc347a8-bb", "ovs_interfaceid": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "address": "fa:16:3e:c5:f9:56", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2b6f03-3c", "ovs_interfaceid": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "address": "fa:16:3e:0f:d2:23", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3dbdee9-e9", "ovs_interfaceid": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:23:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-15eb31aa-2870-4d05-99cd-15fb35a6111b req-443f9330-d5f3-499a-b157-191e416608a9 service nova] Releasing lock "refresh_cache-45a40359-7496-44f6-ae86-a77f991e5106" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:23:19 user nova-compute[72201]: DEBUG nova.compute.manager [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] swap_volume: Updating volume ad0b1fd0-5b38-4413-b8c1-c2249dc2af29 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "ZgXQRfoz", "auth_password": "xFRrOq1i7KjM53", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "ed367a8f-c51c-4cbf-8d75-92424ab21173"}, "status": "reserved", "instance": "c918ea78-9bf8-421c-9a31-0da4104cd032", "attached_at": "", "detached_at": "", "volume_id": "ed367a8f-c51c-4cbf-8d75-92424ab21173", "serial": "ed367a8f-c51c-4cbf-8d75-92424ab21173"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ed367a8f-c51c-4cbf-8d75-92424ab21173', 'no_device': None, 'attachment_id': '1b374ff1-6fb8-406b-8c30-097fd52443f2'} {{(pid=72201) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 01 15:23:19 user nova-compute[72201]: DEBUG nova.network.neutron [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Successfully updated port: befcc650-86a7-49a1-b877-7fd179b494e4 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:23:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-dfff7f36-ed84-4149-aefc-d416319683ee tempest-TestVolumeSwap-518151253 tempest-TestVolumeSwap-518151253-project-admin] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.305s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "refresh_cache-d4146775-a271-4822-84ec-e723ff09c386" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:23:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquired lock "refresh_cache-d4146775-a271-4822-84ec-e723ff09c386" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:23:19 user nova-compute[72201]: DEBUG nova.network.neutron [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:23:19 user nova-compute[72201]: DEBUG nova.compute.manager [req-d8d95d3f-ec0b-479c-b8d2-f915f817bed3 req-e2071240-a25d-4b0a-8184-71e00987919f service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Received event network-changed-befcc650-86a7-49a1-b877-7fd179b494e4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:19 user nova-compute[72201]: DEBUG nova.compute.manager [req-d8d95d3f-ec0b-479c-b8d2-f915f817bed3 req-e2071240-a25d-4b0a-8184-71e00987919f service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Refreshing instance network info cache due to event network-changed-befcc650-86a7-49a1-b877-7fd179b494e4. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:23:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d8d95d3f-ec0b-479c-b8d2-f915f817bed3 req-e2071240-a25d-4b0a-8184-71e00987919f service nova] Acquiring lock "refresh_cache-d4146775-a271-4822-84ec-e723ff09c386" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:23:19 user nova-compute[72201]: DEBUG nova.network.neutron [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.network.neutron [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Updating instance_info_cache with network_info: [{"id": "befcc650-86a7-49a1-b877-7fd179b494e4", "address": "fa:16:3e:25:25:a5", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefcc650-86", "ovs_interfaceid": "befcc650-86a7-49a1-b877-7fd179b494e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Releasing lock "refresh_cache-d4146775-a271-4822-84ec-e723ff09c386" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.compute.manager [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Instance network_info: |[{"id": "befcc650-86a7-49a1-b877-7fd179b494e4", "address": "fa:16:3e:25:25:a5", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefcc650-86", "ovs_interfaceid": "befcc650-86a7-49a1-b877-7fd179b494e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d8d95d3f-ec0b-479c-b8d2-f915f817bed3 req-e2071240-a25d-4b0a-8184-71e00987919f service nova] Acquired lock "refresh_cache-d4146775-a271-4822-84ec-e723ff09c386" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.network.neutron [req-d8d95d3f-ec0b-479c-b8d2-f915f817bed3 req-e2071240-a25d-4b0a-8184-71e00987919f service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Refreshing network info cache for port befcc650-86a7-49a1-b877-7fd179b494e4 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Start _get_guest_xml network_info=[{"id": "befcc650-86a7-49a1-b877-7fd179b494e4", "address": "fa:16:3e:25:25:a5", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefcc650-86", "ovs_interfaceid": "befcc650-86a7-49a1-b877-7fd179b494e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:23:20 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:23:20 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:23:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-232907404',display_name='tempest-AttachVolumeNegativeTest-server-232907404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-232907404',id=14,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASYj7RarSxXe2Fm7m/BCygB8o+e8Htq3f8j2t0pCdJGLFf0W4hMn3JjVz61/uQr5toXcYBVfpZgNunxs2VLYdrnhjnEwSnm4ovuZioXY0x+ynhI8bX0uu2FChrls33wrw==',key_name='tempest-keypair-792720467',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548641aee9954aa48c567e798b4be247',ramdisk_id='',reservation_id='r-zk6ja004',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2028543234',owner_user_name='tempest-AttachVolumeNegativeTest-2028543234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:23:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd505dbb02e4d3d8e8f97839b25ed22',uuid=d4146775-a271-4822-84ec-e723ff09c386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "befcc650-86a7-49a1-b877-7fd179b494e4", "address": "fa:16:3e:25:25:a5", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefcc650-86", "ovs_interfaceid": "befcc650-86a7-49a1-b877-7fd179b494e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converting VIF {"id": "befcc650-86a7-49a1-b877-7fd179b494e4", "address": "fa:16:3e:25:25:a5", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefcc650-86", "ovs_interfaceid": "befcc650-86a7-49a1-b877-7fd179b494e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:25:a5,bridge_name='br-int',has_traffic_filtering=True,id=befcc650-86a7-49a1-b877-7fd179b494e4,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbefcc650-86') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.objects.instance [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lazy-loading 'pci_devices' on Instance uuid d4146775-a271-4822-84ec-e723ff09c386 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:23:20 user nova-compute[72201]:   <uuid>d4146775-a271-4822-84ec-e723ff09c386</uuid>
Aug 01 15:23:20 user nova-compute[72201]:   <name>instance-0000000e</name>
Aug 01 15:23:20 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:23:20 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:23:20 user nova-compute[72201]:   <metadata>
Aug 01 15:23:20 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:23:20 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:23:20 user nova-compute[72201]:       <nova:name>tempest-AttachVolumeNegativeTest-server-232907404</nova:name>
Aug 01 15:23:20 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:23:20</nova:creationTime>
Aug 01 15:23:20 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:23:20 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:23:20 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:23:20 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:23:20 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:23:20 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:23:20 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:23:20 user nova-compute[72201]:       <nova:owner>
Aug 01 15:23:20 user nova-compute[72201]:         <nova:user uuid="6fd505dbb02e4d3d8e8f97839b25ed22">tempest-AttachVolumeNegativeTest-2028543234-project-member</nova:user>
Aug 01 15:23:20 user nova-compute[72201]:         <nova:project uuid="548641aee9954aa48c567e798b4be247">tempest-AttachVolumeNegativeTest-2028543234</nova:project>
Aug 01 15:23:20 user nova-compute[72201]:       </nova:owner>
Aug 01 15:23:20 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:23:20 user nova-compute[72201]:       <nova:ports>
Aug 01 15:23:20 user nova-compute[72201]:         <nova:port uuid="befcc650-86a7-49a1-b877-7fd179b494e4">
Aug 01 15:23:20 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 15:23:20 user nova-compute[72201]:         </nova:port>
Aug 01 15:23:20 user nova-compute[72201]:       </nova:ports>
Aug 01 15:23:20 user nova-compute[72201]:     </nova:instance>
Aug 01 15:23:20 user nova-compute[72201]:   </metadata>
Aug 01 15:23:20 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:23:20 user nova-compute[72201]:     <system>
Aug 01 15:23:20 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:23:20 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:23:20 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:23:20 user nova-compute[72201]:       <entry name="serial">d4146775-a271-4822-84ec-e723ff09c386</entry>
Aug 01 15:23:20 user nova-compute[72201]:       <entry name="uuid">d4146775-a271-4822-84ec-e723ff09c386</entry>
Aug 01 15:23:20 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:23:20 user nova-compute[72201]:     </system>
Aug 01 15:23:20 user nova-compute[72201]:   </sysinfo>
Aug 01 15:23:20 user nova-compute[72201]:   <os>
Aug 01 15:23:20 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:23:20 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:23:20 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:23:20 user nova-compute[72201]:   </os>
Aug 01 15:23:20 user nova-compute[72201]:   <features>
Aug 01 15:23:20 user nova-compute[72201]:     <acpi/>
Aug 01 15:23:20 user nova-compute[72201]:     <apic/>
Aug 01 15:23:20 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:23:20 user nova-compute[72201]:   </features>
Aug 01 15:23:20 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:23:20 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:23:20 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:23:20 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:23:20 user nova-compute[72201]:   </clock>
Aug 01 15:23:20 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:23:20 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:23:20 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:23:20 user nova-compute[72201]:   </cpu>
Aug 01 15:23:20 user nova-compute[72201]:   <devices>
Aug 01 15:23:20 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:23:20 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:23:20 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk"/>
Aug 01 15:23:20 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:23:20 user nova-compute[72201]:     </disk>
Aug 01 15:23:20 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:23:20 user nova-compute[72201]:       <mac address="fa:16:3e:25:25:a5"/>
Aug 01 15:23:20 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:23:20 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:23:20 user nova-compute[72201]:       <target dev="tapbefcc650-86"/>
Aug 01 15:23:20 user nova-compute[72201]:     </interface>
Aug 01 15:23:20 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:23:20 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/console.log" append="off"/>
Aug 01 15:23:20 user nova-compute[72201]:     </serial>
Aug 01 15:23:20 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:23:20 user nova-compute[72201]:     <video>
Aug 01 15:23:20 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:23:20 user nova-compute[72201]:     </video>
Aug 01 15:23:20 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:23:20 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:23:20 user nova-compute[72201]:     </rng>
Aug 01 15:23:20 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:23:20 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:23:20 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:23:20 user nova-compute[72201]:     </memballoon>
Aug 01 15:23:20 user nova-compute[72201]:   </devices>
Aug 01 15:23:20 user nova-compute[72201]: </domain>
Aug 01 15:23:20 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:23:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-232907404',display_name='tempest-AttachVolumeNegativeTest-server-232907404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-232907404',id=14,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASYj7RarSxXe2Fm7m/BCygB8o+e8Htq3f8j2t0pCdJGLFf0W4hMn3JjVz61/uQr5toXcYBVfpZgNunxs2VLYdrnhjnEwSnm4ovuZioXY0x+ynhI8bX0uu2FChrls33wrw==',key_name='tempest-keypair-792720467',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548641aee9954aa48c567e798b4be247',ramdisk_id='',reservation_id='r-zk6ja004',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2028543234',owner_user_name='tempest-AttachVolumeNegativeTest-2028543234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:23:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd505dbb02e4d3d8e8f97839b25ed22',uuid=d4146775-a271-4822-84ec-e723ff09c386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "befcc650-86a7-49a1-b877-7fd179b494e4", "address": "fa:16:3e:25:25:a5", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefcc650-86", "ovs_interfaceid": "befcc650-86a7-49a1-b877-7fd179b494e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converting VIF {"id": "befcc650-86a7-49a1-b877-7fd179b494e4", "address": "fa:16:3e:25:25:a5", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefcc650-86", "ovs_interfaceid": "befcc650-86a7-49a1-b877-7fd179b494e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:25:a5,bridge_name='br-int',has_traffic_filtering=True,id=befcc650-86a7-49a1-b877-7fd179b494e4,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbefcc650-86') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG os_vif [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:25:a5,bridge_name='br-int',has_traffic_filtering=True,id=befcc650-86a7-49a1-b877-7fd179b494e4,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbefcc650-86') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbefcc650-86, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbefcc650-86, col_values=(('external_ids', {'iface-id': 'befcc650-86a7-49a1-b877-7fd179b494e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:25:a5', 'vm-uuid': 'd4146775-a271-4822-84ec-e723ff09c386'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:20 user nova-compute[72201]: INFO os_vif [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:25:a5,bridge_name='br-int',has_traffic_filtering=True,id=befcc650-86a7-49a1-b877-7fd179b494e4,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbefcc650-86')
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] No VIF found with MAC fa:16:3e:25:25:a5, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.network.neutron [req-d8d95d3f-ec0b-479c-b8d2-f915f817bed3 req-e2071240-a25d-4b0a-8184-71e00987919f service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Updated VIF entry in instance network info cache for port befcc650-86a7-49a1-b877-7fd179b494e4. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.network.neutron [req-d8d95d3f-ec0b-479c-b8d2-f915f817bed3 req-e2071240-a25d-4b0a-8184-71e00987919f service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Updating instance_info_cache with network_info: [{"id": "befcc650-86a7-49a1-b877-7fd179b494e4", "address": "fa:16:3e:25:25:a5", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefcc650-86", "ovs_interfaceid": "befcc650-86a7-49a1-b877-7fd179b494e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d8d95d3f-ec0b-479c-b8d2-f915f817bed3 req-e2071240-a25d-4b0a-8184-71e00987919f service nova] Releasing lock "refresh_cache-d4146775-a271-4822-84ec-e723ff09c386" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "45a40359-7496-44f6-ae86-a77f991e5106" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:20 user nova-compute[72201]: INFO nova.compute.manager [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Terminating instance
Aug 01 15:23:20 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Acquiring lock "c918ea78-9bf8-421c-9a31-0da4104cd032" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:20 user nova-compute[72201]: INFO nova.compute.manager [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Detaching volume ed367a8f-c51c-4cbf-8d75-92424ab21173
Aug 01 15:23:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:21 user nova-compute[72201]: INFO nova.virt.block_device [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Attempting to driver detach volume ed367a8f-c51c-4cbf-8d75-92424ab21173 from mountpoint /dev/vdb
Aug 01 15:23:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Attempting to detach device vdb from instance c918ea78-9bf8-421c-9a31-0da4104cd032 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:23:21 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:23:21 user nova-compute[72201]:   <source dev="/dev/sdi"/>
Aug 01 15:23:21 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:23:21 user nova-compute[72201]:   <serial>ed367a8f-c51c-4cbf-8d75-92424ab21173</serial>
Aug 01 15:23:21 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:23:21 user nova-compute[72201]: </disk>
Aug 01 15:23:21 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:23:21 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Successfully detached device vdb from instance c918ea78-9bf8-421c-9a31-0da4104cd032 from the persistent domain config.
Aug 01 15:23:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c918ea78-9bf8-421c-9a31-0da4104cd032 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:23:21 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:23:21 user nova-compute[72201]:   <source dev="/dev/sdi"/>
Aug 01 15:23:21 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:23:21 user nova-compute[72201]:   <serial>ed367a8f-c51c-4cbf-8d75-92424ab21173</serial>
Aug 01 15:23:21 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:23:21 user nova-compute[72201]: </disk>
Aug 01 15:23:21 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-1821190b-2777-4864-96ed-4c06afd668b5 req-0ba56162-6d03-4074-8b9b-0588935b46f6 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-unplugged-12cc53e2-1a6d-455c-9737-dd4a14957fa0 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1821190b-2777-4864-96ed-4c06afd668b5 req-0ba56162-6d03-4074-8b9b-0588935b46f6 service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1821190b-2777-4864-96ed-4c06afd668b5 req-0ba56162-6d03-4074-8b9b-0588935b46f6 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1821190b-2777-4864-96ed-4c06afd668b5 req-0ba56162-6d03-4074-8b9b-0588935b46f6 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-1821190b-2777-4864-96ed-4c06afd668b5 req-0ba56162-6d03-4074-8b9b-0588935b46f6 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-unplugged-12cc53e2-1a6d-455c-9737-dd4a14957fa0 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-1821190b-2777-4864-96ed-4c06afd668b5 req-0ba56162-6d03-4074-8b9b-0588935b46f6 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-unplugged-12cc53e2-1a6d-455c-9737-dd4a14957fa0 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-063ebcaf-147b-4cc1-8539-557a8680fb75 req-c1f9477a-95f4-4ac9-b374-ed3a5a535130 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-unplugged-6e420509-edf8-4398-892b-ee3e4ebb450d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-063ebcaf-147b-4cc1-8539-557a8680fb75 req-c1f9477a-95f4-4ac9-b374-ed3a5a535130 service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-063ebcaf-147b-4cc1-8539-557a8680fb75 req-c1f9477a-95f4-4ac9-b374-ed3a5a535130 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-063ebcaf-147b-4cc1-8539-557a8680fb75 req-c1f9477a-95f4-4ac9-b374-ed3a5a535130 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-063ebcaf-147b-4cc1-8539-557a8680fb75 req-c1f9477a-95f4-4ac9-b374-ed3a5a535130 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-unplugged-6e420509-edf8-4398-892b-ee3e4ebb450d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-063ebcaf-147b-4cc1-8539-557a8680fb75 req-c1f9477a-95f4-4ac9-b374-ed3a5a535130 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-unplugged-6e420509-edf8-4398-892b-ee3e4ebb450d for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-201d4bfb-a630-495d-a4e9-ce717d2470a7 req-9cd47d7c-7a8d-426b-b4a7-199f3cc38cd9 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-unplugged-28037956-d408-4d2b-9ea8-76dda5239b9b {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-201d4bfb-a630-495d-a4e9-ce717d2470a7 req-9cd47d7c-7a8d-426b-b4a7-199f3cc38cd9 service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-201d4bfb-a630-495d-a4e9-ce717d2470a7 req-9cd47d7c-7a8d-426b-b4a7-199f3cc38cd9 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-201d4bfb-a630-495d-a4e9-ce717d2470a7 req-9cd47d7c-7a8d-426b-b4a7-199f3cc38cd9 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-201d4bfb-a630-495d-a4e9-ce717d2470a7 req-9cd47d7c-7a8d-426b-b4a7-199f3cc38cd9 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-unplugged-28037956-d408-4d2b-9ea8-76dda5239b9b {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-201d4bfb-a630-495d-a4e9-ce717d2470a7 req-9cd47d7c-7a8d-426b-b4a7-199f3cc38cd9 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-unplugged-28037956-d408-4d2b-9ea8-76dda5239b9b for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-201d4bfb-a630-495d-a4e9-ce717d2470a7 req-9cd47d7c-7a8d-426b-b4a7-199f3cc38cd9 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-plugged-28037956-d408-4d2b-9ea8-76dda5239b9b {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-201d4bfb-a630-495d-a4e9-ce717d2470a7 req-9cd47d7c-7a8d-426b-b4a7-199f3cc38cd9 service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-201d4bfb-a630-495d-a4e9-ce717d2470a7 req-9cd47d7c-7a8d-426b-b4a7-199f3cc38cd9 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-201d4bfb-a630-495d-a4e9-ce717d2470a7 req-9cd47d7c-7a8d-426b-b4a7-199f3cc38cd9 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-201d4bfb-a630-495d-a4e9-ce717d2470a7 req-9cd47d7c-7a8d-426b-b4a7-199f3cc38cd9 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-plugged-28037956-d408-4d2b-9ea8-76dda5239b9b {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:21 user nova-compute[72201]: WARNING nova.compute.manager [req-201d4bfb-a630-495d-a4e9-ce717d2470a7 req-9cd47d7c-7a8d-426b-b4a7-199f3cc38cd9 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received unexpected event network-vif-plugged-28037956-d408-4d2b-9ea8-76dda5239b9b for instance with vm_state active and task_state deleting.
Aug 01 15:23:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690903401.8917077, c918ea78-9bf8-421c-9a31-0da4104cd032 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c918ea78-9bf8-421c-9a31-0da4104cd032 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:21 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Successfully detached device vdb from instance c918ea78-9bf8-421c-9a31-0da4104cd032 from the live domain config.
Aug 01 15:23:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZgXQRfoz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'ed367a8f-c51c-4cbf-8d75-92424ab21173'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:23:21 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:23:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ee4a08-46c9-4bd4-b44d-52285489a502]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdccb2c-483f-41d8-a95f-578cf8369281]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:23:21 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:23:21 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:23:21 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:23:21 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:23:21 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:21 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:23:21 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 (non-flash)
Aug 01 15:23:21 user nova-compute[72201]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:23:21 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:23:21 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:23:21 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:23:21 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:21 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:23:21 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc54414f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173'): ({'sdi'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Removing single pathed devices sdi {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ed32b8-cfd6-41ad-8412-7f8717993b6d]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8e6a33-eb45-4ed7-a565-502525ab150c]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Flushing IO for device /dev/sdi {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6222884-1f99-49ef-92fa-1787bd1a8428]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.041s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b13766e-1803-406d-bcd4-508e4000a438]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] SCSI volumes sdi have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bdb42e-f6ce-475c-884c-9562cd2d085f]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7877222-7eb7-4ece-a643-c041aa4bb2b0]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173, portal: 172.16.0.220,3260]
Aug 01 15:23:22 user nova-compute[72201]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173, portal: 172.16.0.220,3260] successful.
Aug 01 15:23:22 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed367a8f-c51c-4cbf-8d75-92424ab21173 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d328db-3909-41e0-b4c9-c3f5ffe55f56]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] <== disconnect_volume: return (361ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:23:22 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Instance destroyed successfully.
Aug 01 15:23:22 user nova-compute[72201]: DEBUG nova.objects.instance [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lazy-loading 'resources' on Instance uuid 45a40359-7496-44f6-ae86-a77f991e5106 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2097729005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2097729005',id=10,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp1K/ORVcGLeOVNZLXDddd0H6aTpPgyDEIb1ynvVxfBr7TjGEofHSas3VzHl7WfFaIdXDza1M1ImDTGGDwP0YTIFxJ4VJA2DglK20QPjpeUjMA0Iz8F+wHOKnyAmm2JQw==',key_name='tempest-keypair-852805528',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:22:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e55bd6f4fa84c4da104a5a782bad7ff',ramdisk_id='',reservation_id='r-k6xe63iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-729948914',owner_user_name='tempest-TaggedBootDevicesTest-729948914-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffd657fbfccc4fc2a7f58a60bcada3df',uuid=45a40359-7496-44f6-ae86-a77f991e5106,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "address": "fa:16:3e:5c:9c:8c", "network": {"id": "dd813b4b-a3e3-44c9-839b-1eab4b536882", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1931202477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12cc53e2-1a", "ovs_interfaceid": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converting VIF {"id": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "address": "fa:16:3e:5c:9c:8c", "network": {"id": "dd813b4b-a3e3-44c9-839b-1eab4b536882", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1931202477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12cc53e2-1a", "ovs_interfaceid": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=12cc53e2-1a6d-455c-9737-dd4a14957fa0,network=Network(dd813b4b-a3e3-44c9-839b-1eab4b536882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12cc53e2-1a') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG os_vif [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=12cc53e2-1a6d-455c-9737-dd4a14957fa0,network=Network(dd813b4b-a3e3-44c9-839b-1eab4b536882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12cc53e2-1a') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12cc53e2-1a, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:22 user nova-compute[72201]: INFO os_vif [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=12cc53e2-1a6d-455c-9737-dd4a14957fa0,network=Network(dd813b4b-a3e3-44c9-839b-1eab4b536882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12cc53e2-1a')
Aug 01 15:23:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2097729005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2097729005',id=10,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp1K/ORVcGLeOVNZLXDddd0H6aTpPgyDEIb1ynvVxfBr7TjGEofHSas3VzHl7WfFaIdXDza1M1ImDTGGDwP0YTIFxJ4VJA2DglK20QPjpeUjMA0Iz8F+wHOKnyAmm2JQw==',key_name='tempest-keypair-852805528',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:22:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e55bd6f4fa84c4da104a5a782bad7ff',ramdisk_id='',reservation_id='r-k6xe63iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-729948914',owner_user_name='tempest-TaggedBootDevicesTest-729948914-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffd657fbfccc4fc2a7f58a60bcada3df',uuid=45a40359-7496-44f6-ae86-a77f991e5106,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e420509-edf8-4398-892b-ee3e4ebb450d", "address": "fa:16:3e:b2:af:3c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e420509-ed", "ovs_interfaceid": "6e420509-edf8-4398-892b-ee3e4ebb450d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converting VIF {"id": "6e420509-edf8-4398-892b-ee3e4ebb450d", "address": "fa:16:3e:b2:af:3c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e420509-ed", "ovs_interfaceid": "6e420509-edf8-4398-892b-ee3e4ebb450d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:3c,bridge_name='br-int',has_traffic_filtering=True,id=6e420509-edf8-4398-892b-ee3e4ebb450d,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e420509-ed') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG os_vif [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:3c,bridge_name='br-int',has_traffic_filtering=True,id=6e420509-edf8-4398-892b-ee3e4ebb450d,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e420509-ed') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e420509-ed, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:22 user nova-compute[72201]: INFO os_vif [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:af:3c,bridge_name='br-int',has_traffic_filtering=True,id=6e420509-edf8-4398-892b-ee3e4ebb450d,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e420509-ed')
Aug 01 15:23:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2097729005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2097729005',id=10,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp1K/ORVcGLeOVNZLXDddd0H6aTpPgyDEIb1ynvVxfBr7TjGEofHSas3VzHl7WfFaIdXDza1M1ImDTGGDwP0YTIFxJ4VJA2DglK20QPjpeUjMA0Iz8F+wHOKnyAmm2JQw==',key_name='tempest-keypair-852805528',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:22:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e55bd6f4fa84c4da104a5a782bad7ff',ramdisk_id='',reservation_id='r-k6xe63iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-729948914',owner_user_name='tempest-TaggedBootDevicesTest-729948914-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffd657fbfccc4fc2a7f58a60bcada3df',uuid=45a40359-7496-44f6-ae86-a77f991e5106,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28037956-d408-4d2b-9ea8-76dda5239b9b", "address": "fa:16:3e:3f:1c:0c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28037956-d4", "ovs_interfaceid": "28037956-d408-4d2b-9ea8-76dda5239b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converting VIF {"id": "28037956-d408-4d2b-9ea8-76dda5239b9b", "address": "fa:16:3e:3f:1c:0c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28037956-d4", "ovs_interfaceid": "28037956-d408-4d2b-9ea8-76dda5239b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:1c:0c,bridge_name='br-int',has_traffic_filtering=True,id=28037956-d408-4d2b-9ea8-76dda5239b9b,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap28037956-d4') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG os_vif [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:1c:0c,bridge_name='br-int',has_traffic_filtering=True,id=28037956-d408-4d2b-9ea8-76dda5239b9b,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap28037956-d4') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28037956-d4, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:22 user nova-compute[72201]: INFO os_vif [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:1c:0c,bridge_name='br-int',has_traffic_filtering=True,id=28037956-d408-4d2b-9ea8-76dda5239b9b,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap28037956-d4')
Aug 01 15:23:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2097729005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2097729005',id=10,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp1K/ORVcGLeOVNZLXDddd0H6aTpPgyDEIb1ynvVxfBr7TjGEofHSas3VzHl7WfFaIdXDza1M1ImDTGGDwP0YTIFxJ4VJA2DglK20QPjpeUjMA0Iz8F+wHOKnyAmm2JQw==',key_name='tempest-keypair-852805528',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:22:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e55bd6f4fa84c4da104a5a782bad7ff',ramdisk_id='',reservation_id='r-k6xe63iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-729948914',owner_user_name='tempest-TaggedBootDevicesTest-729948914-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffd657fbfccc4fc2a7f58a60bcada3df',uuid=45a40359-7496-44f6-ae86-a77f991e5106,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "address": "fa:16:3e:c9:09:37", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3cbe0f-91", "ovs_interfaceid": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converting VIF {"id": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "address": "fa:16:3e:c9:09:37", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3cbe0f-91", "ovs_interfaceid": "ef3cbe0f-91fd-488c-80d1-48609530c75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:09:37,bridge_name='br-int',has_traffic_filtering=True,id=ef3cbe0f-91fd-488c-80d1-48609530c75e,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3cbe0f-91') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG os_vif [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:09:37,bridge_name='br-int',has_traffic_filtering=True,id=ef3cbe0f-91fd-488c-80d1-48609530c75e,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3cbe0f-91') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef3cbe0f-91, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:23 user nova-compute[72201]: INFO os_vif [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:09:37,bridge_name='br-int',has_traffic_filtering=True,id=ef3cbe0f-91fd-488c-80d1-48609530c75e,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3cbe0f-91')
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2097729005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2097729005',id=10,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp1K/ORVcGLeOVNZLXDddd0H6aTpPgyDEIb1ynvVxfBr7TjGEofHSas3VzHl7WfFaIdXDza1M1ImDTGGDwP0YTIFxJ4VJA2DglK20QPjpeUjMA0Iz8F+wHOKnyAmm2JQw==',key_name='tempest-keypair-852805528',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:22:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e55bd6f4fa84c4da104a5a782bad7ff',ramdisk_id='',reservation_id='r-k6xe63iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-729948914',owner_user_name='tempest-TaggedBootDevicesTest-729948914-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffd657fbfccc4fc2a7f58a60bcada3df',uuid=45a40359-7496-44f6-ae86-a77f991e5106,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "address": "fa:16:3e:49:dc:99", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc347a8-bb", "ovs_interfaceid": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converting VIF {"id": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "address": "fa:16:3e:49:dc:99", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc347a8-bb", "ovs_interfaceid": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:dc:99,bridge_name='br-int',has_traffic_filtering=True,id=4cc347a8-bb63-452b-a81a-eb6a87afac30,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc347a8-bb') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_vif [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:dc:99,bridge_name='br-int',has_traffic_filtering=True,id=4cc347a8-bb63-452b-a81a-eb6a87afac30,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc347a8-bb') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cc347a8-bb, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:23 user nova-compute[72201]: INFO os_vif [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:dc:99,bridge_name='br-int',has_traffic_filtering=True,id=4cc347a8-bb63-452b-a81a-eb6a87afac30,network=Network(6e0510b0-a803-42fa-9558-2e68e4e6d5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc347a8-bb')
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2097729005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2097729005',id=10,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp1K/ORVcGLeOVNZLXDddd0H6aTpPgyDEIb1ynvVxfBr7TjGEofHSas3VzHl7WfFaIdXDza1M1ImDTGGDwP0YTIFxJ4VJA2DglK20QPjpeUjMA0Iz8F+wHOKnyAmm2JQw==',key_name='tempest-keypair-852805528',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:22:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e55bd6f4fa84c4da104a5a782bad7ff',ramdisk_id='',reservation_id='r-k6xe63iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-729948914',owner_user_name='tempest-TaggedBootDevicesTest-729948914-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffd657fbfccc4fc2a7f58a60bcada3df',uuid=45a40359-7496-44f6-ae86-a77f991e5106,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "address": "fa:16:3e:c5:f9:56", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2b6f03-3c", "ovs_interfaceid": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converting VIF {"id": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "address": "fa:16:3e:c5:f9:56", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2b6f03-3c", "ovs_interfaceid": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f9:56,bridge_name='br-int',has_traffic_filtering=True,id=8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe,network=Network(9f2eee2b-0819-45b2-bf6f-6831fa766f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e2b6f03-3c') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_vif [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f9:56,bridge_name='br-int',has_traffic_filtering=True,id=8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe,network=Network(9f2eee2b-0819-45b2-bf6f-6831fa766f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e2b6f03-3c') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e2b6f03-3c, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:23 user nova-compute[72201]: INFO os_vif [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f9:56,bridge_name='br-int',has_traffic_filtering=True,id=8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe,network=Network(9f2eee2b-0819-45b2-bf6f-6831fa766f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e2b6f03-3c')
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2097729005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2097729005',id=10,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp1K/ORVcGLeOVNZLXDddd0H6aTpPgyDEIb1ynvVxfBr7TjGEofHSas3VzHl7WfFaIdXDza1M1ImDTGGDwP0YTIFxJ4VJA2DglK20QPjpeUjMA0Iz8F+wHOKnyAmm2JQw==',key_name='tempest-keypair-852805528',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:22:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e55bd6f4fa84c4da104a5a782bad7ff',ramdisk_id='',reservation_id='r-k6xe63iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-729948914',owner_user_name='tempest-TaggedBootDevicesTest-729948914-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffd657fbfccc4fc2a7f58a60bcada3df',uuid=45a40359-7496-44f6-ae86-a77f991e5106,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "address": "fa:16:3e:0f:d2:23", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3dbdee9-e9", "ovs_interfaceid": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converting VIF {"id": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "address": "fa:16:3e:0f:d2:23", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3dbdee9-e9", "ovs_interfaceid": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:d2:23,bridge_name='br-int',has_traffic_filtering=True,id=f3dbdee9-e9a5-4859-b066-ccbb35f2df30,network=Network(9f2eee2b-0819-45b2-bf6f-6831fa766f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3dbdee9-e9') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_vif [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:d2:23,bridge_name='br-int',has_traffic_filtering=True,id=f3dbdee9-e9a5-4859-b066-ccbb35f2df30,network=Network(9f2eee2b-0819-45b2-bf6f-6831fa766f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3dbdee9-e9') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3dbdee9-e9, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:23 user nova-compute[72201]: INFO os_vif [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:d2:23,bridge_name='br-int',has_traffic_filtering=True,id=f3dbdee9-e9a5-4859-b066-ccbb35f2df30,network=Network(9f2eee2b-0819-45b2-bf6f-6831fa766f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3dbdee9-e9')
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dGEiVaxY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:23:23 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-f19285c2-bc7c-4f68-aaaf-65d9b71d1e88 req-f97a6423-faad-4f73-9adb-52ab74fb4b68 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-plugged-12cc53e2-1a6d-455c-9737-dd4a14957fa0 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f19285c2-bc7c-4f68-aaaf-65d9b71d1e88 req-f97a6423-faad-4f73-9adb-52ab74fb4b68 service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f19285c2-bc7c-4f68-aaaf-65d9b71d1e88 req-f97a6423-faad-4f73-9adb-52ab74fb4b68 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f19285c2-bc7c-4f68-aaaf-65d9b71d1e88 req-f97a6423-faad-4f73-9adb-52ab74fb4b68 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-f19285c2-bc7c-4f68-aaaf-65d9b71d1e88 req-f97a6423-faad-4f73-9adb-52ab74fb4b68 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-plugged-12cc53e2-1a6d-455c-9737-dd4a14957fa0 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:23 user nova-compute[72201]: WARNING nova.compute.manager [req-f19285c2-bc7c-4f68-aaaf-65d9b71d1e88 req-f97a6423-faad-4f73-9adb-52ab74fb4b68 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received unexpected event network-vif-plugged-12cc53e2-1a6d-455c-9737-dd4a14957fa0 for instance with vm_state active and task_state deleting.
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-f19285c2-bc7c-4f68-aaaf-65d9b71d1e88 req-f97a6423-faad-4f73-9adb-52ab74fb4b68 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-unplugged-8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f19285c2-bc7c-4f68-aaaf-65d9b71d1e88 req-f97a6423-faad-4f73-9adb-52ab74fb4b68 service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f19285c2-bc7c-4f68-aaaf-65d9b71d1e88 req-f97a6423-faad-4f73-9adb-52ab74fb4b68 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f19285c2-bc7c-4f68-aaaf-65d9b71d1e88 req-f97a6423-faad-4f73-9adb-52ab74fb4b68 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-f19285c2-bc7c-4f68-aaaf-65d9b71d1e88 req-f97a6423-faad-4f73-9adb-52ab74fb4b68 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-unplugged-8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-f19285c2-bc7c-4f68-aaaf-65d9b71d1e88 req-f97a6423-faad-4f73-9adb-52ab74fb4b68 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-unplugged-8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-f19285c2-bc7c-4f68-aaaf-65d9b71d1e88 req-f97a6423-faad-4f73-9adb-52ab74fb4b68 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-plugged-8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f19285c2-bc7c-4f68-aaaf-65d9b71d1e88 req-f97a6423-faad-4f73-9adb-52ab74fb4b68 service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f19285c2-bc7c-4f68-aaaf-65d9b71d1e88 req-f97a6423-faad-4f73-9adb-52ab74fb4b68 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f19285c2-bc7c-4f68-aaaf-65d9b71d1e88 req-f97a6423-faad-4f73-9adb-52ab74fb4b68 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-f19285c2-bc7c-4f68-aaaf-65d9b71d1e88 req-f97a6423-faad-4f73-9adb-52ab74fb4b68 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-plugged-8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:23 user nova-compute[72201]: WARNING nova.compute.manager [req-f19285c2-bc7c-4f68-aaaf-65d9b71d1e88 req-f97a6423-faad-4f73-9adb-52ab74fb4b68 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received unexpected event network-vif-plugged-8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe for instance with vm_state active and task_state deleting.
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[37332cd8-b810-4a74-b4f3-a542da9cbeba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4b588f-04a6-44dc-a9f6-182e4d875b6a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5440b4310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57'): ({'sdb'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Removing single pathed devices sdb {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b4990b-98bf-4878-9682-66e99055f48a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d747356-9211-4062-ae2f-da95af221399]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Flushing IO for device /dev/sdb {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0c76d4-59d7-4df9-8d00-a12482200807]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.objects.instance [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lazy-loading 'flavor' on Instance uuid c918ea78-9bf8-421c-9a31-0da4104cd032 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ab9e6d6b-8d73-4866-b205-e949c22d5be3 req-00a87c4c-db18-4a4f-ae9a-f1c7961caa8e service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-plugged-6e420509-edf8-4398-892b-ee3e4ebb450d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ab9e6d6b-8d73-4866-b205-e949c22d5be3 req-00a87c4c-db18-4a4f-ae9a-f1c7961caa8e service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ab9e6d6b-8d73-4866-b205-e949c22d5be3 req-00a87c4c-db18-4a4f-ae9a-f1c7961caa8e service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ab9e6d6b-8d73-4866-b205-e949c22d5be3 req-00a87c4c-db18-4a4f-ae9a-f1c7961caa8e service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ab9e6d6b-8d73-4866-b205-e949c22d5be3 req-00a87c4c-db18-4a4f-ae9a-f1c7961caa8e service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-plugged-6e420509-edf8-4398-892b-ee3e4ebb450d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:23 user nova-compute[72201]: WARNING nova.compute.manager [req-ab9e6d6b-8d73-4866-b205-e949c22d5be3 req-00a87c4c-db18-4a4f-ae9a-f1c7961caa8e service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received unexpected event network-vif-plugged-6e420509-edf8-4398-892b-ee3e4ebb450d for instance with vm_state active and task_state deleting.
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ab9e6d6b-8d73-4866-b205-e949c22d5be3 req-00a87c4c-db18-4a4f-ae9a-f1c7961caa8e service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-unplugged-f3dbdee9-e9a5-4859-b066-ccbb35f2df30 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ab9e6d6b-8d73-4866-b205-e949c22d5be3 req-00a87c4c-db18-4a4f-ae9a-f1c7961caa8e service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ab9e6d6b-8d73-4866-b205-e949c22d5be3 req-00a87c4c-db18-4a4f-ae9a-f1c7961caa8e service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ab9e6d6b-8d73-4866-b205-e949c22d5be3 req-00a87c4c-db18-4a4f-ae9a-f1c7961caa8e service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ab9e6d6b-8d73-4866-b205-e949c22d5be3 req-00a87c4c-db18-4a4f-ae9a-f1c7961caa8e service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-unplugged-f3dbdee9-e9a5-4859-b066-ccbb35f2df30 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ab9e6d6b-8d73-4866-b205-e949c22d5be3 req-00a87c4c-db18-4a4f-ae9a-f1c7961caa8e service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-unplugged-f3dbdee9-e9a5-4859-b066-ccbb35f2df30 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ab9e6d6b-8d73-4866-b205-e949c22d5be3 req-00a87c4c-db18-4a4f-ae9a-f1c7961caa8e service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-plugged-f3dbdee9-e9a5-4859-b066-ccbb35f2df30 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ab9e6d6b-8d73-4866-b205-e949c22d5be3 req-00a87c4c-db18-4a4f-ae9a-f1c7961caa8e service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ab9e6d6b-8d73-4866-b205-e949c22d5be3 req-00a87c4c-db18-4a4f-ae9a-f1c7961caa8e service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ab9e6d6b-8d73-4866-b205-e949c22d5be3 req-00a87c4c-db18-4a4f-ae9a-f1c7961caa8e service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ab9e6d6b-8d73-4866-b205-e949c22d5be3 req-00a87c4c-db18-4a4f-ae9a-f1c7961caa8e service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-plugged-f3dbdee9-e9a5-4859-b066-ccbb35f2df30 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:23 user nova-compute[72201]: WARNING nova.compute.manager [req-ab9e6d6b-8d73-4866-b205-e949c22d5be3 req-00a87c4c-db18-4a4f-ae9a-f1c7961caa8e service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received unexpected event network-vif-plugged-f3dbdee9-e9a5-4859-b066-ccbb35f2df30 for instance with vm_state active and task_state deleting.
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac44b0a2-7326-428a-bf08-1d56c7360a99]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-483ba588-c114-4946-8852-499d6f05eaa3 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.487s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ab86ab-0f49-40f0-a85b-a28b37658728]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa0419c-a2c1-4225-b6d2-6e98cdfedc0a]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57, portal: 172.16.0.220,3260]
Aug 01 15:23:23 user nova-compute[72201]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57, portal: 172.16.0.220,3260] successful.
Aug 01 15:23:23 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0409930c-64ac-4079-ba24-2beb3dd73e57 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae16cb29-cb13-49f2-9111-ba6270f0e7b9]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] <== disconnect_volume: return (348ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wkTxAsDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:23:23 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[730c1e97-cdd9-45bc-ba06-44a70d3f12c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4617850d-a987-4662-b360-309969e327f5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c515480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429'): ({'sdc'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Removing single pathed devices sdc {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfc1c4f-bcc9-4362-95d3-a3bf6aaca0e2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b1556d-a8d4-4331-b44d-0c54322ac209]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Flushing IO for device /dev/sdc {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b57901-d215-4e85-9334-0fd4c5dce705]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebedf0f-7f2b-4785-a1d3-c2a68c353526]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[637ebfab-bd55-497a-8c29-05cc53acf28c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c569e75-7fd3-4b78-8007-791c2d083401]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429, portal: 172.16.0.220,3260]
Aug 01 15:23:23 user nova-compute[72201]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429, portal: 172.16.0.220,3260] successful.
Aug 01 15:23:23 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b81bbc-3da9-48ba-a3aa-115edf768429 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6d2864-3670-4daf-81ff-c530cce39704]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] <== disconnect_volume: return (296ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eEPVwAWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:23:23 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94e5743-ef29-41cb-9484-69ec517e984a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd79f429-fe2c-4876-a2eb-7df582790608]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:23:23 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c515480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0'): ({'sdd'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Removing single pathed devices sdd {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a820e7-9048-4474-b64c-412a7f54febd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a635eeba-d680-4805-a3c0-a5068dd7f2d8]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Flushing IO for device /dev/sdd {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50eaf3a-caa4-4805-935f-e0c2f3610cb6]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-unplugged-ef3cbe0f-91fd-488c-80d1-48609530c75e {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-unplugged-ef3cbe0f-91fd-488c-80d1-48609530c75e {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-unplugged-ef3cbe0f-91fd-488c-80d1-48609530c75e for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-plugged-ef3cbe0f-91fd-488c-80d1-48609530c75e {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-plugged-ef3cbe0f-91fd-488c-80d1-48609530c75e {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:23 user nova-compute[72201]: WARNING nova.compute.manager [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received unexpected event network-vif-plugged-ef3cbe0f-91fd-488c-80d1-48609530c75e for instance with vm_state active and task_state deleting.
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-unplugged-4cc347a8-bb63-452b-a81a-eb6a87afac30 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-unplugged-4cc347a8-bb63-452b-a81a-eb6a87afac30 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-unplugged-4cc347a8-bb63-452b-a81a-eb6a87afac30 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-plugged-4cc347a8-bb63-452b-a81a-eb6a87afac30 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] Acquiring lock "45a40359-7496-44f6-ae86-a77f991e5106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] Lock "45a40359-7496-44f6-ae86-a77f991e5106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] No waiting events found dispatching network-vif-plugged-4cc347a8-bb63-452b-a81a-eb6a87afac30 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:23 user nova-compute[72201]: WARNING nova.compute.manager [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received unexpected event network-vif-plugged-4cc347a8-bb63-452b-a81a-eb6a87afac30 for instance with vm_state active and task_state deleting.
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Received event network-vif-plugged-befcc650-86a7-49a1-b877-7fd179b494e4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] Acquiring lock "d4146775-a271-4822-84ec-e723ff09c386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] Lock "d4146775-a271-4822-84ec-e723ff09c386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] Lock "d4146775-a271-4822-84ec-e723ff09c386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] No waiting events found dispatching network-vif-plugged-befcc650-86a7-49a1-b877-7fd179b494e4 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:23 user nova-compute[72201]: WARNING nova.compute.manager [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Received unexpected event network-vif-plugged-befcc650-86a7-49a1-b877-7fd179b494e4 for instance with vm_state building and task_state spawning.
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Received event network-vif-plugged-befcc650-86a7-49a1-b877-7fd179b494e4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] Acquiring lock "d4146775-a271-4822-84ec-e723ff09c386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] Lock "d4146775-a271-4822-84ec-e723ff09c386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] Lock "d4146775-a271-4822-84ec-e723ff09c386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] No waiting events found dispatching network-vif-plugged-befcc650-86a7-49a1-b877-7fd179b494e4 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:23 user nova-compute[72201]: WARNING nova.compute.manager [req-ec795b90-c2d3-42ac-aee5-59ca0c47c592 req-afc5a10c-9148-4d25-89bb-8632bad99e99 service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Received unexpected event network-vif-plugged-befcc650-86a7-49a1-b877-7fd179b494e4 for instance with vm_state building and task_state spawning.
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.030s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a87664-9034-4676-a8c4-f6e5b27516fe]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] SCSI volumes sdd have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77e772b-ceec-4d86-9dcc-85c1f0011274]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb87dc55-eec8-4291-9f7e-66fddca062ba]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0, portal: 172.16.0.220,3260]
Aug 01 15:23:24 user nova-compute[72201]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0, portal: 172.16.0.220,3260] successful.
Aug 01 15:23:24 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f50070c4-3768-46e8-bb02-aa1bb66a65e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f864a0d3-dbb0-4eaa-8104-008a01e221e5]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] <== disconnect_volume: return (300ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:23:24 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Deleting instance files /opt/stack/data/nova/instances/45a40359-7496-44f6-ae86-a77f991e5106_del
Aug 01 15:23:24 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Deletion of /opt/stack/data/nova/instances/45a40359-7496-44f6-ae86-a77f991e5106_del complete
Aug 01 15:23:24 user nova-compute[72201]: INFO nova.compute.manager [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Took 3.39 seconds to destroy the instance on the hypervisor.
Aug 01 15:23:24 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903404.4497476, d4146775-a271-4822-84ec-e723ff09c386 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:23:24 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d4146775-a271-4822-84ec-e723ff09c386] VM Resumed (Lifecycle Event)
Aug 01 15:23:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:23:24 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: d4146775-a271-4822-84ec-e723ff09c386] Instance spawned successfully.
Aug 01 15:23:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d4146775-a271-4822-84ec-e723ff09c386] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d4146775-a271-4822-84ec-e723ff09c386] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:23:24 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d4146775-a271-4822-84ec-e723ff09c386] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:23:24 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903404.4507284, d4146775-a271-4822-84ec-e723ff09c386 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:23:24 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d4146775-a271-4822-84ec-e723ff09c386] VM Started (Lifecycle Event)
Aug 01 15:23:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d4146775-a271-4822-84ec-e723ff09c386] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:23:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d4146775-a271-4822-84ec-e723ff09c386] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:23:24 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d4146775-a271-4822-84ec-e723ff09c386] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:23:24 user nova-compute[72201]: INFO nova.compute.manager [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Took 6.49 seconds to spawn the instance on the hypervisor.
Aug 01 15:23:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:23:24 user nova-compute[72201]: INFO nova.compute.manager [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Took 7.55 seconds to build instance.
Aug 01 15:23:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b8273637-cfe7-4ffd-a26c-28359493795f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "d4146775-a271-4822-84ec-e723ff09c386" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.673s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-a5c113f8-cc72-4680-8fd9-921d4b522a2f req-55bf2226-7acc-425c-9415-bc805c4b35a8 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-deleted-ef3cbe0f-91fd-488c-80d1-48609530c75e {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:25 user nova-compute[72201]: INFO nova.compute.manager [req-a5c113f8-cc72-4680-8fd9-921d4b522a2f req-55bf2226-7acc-425c-9415-bc805c4b35a8 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Neutron deleted interface ef3cbe0f-91fd-488c-80d1-48609530c75e; detaching it from the instance and deleting it from the info cache
Aug 01 15:23:25 user nova-compute[72201]: DEBUG nova.network.neutron [req-a5c113f8-cc72-4680-8fd9-921d4b522a2f req-55bf2226-7acc-425c-9415-bc805c4b35a8 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Updating instance_info_cache with network_info: [{"id": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "address": "fa:16:3e:5c:9c:8c", "network": {"id": "dd813b4b-a3e3-44c9-839b-1eab4b536882", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1931202477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12cc53e2-1a", "ovs_interfaceid": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e420509-edf8-4398-892b-ee3e4ebb450d", "address": "fa:16:3e:b2:af:3c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e420509-ed", "ovs_interfaceid": "6e420509-edf8-4398-892b-ee3e4ebb450d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28037956-d408-4d2b-9ea8-76dda5239b9b", "address": "fa:16:3e:3f:1c:0c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28037956-d4", "ovs_interfaceid": "28037956-d408-4d2b-9ea8-76dda5239b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "address": "fa:16:3e:49:dc:99", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc347a8-bb", "ovs_interfaceid": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "address": "fa:16:3e:c5:f9:56", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2b6f03-3c", "ovs_interfaceid": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "address": "fa:16:3e:0f:d2:23", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3dbdee9-e9", "ovs_interfaceid": "f3dbdee9-e9a5-4859-b066-ccbb35f2df30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:23:26 user nova-compute[72201]: DEBUG nova.compute.manager [req-a5c113f8-cc72-4680-8fd9-921d4b522a2f req-55bf2226-7acc-425c-9415-bc805c4b35a8 service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Detach interface failed, port_id=ef3cbe0f-91fd-488c-80d1-48609530c75e, reason: Instance 45a40359-7496-44f6-ae86-a77f991e5106 could not be found. {{(pid=72201) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 15:23:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Acquiring lock "44cde39a-a94b-4fd8-8747-def0a68d77df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "44cde39a-a94b-4fd8-8747-def0a68d77df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Acquiring lock "44cde39a-a94b-4fd8-8747-def0a68d77df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "44cde39a-a94b-4fd8-8747-def0a68d77df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "44cde39a-a94b-4fd8-8747-def0a68d77df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:26 user nova-compute[72201]: INFO nova.compute.manager [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Terminating instance
Aug 01 15:23:26 user nova-compute[72201]: DEBUG nova.compute.manager [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:23:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:26 user nova-compute[72201]: DEBUG nova.compute.manager [req-80739708-ba00-4ea4-8089-92de756060e8 req-c43d7ae3-2218-4940-89e4-9aafad09fb5f service nova] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Received event network-vif-unplugged-d3e3d40b-6f50-4f30-8074-91bb77bd0e81 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-80739708-ba00-4ea4-8089-92de756060e8 req-c43d7ae3-2218-4940-89e4-9aafad09fb5f service nova] Acquiring lock "44cde39a-a94b-4fd8-8747-def0a68d77df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-80739708-ba00-4ea4-8089-92de756060e8 req-c43d7ae3-2218-4940-89e4-9aafad09fb5f service nova] Lock "44cde39a-a94b-4fd8-8747-def0a68d77df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-80739708-ba00-4ea4-8089-92de756060e8 req-c43d7ae3-2218-4940-89e4-9aafad09fb5f service nova] Lock "44cde39a-a94b-4fd8-8747-def0a68d77df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:26 user nova-compute[72201]: DEBUG nova.compute.manager [req-80739708-ba00-4ea4-8089-92de756060e8 req-c43d7ae3-2218-4940-89e4-9aafad09fb5f service nova] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] No waiting events found dispatching network-vif-unplugged-d3e3d40b-6f50-4f30-8074-91bb77bd0e81 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:26 user nova-compute[72201]: DEBUG nova.compute.manager [req-80739708-ba00-4ea4-8089-92de756060e8 req-c43d7ae3-2218-4940-89e4-9aafad09fb5f service nova] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Received event network-vif-unplugged-d3e3d40b-6f50-4f30-8074-91bb77bd0e81 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:23:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:27 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Instance destroyed successfully.
Aug 01 15:23:27 user nova-compute[72201]: DEBUG nova.objects.instance [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lazy-loading 'resources' on Instance uuid 44cde39a-a94b-4fd8-8747-def0a68d77df {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:23:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:21:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-285758568',display_name='tempest-VolumesActionsTest-instance-285758568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-285758568',id=11,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:21:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19a697b16b874115aedf4e49d7b042b7',ramdisk_id='',reservation_id='r-kfwcugde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-343582602',owner_user_name='tempest-VolumesActionsTest-343582602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:21:44Z,user_data=None,user_id='59ec55bc93f54ef6ad59d5624c19d26d',uuid=44cde39a-a94b-4fd8-8747-def0a68d77df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3e3d40b-6f50-4f30-8074-91bb77bd0e81", "address": "fa:16:3e:8a:87:d2", "network": {"id": "95f92796-92dc-4732-a567-57b506b0d89b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403146244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a697b16b874115aedf4e49d7b042b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e3d40b-6f", "ovs_interfaceid": "d3e3d40b-6f50-4f30-8074-91bb77bd0e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:23:27 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Converting VIF {"id": "d3e3d40b-6f50-4f30-8074-91bb77bd0e81", "address": "fa:16:3e:8a:87:d2", "network": {"id": "95f92796-92dc-4732-a567-57b506b0d89b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403146244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a697b16b874115aedf4e49d7b042b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e3d40b-6f", "ovs_interfaceid": "d3e3d40b-6f50-4f30-8074-91bb77bd0e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:23:27 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:87:d2,bridge_name='br-int',has_traffic_filtering=True,id=d3e3d40b-6f50-4f30-8074-91bb77bd0e81,network=Network(95f92796-92dc-4732-a567-57b506b0d89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e3d40b-6f') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:23:27 user nova-compute[72201]: DEBUG os_vif [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:87:d2,bridge_name='br-int',has_traffic_filtering=True,id=d3e3d40b-6f50-4f30-8074-91bb77bd0e81,network=Network(95f92796-92dc-4732-a567-57b506b0d89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e3d40b-6f') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:23:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3e3d40b-6f, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:23:27 user nova-compute[72201]: INFO os_vif [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:87:d2,bridge_name='br-int',has_traffic_filtering=True,id=d3e3d40b-6f50-4f30-8074-91bb77bd0e81,network=Network(95f92796-92dc-4732-a567-57b506b0d89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e3d40b-6f')
Aug 01 15:23:27 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Deleting instance files /opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df_del
Aug 01 15:23:27 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Deletion of /opt/stack/data/nova/instances/44cde39a-a94b-4fd8-8747-def0a68d77df_del complete
Aug 01 15:23:27 user nova-compute[72201]: INFO nova.compute.manager [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 01 15:23:27 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:23:27 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:23:27 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:23:27 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:23:27 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Took 0.52 seconds to deallocate network for instance.
Aug 01 15:23:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:28 user nova-compute[72201]: DEBUG nova.compute.manager [req-d7e85812-b3d2-4e9d-a593-fd4ea21f4397 req-152b7df4-e187-43d5-a775-a5f28259cc7d service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-deleted-f3dbdee9-e9a5-4859-b066-ccbb35f2df30 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:28 user nova-compute[72201]: INFO nova.compute.manager [req-d7e85812-b3d2-4e9d-a593-fd4ea21f4397 req-152b7df4-e187-43d5-a775-a5f28259cc7d service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Neutron deleted interface f3dbdee9-e9a5-4859-b066-ccbb35f2df30; detaching it from the instance and deleting it from the info cache
Aug 01 15:23:28 user nova-compute[72201]: DEBUG nova.network.neutron [req-d7e85812-b3d2-4e9d-a593-fd4ea21f4397 req-152b7df4-e187-43d5-a775-a5f28259cc7d service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Updating instance_info_cache with network_info: [{"id": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "address": "fa:16:3e:5c:9c:8c", "network": {"id": "dd813b4b-a3e3-44c9-839b-1eab4b536882", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1931202477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12cc53e2-1a", "ovs_interfaceid": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e420509-edf8-4398-892b-ee3e4ebb450d", "address": "fa:16:3e:b2:af:3c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e420509-ed", "ovs_interfaceid": "6e420509-edf8-4398-892b-ee3e4ebb450d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28037956-d408-4d2b-9ea8-76dda5239b9b", "address": "fa:16:3e:3f:1c:0c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28037956-d4", "ovs_interfaceid": "28037956-d408-4d2b-9ea8-76dda5239b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "address": "fa:16:3e:49:dc:99", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc347a8-bb", "ovs_interfaceid": "4cc347a8-bb63-452b-a81a-eb6a87afac30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "address": "fa:16:3e:c5:f9:56", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2b6f03-3c", "ovs_interfaceid": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:23:28 user nova-compute[72201]: DEBUG nova.compute.manager [req-d7e85812-b3d2-4e9d-a593-fd4ea21f4397 req-152b7df4-e187-43d5-a775-a5f28259cc7d service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Detach interface failed, port_id=f3dbdee9-e9a5-4859-b066-ccbb35f2df30, reason: Instance 45a40359-7496-44f6-ae86-a77f991e5106 could not be found. {{(pid=72201) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 15:23:28 user nova-compute[72201]: DEBUG nova.compute.manager [req-d7e85812-b3d2-4e9d-a593-fd4ea21f4397 req-152b7df4-e187-43d5-a775-a5f28259cc7d service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-deleted-4cc347a8-bb63-452b-a81a-eb6a87afac30 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:28 user nova-compute[72201]: INFO nova.compute.manager [req-d7e85812-b3d2-4e9d-a593-fd4ea21f4397 req-152b7df4-e187-43d5-a775-a5f28259cc7d service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Neutron deleted interface 4cc347a8-bb63-452b-a81a-eb6a87afac30; detaching it from the instance and deleting it from the info cache
Aug 01 15:23:28 user nova-compute[72201]: DEBUG nova.network.neutron [req-d7e85812-b3d2-4e9d-a593-fd4ea21f4397 req-152b7df4-e187-43d5-a775-a5f28259cc7d service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Updating instance_info_cache with network_info: [{"id": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "address": "fa:16:3e:5c:9c:8c", "network": {"id": "dd813b4b-a3e3-44c9-839b-1eab4b536882", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1931202477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12cc53e2-1a", "ovs_interfaceid": "12cc53e2-1a6d-455c-9737-dd4a14957fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e420509-edf8-4398-892b-ee3e4ebb450d", "address": "fa:16:3e:b2:af:3c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e420509-ed", "ovs_interfaceid": "6e420509-edf8-4398-892b-ee3e4ebb450d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28037956-d408-4d2b-9ea8-76dda5239b9b", "address": "fa:16:3e:3f:1c:0c", "network": {"id": "6e0510b0-a803-42fa-9558-2e68e4e6d5b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1750981160", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28037956-d4", "ovs_interfaceid": "28037956-d408-4d2b-9ea8-76dda5239b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "address": "fa:16:3e:c5:f9:56", "network": {"id": "9f2eee2b-0819-45b2-bf6f-6831fa766f93", "bridge": "br-int", "label": "tempest-device-tagging-net2-968851752", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e55bd6f4fa84c4da104a5a782bad7ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2b6f03-3c", "ovs_interfaceid": "8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:23:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:28 user nova-compute[72201]: DEBUG nova.compute.manager [req-d7e85812-b3d2-4e9d-a593-fd4ea21f4397 req-152b7df4-e187-43d5-a775-a5f28259cc7d service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Detach interface failed, port_id=4cc347a8-bb63-452b-a81a-eb6a87afac30, reason: Instance 45a40359-7496-44f6-ae86-a77f991e5106 could not be found. {{(pid=72201) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 15:23:28 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:23:28 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:23:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:28 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Deleted allocations for instance 44cde39a-a94b-4fd8-8747-def0a68d77df
Aug 01 15:23:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eef49d67-5d9d-4836-afc9-0209d833893e tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "44cde39a-a94b-4fd8-8747-def0a68d77df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.028s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:28 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:23:28 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Took 4.42 seconds to deallocate network for instance.
Aug 01 15:23:28 user nova-compute[72201]: DEBUG nova.compute.manager [req-8117ca19-ee40-4771-b5ce-1a2144d21b4b req-bf48c96d-a42d-4651-ac25-df05bb98bc7d service nova] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Received event network-vif-plugged-d3e3d40b-6f50-4f30-8074-91bb77bd0e81 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8117ca19-ee40-4771-b5ce-1a2144d21b4b req-bf48c96d-a42d-4651-ac25-df05bb98bc7d service nova] Acquiring lock "44cde39a-a94b-4fd8-8747-def0a68d77df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8117ca19-ee40-4771-b5ce-1a2144d21b4b req-bf48c96d-a42d-4651-ac25-df05bb98bc7d service nova] Lock "44cde39a-a94b-4fd8-8747-def0a68d77df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8117ca19-ee40-4771-b5ce-1a2144d21b4b req-bf48c96d-a42d-4651-ac25-df05bb98bc7d service nova] Lock "44cde39a-a94b-4fd8-8747-def0a68d77df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:28 user nova-compute[72201]: DEBUG nova.compute.manager [req-8117ca19-ee40-4771-b5ce-1a2144d21b4b req-bf48c96d-a42d-4651-ac25-df05bb98bc7d service nova] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] No waiting events found dispatching network-vif-plugged-d3e3d40b-6f50-4f30-8074-91bb77bd0e81 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:28 user nova-compute[72201]: WARNING nova.compute.manager [req-8117ca19-ee40-4771-b5ce-1a2144d21b4b req-bf48c96d-a42d-4651-ac25-df05bb98bc7d service nova] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Received unexpected event network-vif-plugged-d3e3d40b-6f50-4f30-8074-91bb77bd0e81 for instance with vm_state deleted and task_state None.
Aug 01 15:23:28 user nova-compute[72201]: DEBUG nova.compute.manager [req-8117ca19-ee40-4771-b5ce-1a2144d21b4b req-bf48c96d-a42d-4651-ac25-df05bb98bc7d service nova] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Received event network-vif-deleted-d3e3d40b-6f50-4f30-8074-91bb77bd0e81 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:30 user nova-compute[72201]: DEBUG nova.compute.manager [req-ef38c620-bb9d-4fbd-adc7-462983842959 req-66b9da53-5e4d-4863-84e2-e465cdb58cee service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-deleted-12cc53e2-1a6d-455c-9737-dd4a14957fa0 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:30 user nova-compute[72201]: DEBUG nova.compute.manager [req-ef38c620-bb9d-4fbd-adc7-462983842959 req-66b9da53-5e4d-4863-84e2-e465cdb58cee service nova] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Received event network-vif-deleted-8e2b6f03-3c21-464b-8ef2-ed53fa23e5fe {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:30 user nova-compute[72201]: INFO nova.compute.manager [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Took 2.25 seconds to detach 3 volumes for instance.
Aug 01 15:23:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:31 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:23:31 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:23:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:31 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Deleted allocations for instance 45a40359-7496-44f6-ae86-a77f991e5106
Aug 01 15:23:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3ff14a13-84a5-4fb1-b54f-bc99865b83e0 tempest-TaggedBootDevicesTest-729948914 tempest-TaggedBootDevicesTest-729948914-project-member] Lock "45a40359-7496-44f6-ae86-a77f991e5106" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.576s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:33 user nova-compute[72201]: DEBUG nova.compute.manager [req-b1070f90-ba5d-4d91-8fdb-f056c09b556b req-e0f08fce-7730-451e-a9f0-c2226ab20ccd service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-changed-5c6a1011-f0c2-4d1b-8559-116d9b15bdd8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:33 user nova-compute[72201]: DEBUG nova.compute.manager [req-b1070f90-ba5d-4d91-8fdb-f056c09b556b req-e0f08fce-7730-451e-a9f0-c2226ab20ccd service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Refreshing instance network info cache due to event network-changed-5c6a1011-f0c2-4d1b-8559-116d9b15bdd8. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:23:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b1070f90-ba5d-4d91-8fdb-f056c09b556b req-e0f08fce-7730-451e-a9f0-c2226ab20ccd service nova] Acquiring lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:23:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b1070f90-ba5d-4d91-8fdb-f056c09b556b req-e0f08fce-7730-451e-a9f0-c2226ab20ccd service nova] Acquired lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:23:33 user nova-compute[72201]: DEBUG nova.network.neutron [req-b1070f90-ba5d-4d91-8fdb-f056c09b556b req-e0f08fce-7730-451e-a9f0-c2226ab20ccd service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Refreshing network info cache for port 5c6a1011-f0c2-4d1b-8559-116d9b15bdd8 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:23:34 user nova-compute[72201]: DEBUG nova.network.neutron [req-b1070f90-ba5d-4d91-8fdb-f056c09b556b req-e0f08fce-7730-451e-a9f0-c2226ab20ccd service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Updated VIF entry in instance network info cache for port 5c6a1011-f0c2-4d1b-8559-116d9b15bdd8. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:23:34 user nova-compute[72201]: DEBUG nova.network.neutron [req-b1070f90-ba5d-4d91-8fdb-f056c09b556b req-e0f08fce-7730-451e-a9f0-c2226ab20ccd service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Updating instance_info_cache with network_info: [{"id": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "address": "fa:16:3e:43:cd:e6", "network": {"id": "43b87e91-7bb8-432c-abc5-9821f28350ef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-494863642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6a1011-f0", "ovs_interfaceid": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "address": "fa:16:3e:e9:aa:f5", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bdcebc-0f", "ovs_interfaceid": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5eec44e9-3963-454e-931c-4f5a94548672", "address": "fa:16:3e:9c:5a:6f", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eec44e9-39", "ovs_interfaceid": "5eec44e9-3963-454e-931c-4f5a94548672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "52014d35-b37b-41ec-ab07-1ec05db59785", "address": "fa:16:3e:f0:e7:fb", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52014d35-b3", "ovs_interfaceid": "52014d35-b37b-41ec-ab07-1ec05db59785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "892001ed-6dfd-4e71-baa0-dae05528700d", "address": "fa:16:3e:59:ec:7a", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892001ed-6d", "ovs_interfaceid": "892001ed-6dfd-4e71-baa0-dae05528700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "babde51a-fce1-4954-8aa6-2e3715330cf0", "address": "fa:16:3e:41:5d:45", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabde51a-fc", "ovs_interfaceid": "babde51a-fce1-4954-8aa6-2e3715330cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "address": "fa:16:3e:bd:98:53", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c3087dd-d4", "ovs_interfaceid": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:23:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b1070f90-ba5d-4d91-8fdb-f056c09b556b req-e0f08fce-7730-451e-a9f0-c2226ab20ccd service nova] Releasing lock "refresh_cache-d86ed500-ec1a-4e2c-a137-7a654ada6e11" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:23:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:35 user nova-compute[72201]: INFO nova.compute.manager [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Terminating instance
Aug 01 15:23:35 user nova-compute[72201]: DEBUG nova.compute.manager [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:23:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG nova.compute.manager [req-f0a3abff-ebb9-4ebe-8965-45c6e4d5eb21 req-3fde909e-104e-4e8b-954f-d7e9eb7d575a service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-unplugged-b3bdcebc-0ff7-45e1-995e-790d24bc580f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f0a3abff-ebb9-4ebe-8965-45c6e4d5eb21 req-3fde909e-104e-4e8b-954f-d7e9eb7d575a service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f0a3abff-ebb9-4ebe-8965-45c6e4d5eb21 req-3fde909e-104e-4e8b-954f-d7e9eb7d575a service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f0a3abff-ebb9-4ebe-8965-45c6e4d5eb21 req-3fde909e-104e-4e8b-954f-d7e9eb7d575a service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG nova.compute.manager [req-f0a3abff-ebb9-4ebe-8965-45c6e4d5eb21 req-3fde909e-104e-4e8b-954f-d7e9eb7d575a service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-unplugged-b3bdcebc-0ff7-45e1-995e-790d24bc580f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG nova.compute.manager [req-f0a3abff-ebb9-4ebe-8965-45c6e4d5eb21 req-3fde909e-104e-4e8b-954f-d7e9eb7d575a service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-unplugged-b3bdcebc-0ff7-45e1-995e-790d24bc580f for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG nova.compute.manager [req-64d22589-1061-4ba9-965a-7ee728b1573c req-86164035-c639-4356-a94a-62f724d1a682 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-unplugged-5c6a1011-f0c2-4d1b-8559-116d9b15bdd8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-64d22589-1061-4ba9-965a-7ee728b1573c req-86164035-c639-4356-a94a-62f724d1a682 service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-64d22589-1061-4ba9-965a-7ee728b1573c req-86164035-c639-4356-a94a-62f724d1a682 service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-64d22589-1061-4ba9-965a-7ee728b1573c req-86164035-c639-4356-a94a-62f724d1a682 service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG nova.compute.manager [req-64d22589-1061-4ba9-965a-7ee728b1573c req-86164035-c639-4356-a94a-62f724d1a682 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-unplugged-5c6a1011-f0c2-4d1b-8559-116d9b15bdd8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG nova.compute.manager [req-64d22589-1061-4ba9-965a-7ee728b1573c req-86164035-c639-4356-a94a-62f724d1a682 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-unplugged-5c6a1011-f0c2-4d1b-8559-116d9b15bdd8 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG nova.compute.manager [req-715dc133-e020-45aa-940a-cbec01854a08 req-129035b7-5cfd-41e5-8a97-fd4c98bf9b14 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-unplugged-5c3087dd-d4fb-4ec6-8ae3-7a90993941ae {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-715dc133-e020-45aa-940a-cbec01854a08 req-129035b7-5cfd-41e5-8a97-fd4c98bf9b14 service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-715dc133-e020-45aa-940a-cbec01854a08 req-129035b7-5cfd-41e5-8a97-fd4c98bf9b14 service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-715dc133-e020-45aa-940a-cbec01854a08 req-129035b7-5cfd-41e5-8a97-fd4c98bf9b14 service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG nova.compute.manager [req-715dc133-e020-45aa-940a-cbec01854a08 req-129035b7-5cfd-41e5-8a97-fd4c98bf9b14 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-unplugged-5c3087dd-d4fb-4ec6-8ae3-7a90993941ae {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG nova.compute.manager [req-715dc133-e020-45aa-940a-cbec01854a08 req-129035b7-5cfd-41e5-8a97-fd4c98bf9b14 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-unplugged-5c3087dd-d4fb-4ec6-8ae3-7a90993941ae for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903402.598046, 45a40359-7496-44f6-ae86-a77f991e5106 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:23:37 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] VM Stopped (Lifecycle Event)
Aug 01 15:23:37 user nova-compute[72201]: DEBUG nova.compute.manager [None req-342d8166-4c8c-4474-809a-40a3b15e3791 None None] [instance: 45a40359-7496-44f6-ae86-a77f991e5106] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:23:37 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Instance destroyed successfully.
Aug 01 15:23:37 user nova-compute[72201]: DEBUG nova.objects.instance [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lazy-loading 'resources' on Instance uuid d86ed500-ec1a-4e2c-a137-7a654ada6e11 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768097343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768097343',id=12,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgbXmP8E15q/2hc/sGGZZBtyKuuqNtJdk8Iq/aT7Y+eOcUaZn3yzcvDKh1GBxnTbvzsaqHqnI8TS1PZHT0WQ3lAxYtOiZyiWfRylI4pBb6s6CN+8bL4bsjkBNc38pPNRQ==',key_name='tempest-keypair-335494459',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:22:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fce0072ae6c74c3997ea40225a876c68',ramdisk_id='',reservation_id='r-temo3w1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1828701596',owner_user_name='tempest-TaggedBootDevicesTest_v242-1828701596-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b68ccc67f5401b87a5951bde152dc5',uuid=d86ed500-ec1a-4e2c-a137-7a654ada6e11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "address": "fa:16:3e:43:cd:e6", "network": {"id": "43b87e91-7bb8-432c-abc5-9821f28350ef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-494863642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6a1011-f0", "ovs_interfaceid": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converting VIF {"id": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "address": "fa:16:3e:43:cd:e6", "network": {"id": "43b87e91-7bb8-432c-abc5-9821f28350ef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-494863642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6a1011-f0", "ovs_interfaceid": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:cd:e6,bridge_name='br-int',has_traffic_filtering=True,id=5c6a1011-f0c2-4d1b-8559-116d9b15bdd8,network=Network(43b87e91-7bb8-432c-abc5-9821f28350ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6a1011-f0') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG os_vif [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:cd:e6,bridge_name='br-int',has_traffic_filtering=True,id=5c6a1011-f0c2-4d1b-8559-116d9b15bdd8,network=Network(43b87e91-7bb8-432c-abc5-9821f28350ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6a1011-f0') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c6a1011-f0, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:37 user nova-compute[72201]: INFO os_vif [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:cd:e6,bridge_name='br-int',has_traffic_filtering=True,id=5c6a1011-f0c2-4d1b-8559-116d9b15bdd8,network=Network(43b87e91-7bb8-432c-abc5-9821f28350ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6a1011-f0')
Aug 01 15:23:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768097343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768097343',id=12,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgbXmP8E15q/2hc/sGGZZBtyKuuqNtJdk8Iq/aT7Y+eOcUaZn3yzcvDKh1GBxnTbvzsaqHqnI8TS1PZHT0WQ3lAxYtOiZyiWfRylI4pBb6s6CN+8bL4bsjkBNc38pPNRQ==',key_name='tempest-keypair-335494459',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:22:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fce0072ae6c74c3997ea40225a876c68',ramdisk_id='',reservation_id='r-temo3w1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1828701596',owner_user_name='tempest-TaggedBootDevicesTest_v242-1828701596-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b68ccc67f5401b87a5951bde152dc5',uuid=d86ed500-ec1a-4e2c-a137-7a654ada6e11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "address": "fa:16:3e:e9:aa:f5", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bdcebc-0f", "ovs_interfaceid": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converting VIF {"id": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "address": "fa:16:3e:e9:aa:f5", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bdcebc-0f", "ovs_interfaceid": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:aa:f5,bridge_name='br-int',has_traffic_filtering=True,id=b3bdcebc-0ff7-45e1-995e-790d24bc580f,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3bdcebc-0f') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG os_vif [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:aa:f5,bridge_name='br-int',has_traffic_filtering=True,id=b3bdcebc-0ff7-45e1-995e-790d24bc580f,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3bdcebc-0f') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3bdcebc-0f, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:37 user nova-compute[72201]: INFO os_vif [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:aa:f5,bridge_name='br-int',has_traffic_filtering=True,id=b3bdcebc-0ff7-45e1-995e-790d24bc580f,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb3bdcebc-0f')
Aug 01 15:23:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768097343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768097343',id=12,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgbXmP8E15q/2hc/sGGZZBtyKuuqNtJdk8Iq/aT7Y+eOcUaZn3yzcvDKh1GBxnTbvzsaqHqnI8TS1PZHT0WQ3lAxYtOiZyiWfRylI4pBb6s6CN+8bL4bsjkBNc38pPNRQ==',key_name='tempest-keypair-335494459',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:22:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fce0072ae6c74c3997ea40225a876c68',ramdisk_id='',reservation_id='r-temo3w1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1828701596',owner_user_name='tempest-TaggedBootDevicesTest_v242-1828701596-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b68ccc67f5401b87a5951bde152dc5',uuid=d86ed500-ec1a-4e2c-a137-7a654ada6e11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5eec44e9-3963-454e-931c-4f5a94548672", "address": "fa:16:3e:9c:5a:6f", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eec44e9-39", "ovs_interfaceid": "5eec44e9-3963-454e-931c-4f5a94548672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converting VIF {"id": "5eec44e9-3963-454e-931c-4f5a94548672", "address": "fa:16:3e:9c:5a:6f", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eec44e9-39", "ovs_interfaceid": "5eec44e9-3963-454e-931c-4f5a94548672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:5a:6f,bridge_name='br-int',has_traffic_filtering=True,id=5eec44e9-3963-454e-931c-4f5a94548672,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5eec44e9-39') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG os_vif [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:5a:6f,bridge_name='br-int',has_traffic_filtering=True,id=5eec44e9-3963-454e-931c-4f5a94548672,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5eec44e9-39') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5eec44e9-39, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:37 user nova-compute[72201]: INFO os_vif [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:5a:6f,bridge_name='br-int',has_traffic_filtering=True,id=5eec44e9-3963-454e-931c-4f5a94548672,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5eec44e9-39')
Aug 01 15:23:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768097343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768097343',id=12,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgbXmP8E15q/2hc/sGGZZBtyKuuqNtJdk8Iq/aT7Y+eOcUaZn3yzcvDKh1GBxnTbvzsaqHqnI8TS1PZHT0WQ3lAxYtOiZyiWfRylI4pBb6s6CN+8bL4bsjkBNc38pPNRQ==',key_name='tempest-keypair-335494459',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:22:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fce0072ae6c74c3997ea40225a876c68',ramdisk_id='',reservation_id='r-temo3w1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1828701596',owner_user_name='tempest-TaggedBootDevicesTest_v242-1828701596-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b68ccc67f5401b87a5951bde152dc5',uuid=d86ed500-ec1a-4e2c-a137-7a654ada6e11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52014d35-b37b-41ec-ab07-1ec05db59785", "address": "fa:16:3e:f0:e7:fb", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52014d35-b3", "ovs_interfaceid": "52014d35-b37b-41ec-ab07-1ec05db59785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converting VIF {"id": "52014d35-b37b-41ec-ab07-1ec05db59785", "address": "fa:16:3e:f0:e7:fb", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52014d35-b3", "ovs_interfaceid": "52014d35-b37b-41ec-ab07-1ec05db59785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e7:fb,bridge_name='br-int',has_traffic_filtering=True,id=52014d35-b37b-41ec-ab07-1ec05db59785,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52014d35-b3') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:23:37 user nova-compute[72201]: DEBUG os_vif [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e7:fb,bridge_name='br-int',has_traffic_filtering=True,id=52014d35-b37b-41ec-ab07-1ec05db59785,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52014d35-b3') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52014d35-b3, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:38 user nova-compute[72201]: INFO os_vif [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e7:fb,bridge_name='br-int',has_traffic_filtering=True,id=52014d35-b37b-41ec-ab07-1ec05db59785,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52014d35-b3')
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768097343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768097343',id=12,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgbXmP8E15q/2hc/sGGZZBtyKuuqNtJdk8Iq/aT7Y+eOcUaZn3yzcvDKh1GBxnTbvzsaqHqnI8TS1PZHT0WQ3lAxYtOiZyiWfRylI4pBb6s6CN+8bL4bsjkBNc38pPNRQ==',key_name='tempest-keypair-335494459',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:22:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fce0072ae6c74c3997ea40225a876c68',ramdisk_id='',reservation_id='r-temo3w1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1828701596',owner_user_name='tempest-TaggedBootDevicesTest_v242-1828701596-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b68ccc67f5401b87a5951bde152dc5',uuid=d86ed500-ec1a-4e2c-a137-7a654ada6e11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "892001ed-6dfd-4e71-baa0-dae05528700d", "address": "fa:16:3e:59:ec:7a", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892001ed-6d", "ovs_interfaceid": "892001ed-6dfd-4e71-baa0-dae05528700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converting VIF {"id": "892001ed-6dfd-4e71-baa0-dae05528700d", "address": "fa:16:3e:59:ec:7a", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892001ed-6d", "ovs_interfaceid": "892001ed-6dfd-4e71-baa0-dae05528700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:ec:7a,bridge_name='br-int',has_traffic_filtering=True,id=892001ed-6dfd-4e71-baa0-dae05528700d,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap892001ed-6d') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_vif [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:ec:7a,bridge_name='br-int',has_traffic_filtering=True,id=892001ed-6dfd-4e71-baa0-dae05528700d,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap892001ed-6d') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap892001ed-6d, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:38 user nova-compute[72201]: INFO os_vif [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:ec:7a,bridge_name='br-int',has_traffic_filtering=True,id=892001ed-6dfd-4e71-baa0-dae05528700d,network=Network(a9b84520-b6b2-422f-812b-28e4c30026bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap892001ed-6d')
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768097343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768097343',id=12,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgbXmP8E15q/2hc/sGGZZBtyKuuqNtJdk8Iq/aT7Y+eOcUaZn3yzcvDKh1GBxnTbvzsaqHqnI8TS1PZHT0WQ3lAxYtOiZyiWfRylI4pBb6s6CN+8bL4bsjkBNc38pPNRQ==',key_name='tempest-keypair-335494459',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:22:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fce0072ae6c74c3997ea40225a876c68',ramdisk_id='',reservation_id='r-temo3w1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1828701596',owner_user_name='tempest-TaggedBootDevicesTest_v242-1828701596-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b68ccc67f5401b87a5951bde152dc5',uuid=d86ed500-ec1a-4e2c-a137-7a654ada6e11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "babde51a-fce1-4954-8aa6-2e3715330cf0", "address": "fa:16:3e:41:5d:45", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabde51a-fc", "ovs_interfaceid": "babde51a-fce1-4954-8aa6-2e3715330cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converting VIF {"id": "babde51a-fce1-4954-8aa6-2e3715330cf0", "address": "fa:16:3e:41:5d:45", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabde51a-fc", "ovs_interfaceid": "babde51a-fce1-4954-8aa6-2e3715330cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:5d:45,bridge_name='br-int',has_traffic_filtering=True,id=babde51a-fce1-4954-8aa6-2e3715330cf0,network=Network(163285c6-73ff-4004-80ac-264355f256c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbabde51a-fc') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_vif [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:5d:45,bridge_name='br-int',has_traffic_filtering=True,id=babde51a-fce1-4954-8aa6-2e3715330cf0,network=Network(163285c6-73ff-4004-80ac-264355f256c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbabde51a-fc') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbabde51a-fc, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:38 user nova-compute[72201]: INFO os_vif [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:5d:45,bridge_name='br-int',has_traffic_filtering=True,id=babde51a-fce1-4954-8aa6-2e3715330cf0,network=Network(163285c6-73ff-4004-80ac-264355f256c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbabde51a-fc')
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768097343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768097343',id=12,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgbXmP8E15q/2hc/sGGZZBtyKuuqNtJdk8Iq/aT7Y+eOcUaZn3yzcvDKh1GBxnTbvzsaqHqnI8TS1PZHT0WQ3lAxYtOiZyiWfRylI4pBb6s6CN+8bL4bsjkBNc38pPNRQ==',key_name='tempest-keypair-335494459',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:22:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fce0072ae6c74c3997ea40225a876c68',ramdisk_id='',reservation_id='r-temo3w1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1828701596',owner_user_name='tempest-TaggedBootDevicesTest_v242-1828701596-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7b68ccc67f5401b87a5951bde152dc5',uuid=d86ed500-ec1a-4e2c-a137-7a654ada6e11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "address": "fa:16:3e:bd:98:53", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c3087dd-d4", "ovs_interfaceid": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converting VIF {"id": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "address": "fa:16:3e:bd:98:53", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c3087dd-d4", "ovs_interfaceid": "5c3087dd-d4fb-4ec6-8ae3-7a90993941ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:98:53,bridge_name='br-int',has_traffic_filtering=True,id=5c3087dd-d4fb-4ec6-8ae3-7a90993941ae,network=Network(163285c6-73ff-4004-80ac-264355f256c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c3087dd-d4') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_vif [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:98:53,bridge_name='br-int',has_traffic_filtering=True,id=5c3087dd-d4fb-4ec6-8ae3-7a90993941ae,network=Network(163285c6-73ff-4004-80ac-264355f256c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c3087dd-d4') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c3087dd-d4, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:38 user nova-compute[72201]: INFO os_vif [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:98:53,bridge_name='br-int',has_traffic_filtering=True,id=5c3087dd-d4fb-4ec6-8ae3-7a90993941ae,network=Network(163285c6-73ff-4004-80ac-264355f256c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c3087dd-d4')
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgUmnNhF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:23:38 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c1fb2a-0cd8-432e-9438-e74cac9e1d35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "080b458f-b0e4-4749-bb75-3efefa9dc8cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "080b458f-b0e4-4749-bb75-3efefa9dc8cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[293df27c-97c8-4112-9736-d939a91ffec6]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:23:38 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:38 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:23:38 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 (non-flash)
Aug 01 15:23:38 user nova-compute[72201]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:38 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:23:38 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc544305480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00'): ({'sde'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Removing single pathed devices sde {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edb0c9c-c4bd-45ba-91f1-5d9d9a53c64a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d1a63c-5141-4a9f-84ab-967af29e69d1]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Flushing IO for device /dev/sde {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3f3ec8-5a4d-4dcf-a681-f2a75fb65eae]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:23:38 user nova-compute[72201]: INFO nova.compute.claims [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Claim successful on node user
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b6943f-8573-439b-b775-2f17a41445a9]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] SCSI volumes sde have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc76423-4e06-407e-b1f8-cc42b30880b5]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2d91e5-554e-4edf-82a6-1c2487a488fa]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00, portal: 172.16.0.220,3260]
Aug 01 15:23:38 user nova-compute[72201]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00, portal: 172.16.0.220,3260] successful.
Aug 01 15:23:38 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01356eec-0a71-4aad-94bf-ac863bf85d00 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd80021a-6c20-43ea-94d6-b2fe17b753db]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] <== disconnect_volume: return (316ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXAvBuit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:23:38 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89e568d-4f74-45b6-ab9f-3867bb108051]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-816ccb45-6102-431c-8a6c-5fca735895ac req-a2bb0a64-6248-4128-912d-c4b7465849aa service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-plugged-5c6a1011-f0c2-4d1b-8559-116d9b15bdd8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-816ccb45-6102-431c-8a6c-5fca735895ac req-a2bb0a64-6248-4128-912d-c4b7465849aa service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-816ccb45-6102-431c-8a6c-5fca735895ac req-a2bb0a64-6248-4128-912d-c4b7465849aa service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-816ccb45-6102-431c-8a6c-5fca735895ac req-a2bb0a64-6248-4128-912d-c4b7465849aa service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-816ccb45-6102-431c-8a6c-5fca735895ac req-a2bb0a64-6248-4128-912d-c4b7465849aa service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-plugged-5c6a1011-f0c2-4d1b-8559-116d9b15bdd8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:38 user nova-compute[72201]: WARNING nova.compute.manager [req-816ccb45-6102-431c-8a6c-5fca735895ac req-a2bb0a64-6248-4128-912d-c4b7465849aa service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received unexpected event network-vif-plugged-5c6a1011-f0c2-4d1b-8559-116d9b15bdd8 for instance with vm_state active and task_state deleting.
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-plugged-b3bdcebc-0ff7-45e1-995e-790d24bc580f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-plugged-b3bdcebc-0ff7-45e1-995e-790d24bc580f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:38 user nova-compute[72201]: WARNING nova.compute.manager [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received unexpected event network-vif-plugged-b3bdcebc-0ff7-45e1-995e-790d24bc580f for instance with vm_state active and task_state deleting.
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-unplugged-5eec44e9-3963-454e-931c-4f5a94548672 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-unplugged-5eec44e9-3963-454e-931c-4f5a94548672 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-unplugged-5eec44e9-3963-454e-931c-4f5a94548672 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-plugged-5eec44e9-3963-454e-931c-4f5a94548672 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-plugged-5eec44e9-3963-454e-931c-4f5a94548672 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:38 user nova-compute[72201]: WARNING nova.compute.manager [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received unexpected event network-vif-plugged-5eec44e9-3963-454e-931c-4f5a94548672 for instance with vm_state active and task_state deleting.
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-unplugged-52014d35-b37b-41ec-ab07-1ec05db59785 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-unplugged-52014d35-b37b-41ec-ab07-1ec05db59785 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-unplugged-52014d35-b37b-41ec-ab07-1ec05db59785 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-plugged-52014d35-b37b-41ec-ab07-1ec05db59785 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-plugged-52014d35-b37b-41ec-ab07-1ec05db59785 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:38 user nova-compute[72201]: WARNING nova.compute.manager [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received unexpected event network-vif-plugged-52014d35-b37b-41ec-ab07-1ec05db59785 for instance with vm_state active and task_state deleting.
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-unplugged-892001ed-6dfd-4e71-baa0-dae05528700d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-unplugged-892001ed-6dfd-4e71-baa0-dae05528700d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-a6cca38a-6e90-458e-b591-32e574b2d731 req-4abdeedc-a3eb-4a48-bbdf-316acbc0c31b service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-unplugged-892001ed-6dfd-4e71-baa0-dae05528700d for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[77de42d1-da31-48e6-b36b-7a56df8480de]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:38 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:23:38 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:38 user nova-compute[72201]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 (non-flash)
Aug 01 15:23:38 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc54418add0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545'): ({'sdg'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Removing single pathed devices sdg {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc598e52-2b75-4e3f-a6f2-9c6af1b32a88]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a882248-6ad7-4322-8fb9-b24de11ec4fe]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Flushing IO for device /dev/sdg {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b849bdf8-6954-476c-a3a5-f64ec5e09f9c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[184b03ab-d2e5-4897-8af8-b50438ededd8]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] SCSI volumes sdg have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23e23b4-e70f-4f05-a5cf-db3ee94f4e56]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[78efd5ad-d15f-4886-86a7-ab422e0ed75d]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545, portal: 172.16.0.220,3260]
Aug 01 15:23:38 user nova-compute[72201]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545, portal: 172.16.0.220,3260] successful.
Aug 01 15:23:38 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8043bb3d-5c99-4f42-9fa7-8bc0d09ac545 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d5dd5a-bc67-4ded-aa1d-8c5d5d4ccf0f]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] <== disconnect_volume: return (316ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lHhYXNDx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:23:38 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f97a01-eb70-4c9f-843f-07c31fa63683]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[285ef609-c600-41d7-bc3b-5e2f14e4f8fd]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:38 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 (non-flash)
Aug 01 15:23:38 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5440b6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9'): ({'sdf'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Removing single pathed devices sdf {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafe8bfe-1b8a-4807-8cd8-f56f69cf9b3c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:23:38 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0747256-0b2e-489e-b300-f5f602af03f5]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Flushing IO for device /dev/sdf {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea6abd6-78fd-4b0e-a5b7-2894c753ec0a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8faf6e-8961-456d-91f3-07516f7eaf40]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] SCSI volumes sdf have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG nova.policy [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c3e96bf4fb645898f1fc7987f4f0ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cae4f1529be4369af543b05169568cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9cc370-c8b5-4eb5-8dbb-cc6b7c41d19f]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:23:39 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Creating image(s)
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "/opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "/opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "/opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede93e47-ce69-4ff2-b462-bb8c602fe3da]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9, portal: 172.16.0.220,3260]
Aug 01 15:23:39 user nova-compute[72201]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9, portal: 172.16.0.220,3260] successful.
Aug 01 15:23:39 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c452cc06-1e64-4257-8ee5-7f75f4ead5c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab73335-b8a9-4f52-a489-96cb9eeae347]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] <== disconnect_volume: return (316ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:23:39 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Deleting instance files /opt/stack/data/nova/instances/d86ed500-ec1a-4e2c-a137-7a654ada6e11_del
Aug 01 15:23:39 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Deletion of /opt/stack/data/nova/instances/d86ed500-ec1a-4e2c-a137-7a654ada6e11_del complete
Aug 01 15:23:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-1650428b-63e4-4dda-ab09-fc68f195e1ef req-21cba361-f696-4632-b173-888671418bf6 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-plugged-5c3087dd-d4fb-4ec6-8ae3-7a90993941ae {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1650428b-63e4-4dda-ab09-fc68f195e1ef req-21cba361-f696-4632-b173-888671418bf6 service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1650428b-63e4-4dda-ab09-fc68f195e1ef req-21cba361-f696-4632-b173-888671418bf6 service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1650428b-63e4-4dda-ab09-fc68f195e1ef req-21cba361-f696-4632-b173-888671418bf6 service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-1650428b-63e4-4dda-ab09-fc68f195e1ef req-21cba361-f696-4632-b173-888671418bf6 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-plugged-5c3087dd-d4fb-4ec6-8ae3-7a90993941ae {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:39 user nova-compute[72201]: WARNING nova.compute.manager [req-1650428b-63e4-4dda-ab09-fc68f195e1ef req-21cba361-f696-4632-b173-888671418bf6 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received unexpected event network-vif-plugged-5c3087dd-d4fb-4ec6-8ae3-7a90993941ae for instance with vm_state active and task_state deleting.
Aug 01 15:23:39 user nova-compute[72201]: INFO nova.compute.manager [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Took 3.26 seconds to destroy the instance on the hypervisor.
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.157s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.132s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc/disk 1073741824" returned: 0 in 0.046s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Successfully created port: 0783c0b9-9575-4498-9e45-11c7a3fb8b16 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Cannot resize image /opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lazy-loading 'migration_context' on Instance uuid 080b458f-b0e4-4749-bb75-3efefa9dc8cc {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Ensure instance console log exists: /opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG nova.compute.manager [req-03e319b1-c077-4e03-a5ee-c877598b1354 req-a8859e5c-f7f5-4890-8e30-2d59531cf3fa service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-plugged-892001ed-6dfd-4e71-baa0-dae05528700d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-03e319b1-c077-4e03-a5ee-c877598b1354 req-a8859e5c-f7f5-4890-8e30-2d59531cf3fa service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-03e319b1-c077-4e03-a5ee-c877598b1354 req-a8859e5c-f7f5-4890-8e30-2d59531cf3fa service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-03e319b1-c077-4e03-a5ee-c877598b1354 req-a8859e5c-f7f5-4890-8e30-2d59531cf3fa service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG nova.compute.manager [req-03e319b1-c077-4e03-a5ee-c877598b1354 req-a8859e5c-f7f5-4890-8e30-2d59531cf3fa service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-plugged-892001ed-6dfd-4e71-baa0-dae05528700d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:40 user nova-compute[72201]: WARNING nova.compute.manager [req-03e319b1-c077-4e03-a5ee-c877598b1354 req-a8859e5c-f7f5-4890-8e30-2d59531cf3fa service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received unexpected event network-vif-plugged-892001ed-6dfd-4e71-baa0-dae05528700d for instance with vm_state active and task_state deleting.
Aug 01 15:23:40 user nova-compute[72201]: DEBUG nova.compute.manager [req-03e319b1-c077-4e03-a5ee-c877598b1354 req-a8859e5c-f7f5-4890-8e30-2d59531cf3fa service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-unplugged-babde51a-fce1-4954-8aa6-2e3715330cf0 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-03e319b1-c077-4e03-a5ee-c877598b1354 req-a8859e5c-f7f5-4890-8e30-2d59531cf3fa service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-03e319b1-c077-4e03-a5ee-c877598b1354 req-a8859e5c-f7f5-4890-8e30-2d59531cf3fa service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-03e319b1-c077-4e03-a5ee-c877598b1354 req-a8859e5c-f7f5-4890-8e30-2d59531cf3fa service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG nova.compute.manager [req-03e319b1-c077-4e03-a5ee-c877598b1354 req-a8859e5c-f7f5-4890-8e30-2d59531cf3fa service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-unplugged-babde51a-fce1-4954-8aa6-2e3715330cf0 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG nova.compute.manager [req-03e319b1-c077-4e03-a5ee-c877598b1354 req-a8859e5c-f7f5-4890-8e30-2d59531cf3fa service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-unplugged-babde51a-fce1-4954-8aa6-2e3715330cf0 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG nova.compute.manager [req-03e319b1-c077-4e03-a5ee-c877598b1354 req-a8859e5c-f7f5-4890-8e30-2d59531cf3fa service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-plugged-babde51a-fce1-4954-8aa6-2e3715330cf0 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-03e319b1-c077-4e03-a5ee-c877598b1354 req-a8859e5c-f7f5-4890-8e30-2d59531cf3fa service nova] Acquiring lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-03e319b1-c077-4e03-a5ee-c877598b1354 req-a8859e5c-f7f5-4890-8e30-2d59531cf3fa service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-03e319b1-c077-4e03-a5ee-c877598b1354 req-a8859e5c-f7f5-4890-8e30-2d59531cf3fa service nova] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG nova.compute.manager [req-03e319b1-c077-4e03-a5ee-c877598b1354 req-a8859e5c-f7f5-4890-8e30-2d59531cf3fa service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] No waiting events found dispatching network-vif-plugged-babde51a-fce1-4954-8aa6-2e3715330cf0 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:40 user nova-compute[72201]: WARNING nova.compute.manager [req-03e319b1-c077-4e03-a5ee-c877598b1354 req-a8859e5c-f7f5-4890-8e30-2d59531cf3fa service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received unexpected event network-vif-plugged-babde51a-fce1-4954-8aa6-2e3715330cf0 for instance with vm_state active and task_state deleting.
Aug 01 15:23:40 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Successfully updated port: 0783c0b9-9575-4498-9e45-11c7a3fb8b16 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "refresh_cache-080b458f-b0e4-4749-bb75-3efefa9dc8cc" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquired lock "refresh_cache-080b458f-b0e4-4749-bb75-3efefa9dc8cc" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG nova.compute.manager [req-110ef3f3-4c8f-4d74-b4bd-e18478bc1de3 req-b7afdfac-6979-46d3-aaab-b01a0e71cfe8 service nova] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Received event network-changed-0783c0b9-9575-4498-9e45-11c7a3fb8b16 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG nova.compute.manager [req-110ef3f3-4c8f-4d74-b4bd-e18478bc1de3 req-b7afdfac-6979-46d3-aaab-b01a0e71cfe8 service nova] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Refreshing instance network info cache due to event network-changed-0783c0b9-9575-4498-9e45-11c7a3fb8b16. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-110ef3f3-4c8f-4d74-b4bd-e18478bc1de3 req-b7afdfac-6979-46d3-aaab-b01a0e71cfe8 service nova] Acquiring lock "refresh_cache-080b458f-b0e4-4749-bb75-3efefa9dc8cc" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:23:40 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Updating instance_info_cache with network_info: [{"id": "0783c0b9-9575-4498-9e45-11c7a3fb8b16", "address": "fa:16:3e:ec:ee:1e", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783c0b9-95", "ovs_interfaceid": "0783c0b9-9575-4498-9e45-11c7a3fb8b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Releasing lock "refresh_cache-080b458f-b0e4-4749-bb75-3efefa9dc8cc" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Instance network_info: |[{"id": "0783c0b9-9575-4498-9e45-11c7a3fb8b16", "address": "fa:16:3e:ec:ee:1e", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783c0b9-95", "ovs_interfaceid": "0783c0b9-9575-4498-9e45-11c7a3fb8b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-110ef3f3-4c8f-4d74-b4bd-e18478bc1de3 req-b7afdfac-6979-46d3-aaab-b01a0e71cfe8 service nova] Acquired lock "refresh_cache-080b458f-b0e4-4749-bb75-3efefa9dc8cc" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.network.neutron [req-110ef3f3-4c8f-4d74-b4bd-e18478bc1de3 req-b7afdfac-6979-46d3-aaab-b01a0e71cfe8 service nova] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Refreshing network info cache for port 0783c0b9-9575-4498-9e45-11c7a3fb8b16 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Start _get_guest_xml network_info=[{"id": "0783c0b9-9575-4498-9e45-11c7a3fb8b16", "address": "fa:16:3e:ec:ee:1e", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783c0b9-95", "ovs_interfaceid": "0783c0b9-9575-4498-9e45-11c7a3fb8b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:23:41 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:23:41 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1031468623',display_name='tempest-VolumesAdminNegativeTest-server-1031468623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1031468623',id=15,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cae4f1529be4369af543b05169568cc',ramdisk_id='',reservation_id='r-4ta0ro1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1786819113',owner_user_name='tempest-VolumesAdminNegativeTest-1786819113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:23:39Z,user_data=None,user_id='8c3e96bf4fb645898f1fc7987f4f0ccc',uuid=080b458f-b0e4-4749-bb75-3efefa9dc8cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0783c0b9-9575-4498-9e45-11c7a3fb8b16", "address": "fa:16:3e:ec:ee:1e", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783c0b9-95", "ovs_interfaceid": "0783c0b9-9575-4498-9e45-11c7a3fb8b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Converting VIF {"id": "0783c0b9-9575-4498-9e45-11c7a3fb8b16", "address": "fa:16:3e:ec:ee:1e", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783c0b9-95", "ovs_interfaceid": "0783c0b9-9575-4498-9e45-11c7a3fb8b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ee:1e,bridge_name='br-int',has_traffic_filtering=True,id=0783c0b9-9575-4498-9e45-11c7a3fb8b16,network=Network(a3eccf4e-95d7-49ef-a540-4ce7e9a490b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0783c0b9-95') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lazy-loading 'pci_devices' on Instance uuid 080b458f-b0e4-4749-bb75-3efefa9dc8cc {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-82c74e5a-d3be-48c5-b907-3705155dd395 req-c13bedc6-4169-46ca-ba12-cbec6d7da8a2 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-deleted-5c3087dd-d4fb-4ec6-8ae3-7a90993941ae {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:41 user nova-compute[72201]: INFO nova.compute.manager [req-82c74e5a-d3be-48c5-b907-3705155dd395 req-c13bedc6-4169-46ca-ba12-cbec6d7da8a2 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Neutron deleted interface 5c3087dd-d4fb-4ec6-8ae3-7a90993941ae; detaching it from the instance and deleting it from the info cache
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.network.neutron [req-82c74e5a-d3be-48c5-b907-3705155dd395 req-c13bedc6-4169-46ca-ba12-cbec6d7da8a2 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Updating instance_info_cache with network_info: [{"id": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "address": "fa:16:3e:43:cd:e6", "network": {"id": "43b87e91-7bb8-432c-abc5-9821f28350ef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-494863642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6a1011-f0", "ovs_interfaceid": "5c6a1011-f0c2-4d1b-8559-116d9b15bdd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "address": "fa:16:3e:e9:aa:f5", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bdcebc-0f", "ovs_interfaceid": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5eec44e9-3963-454e-931c-4f5a94548672", "address": "fa:16:3e:9c:5a:6f", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eec44e9-39", "ovs_interfaceid": "5eec44e9-3963-454e-931c-4f5a94548672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "52014d35-b37b-41ec-ab07-1ec05db59785", "address": "fa:16:3e:f0:e7:fb", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52014d35-b3", "ovs_interfaceid": "52014d35-b37b-41ec-ab07-1ec05db59785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "892001ed-6dfd-4e71-baa0-dae05528700d", "address": "fa:16:3e:59:ec:7a", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892001ed-6d", "ovs_interfaceid": "892001ed-6dfd-4e71-baa0-dae05528700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "babde51a-fce1-4954-8aa6-2e3715330cf0", "address": "fa:16:3e:41:5d:45", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabde51a-fc", "ovs_interfaceid": "babde51a-fce1-4954-8aa6-2e3715330cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:23:41 user nova-compute[72201]:   <uuid>080b458f-b0e4-4749-bb75-3efefa9dc8cc</uuid>
Aug 01 15:23:41 user nova-compute[72201]:   <name>instance-0000000f</name>
Aug 01 15:23:41 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:23:41 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:23:41 user nova-compute[72201]:   <metadata>
Aug 01 15:23:41 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:23:41 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:23:41 user nova-compute[72201]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1031468623</nova:name>
Aug 01 15:23:41 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:23:41</nova:creationTime>
Aug 01 15:23:41 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:23:41 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:23:41 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:23:41 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:23:41 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:23:41 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:23:41 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:23:41 user nova-compute[72201]:       <nova:owner>
Aug 01 15:23:41 user nova-compute[72201]:         <nova:user uuid="8c3e96bf4fb645898f1fc7987f4f0ccc">tempest-VolumesAdminNegativeTest-1786819113-project-member</nova:user>
Aug 01 15:23:41 user nova-compute[72201]:         <nova:project uuid="1cae4f1529be4369af543b05169568cc">tempest-VolumesAdminNegativeTest-1786819113</nova:project>
Aug 01 15:23:41 user nova-compute[72201]:       </nova:owner>
Aug 01 15:23:41 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:23:41 user nova-compute[72201]:       <nova:ports>
Aug 01 15:23:41 user nova-compute[72201]:         <nova:port uuid="0783c0b9-9575-4498-9e45-11c7a3fb8b16">
Aug 01 15:23:41 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 15:23:41 user nova-compute[72201]:         </nova:port>
Aug 01 15:23:41 user nova-compute[72201]:       </nova:ports>
Aug 01 15:23:41 user nova-compute[72201]:     </nova:instance>
Aug 01 15:23:41 user nova-compute[72201]:   </metadata>
Aug 01 15:23:41 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:23:41 user nova-compute[72201]:     <system>
Aug 01 15:23:41 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:23:41 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:23:41 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:23:41 user nova-compute[72201]:       <entry name="serial">080b458f-b0e4-4749-bb75-3efefa9dc8cc</entry>
Aug 01 15:23:41 user nova-compute[72201]:       <entry name="uuid">080b458f-b0e4-4749-bb75-3efefa9dc8cc</entry>
Aug 01 15:23:41 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:23:41 user nova-compute[72201]:     </system>
Aug 01 15:23:41 user nova-compute[72201]:   </sysinfo>
Aug 01 15:23:41 user nova-compute[72201]:   <os>
Aug 01 15:23:41 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:23:41 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:23:41 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:23:41 user nova-compute[72201]:   </os>
Aug 01 15:23:41 user nova-compute[72201]:   <features>
Aug 01 15:23:41 user nova-compute[72201]:     <acpi/>
Aug 01 15:23:41 user nova-compute[72201]:     <apic/>
Aug 01 15:23:41 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:23:41 user nova-compute[72201]:   </features>
Aug 01 15:23:41 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:23:41 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:23:41 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:23:41 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:23:41 user nova-compute[72201]:   </clock>
Aug 01 15:23:41 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:23:41 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:23:41 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:23:41 user nova-compute[72201]:   </cpu>
Aug 01 15:23:41 user nova-compute[72201]:   <devices>
Aug 01 15:23:41 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:23:41 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:23:41 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc/disk"/>
Aug 01 15:23:41 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:23:41 user nova-compute[72201]:     </disk>
Aug 01 15:23:41 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:23:41 user nova-compute[72201]:       <mac address="fa:16:3e:ec:ee:1e"/>
Aug 01 15:23:41 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:23:41 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:23:41 user nova-compute[72201]:       <target dev="tap0783c0b9-95"/>
Aug 01 15:23:41 user nova-compute[72201]:     </interface>
Aug 01 15:23:41 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:23:41 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc/console.log" append="off"/>
Aug 01 15:23:41 user nova-compute[72201]:     </serial>
Aug 01 15:23:41 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:23:41 user nova-compute[72201]:     <video>
Aug 01 15:23:41 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:23:41 user nova-compute[72201]:     </video>
Aug 01 15:23:41 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:23:41 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:23:41 user nova-compute[72201]:     </rng>
Aug 01 15:23:41 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:23:41 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:23:41 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:23:41 user nova-compute[72201]:     </memballoon>
Aug 01 15:23:41 user nova-compute[72201]:   </devices>
Aug 01 15:23:41 user nova-compute[72201]: </domain>
Aug 01 15:23:41 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1031468623',display_name='tempest-VolumesAdminNegativeTest-server-1031468623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1031468623',id=15,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cae4f1529be4369af543b05169568cc',ramdisk_id='',reservation_id='r-4ta0ro1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1786819113',owner_user_name='tempest-VolumesAdminNegativeTest-1786819113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:23:39Z,user_data=None,user_id='8c3e96bf4fb645898f1fc7987f4f0ccc',uuid=080b458f-b0e4-4749-bb75-3efefa9dc8cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0783c0b9-9575-4498-9e45-11c7a3fb8b16", "address": "fa:16:3e:ec:ee:1e", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783c0b9-95", "ovs_interfaceid": "0783c0b9-9575-4498-9e45-11c7a3fb8b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Converting VIF {"id": "0783c0b9-9575-4498-9e45-11c7a3fb8b16", "address": "fa:16:3e:ec:ee:1e", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783c0b9-95", "ovs_interfaceid": "0783c0b9-9575-4498-9e45-11c7a3fb8b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ee:1e,bridge_name='br-int',has_traffic_filtering=True,id=0783c0b9-9575-4498-9e45-11c7a3fb8b16,network=Network(a3eccf4e-95d7-49ef-a540-4ce7e9a490b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0783c0b9-95') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG os_vif [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ee:1e,bridge_name='br-int',has_traffic_filtering=True,id=0783c0b9-9575-4498-9e45-11c7a3fb8b16,network=Network(a3eccf4e-95d7-49ef-a540-4ce7e9a490b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0783c0b9-95') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0783c0b9-95, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0783c0b9-95, col_values=(('external_ids', {'iface-id': '0783c0b9-9575-4498-9e45-11c7a3fb8b16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:ee:1e', 'vm-uuid': '080b458f-b0e4-4749-bb75-3efefa9dc8cc'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-82c74e5a-d3be-48c5-b907-3705155dd395 req-c13bedc6-4169-46ca-ba12-cbec6d7da8a2 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Detach interface failed, port_id=5c3087dd-d4fb-4ec6-8ae3-7a90993941ae, reason: Instance d86ed500-ec1a-4e2c-a137-7a654ada6e11 could not be found. {{(pid=72201) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:41 user nova-compute[72201]: INFO os_vif [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ee:1e,bridge_name='br-int',has_traffic_filtering=True,id=0783c0b9-9575-4498-9e45-11c7a3fb8b16,network=Network(a3eccf4e-95d7-49ef-a540-4ce7e9a490b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0783c0b9-95')
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] No VIF found with MAC fa:16:3e:ec:ee:1e, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.network.neutron [req-110ef3f3-4c8f-4d74-b4bd-e18478bc1de3 req-b7afdfac-6979-46d3-aaab-b01a0e71cfe8 service nova] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Updated VIF entry in instance network info cache for port 0783c0b9-9575-4498-9e45-11c7a3fb8b16. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG nova.network.neutron [req-110ef3f3-4c8f-4d74-b4bd-e18478bc1de3 req-b7afdfac-6979-46d3-aaab-b01a0e71cfe8 service nova] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Updating instance_info_cache with network_info: [{"id": "0783c0b9-9575-4498-9e45-11c7a3fb8b16", "address": "fa:16:3e:ec:ee:1e", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783c0b9-95", "ovs_interfaceid": "0783c0b9-9575-4498-9e45-11c7a3fb8b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:23:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-110ef3f3-4c8f-4d74-b4bd-e18478bc1de3 req-b7afdfac-6979-46d3-aaab-b01a0e71cfe8 service nova] Releasing lock "refresh_cache-080b458f-b0e4-4749-bb75-3efefa9dc8cc" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:23:42 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903407.194318, 44cde39a-a94b-4fd8-8747-def0a68d77df => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:23:42 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] VM Stopped (Lifecycle Event)
Aug 01 15:23:42 user nova-compute[72201]: DEBUG nova.compute.manager [None req-80490b05-0a0f-46cc-88d8-edf7b56cba13 None None] [instance: 44cde39a-a94b-4fd8-8747-def0a68d77df] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:23:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-e23cf206-1f10-4df4-badd-7a3a6ebbff8e req-a0376f60-9bd3-42e8-94c7-9ad6022e3f8e service nova] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Received event network-vif-plugged-0783c0b9-9575-4498-9e45-11c7a3fb8b16 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e23cf206-1f10-4df4-badd-7a3a6ebbff8e req-a0376f60-9bd3-42e8-94c7-9ad6022e3f8e service nova] Acquiring lock "080b458f-b0e4-4749-bb75-3efefa9dc8cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e23cf206-1f10-4df4-badd-7a3a6ebbff8e req-a0376f60-9bd3-42e8-94c7-9ad6022e3f8e service nova] Lock "080b458f-b0e4-4749-bb75-3efefa9dc8cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e23cf206-1f10-4df4-badd-7a3a6ebbff8e req-a0376f60-9bd3-42e8-94c7-9ad6022e3f8e service nova] Lock "080b458f-b0e4-4749-bb75-3efefa9dc8cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-e23cf206-1f10-4df4-badd-7a3a6ebbff8e req-a0376f60-9bd3-42e8-94c7-9ad6022e3f8e service nova] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] No waiting events found dispatching network-vif-plugged-0783c0b9-9575-4498-9e45-11c7a3fb8b16 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:43 user nova-compute[72201]: WARNING nova.compute.manager [req-e23cf206-1f10-4df4-badd-7a3a6ebbff8e req-a0376f60-9bd3-42e8-94c7-9ad6022e3f8e service nova] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Received unexpected event network-vif-plugged-0783c0b9-9575-4498-9e45-11c7a3fb8b16 for instance with vm_state building and task_state spawning.
Aug 01 15:23:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-71e923db-934d-45c3-aba5-bcb9a48641f3 req-85257ba0-4c03-4c23-89ed-4ac723c9c7d3 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-deleted-5c6a1011-f0c2-4d1b-8559-116d9b15bdd8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:43 user nova-compute[72201]: INFO nova.compute.manager [req-71e923db-934d-45c3-aba5-bcb9a48641f3 req-85257ba0-4c03-4c23-89ed-4ac723c9c7d3 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Neutron deleted interface 5c6a1011-f0c2-4d1b-8559-116d9b15bdd8; detaching it from the instance and deleting it from the info cache
Aug 01 15:23:43 user nova-compute[72201]: DEBUG nova.network.neutron [req-71e923db-934d-45c3-aba5-bcb9a48641f3 req-85257ba0-4c03-4c23-89ed-4ac723c9c7d3 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Updating instance_info_cache with network_info: [{"id": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "address": "fa:16:3e:e9:aa:f5", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bdcebc-0f", "ovs_interfaceid": "b3bdcebc-0ff7-45e1-995e-790d24bc580f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5eec44e9-3963-454e-931c-4f5a94548672", "address": "fa:16:3e:9c:5a:6f", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eec44e9-39", "ovs_interfaceid": "5eec44e9-3963-454e-931c-4f5a94548672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "52014d35-b37b-41ec-ab07-1ec05db59785", "address": "fa:16:3e:f0:e7:fb", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52014d35-b3", "ovs_interfaceid": "52014d35-b37b-41ec-ab07-1ec05db59785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "892001ed-6dfd-4e71-baa0-dae05528700d", "address": "fa:16:3e:59:ec:7a", "network": {"id": "a9b84520-b6b2-422f-812b-28e4c30026bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-103006528", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap892001ed-6d", "ovs_interfaceid": "892001ed-6dfd-4e71-baa0-dae05528700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "babde51a-fce1-4954-8aa6-2e3715330cf0", "address": "fa:16:3e:41:5d:45", "network": {"id": "163285c6-73ff-4004-80ac-264355f256c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-512558226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fce0072ae6c74c3997ea40225a876c68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabde51a-fc", "ovs_interfaceid": "babde51a-fce1-4954-8aa6-2e3715330cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:23:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-71e923db-934d-45c3-aba5-bcb9a48641f3 req-85257ba0-4c03-4c23-89ed-4ac723c9c7d3 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Detach interface failed, port_id=5c6a1011-f0c2-4d1b-8559-116d9b15bdd8, reason: Instance d86ed500-ec1a-4e2c-a137-7a654ada6e11 could not be found. {{(pid=72201) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 15:23:44 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:23:44 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Took 5.12 seconds to deallocate network for instance.
Aug 01 15:23:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:44 user nova-compute[72201]: DEBUG nova.objects.instance [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lazy-loading 'flavor' on Instance uuid 3e869e37-c921-48e3-b89a-946bbcc1a5ed {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:23:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:44 user nova-compute[72201]: INFO nova.compute.manager [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Attaching volume 3d7258d0-79fd-4a0d-a041-1805193377fb to /dev/vdb
Aug 01 15:23:45 user nova-compute[72201]: DEBUG os_brick.utils [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[30050f79-1f15-4738-a71c-ac03fd149455]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-108539ca-422b-4484-873b-f41d34a5d680 req-bbc0f1b0-e972-4538-ba64-0141246aa1da service nova] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Received event network-vif-plugged-0783c0b9-9575-4498-9e45-11c7a3fb8b16 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-108539ca-422b-4484-873b-f41d34a5d680 req-bbc0f1b0-e972-4538-ba64-0141246aa1da service nova] Acquiring lock "080b458f-b0e4-4749-bb75-3efefa9dc8cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-108539ca-422b-4484-873b-f41d34a5d680 req-bbc0f1b0-e972-4538-ba64-0141246aa1da service nova] Lock "080b458f-b0e4-4749-bb75-3efefa9dc8cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-108539ca-422b-4484-873b-f41d34a5d680 req-bbc0f1b0-e972-4538-ba64-0141246aa1da service nova] Lock "080b458f-b0e4-4749-bb75-3efefa9dc8cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-108539ca-422b-4484-873b-f41d34a5d680 req-bbc0f1b0-e972-4538-ba64-0141246aa1da service nova] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] No waiting events found dispatching network-vif-plugged-0783c0b9-9575-4498-9e45-11c7a3fb8b16 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:45 user nova-compute[72201]: WARNING nova.compute.manager [req-108539ca-422b-4484-873b-f41d34a5d680 req-bbc0f1b0-e972-4538-ba64-0141246aa1da service nova] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Received unexpected event network-vif-plugged-0783c0b9-9575-4498-9e45-11c7a3fb8b16 for instance with vm_state building and task_state spawning.
Aug 01 15:23:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e64c5a-5365-42d3-ba61-311a4a63fa21]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e2cc74-eee5-49d8-a7fe-db72e9963c19]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0a3ab0-c861-48b4-9e1c-ef0bb33ffca1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:23:45 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:23:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc39a1b-b7d4-4b61-95ce-c473cc0e957c]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG os_brick.utils [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Updating existing volume attachment record: c2621fe9-67a7-4a44-9c79-d2da43fdaf15 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903425.2651174, 080b458f-b0e4-4749-bb75-3efefa9dc8cc => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:23:45 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] VM Resumed (Lifecycle Event)
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:23:45 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Instance spawned successfully.
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:23:45 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903425.2671273, 080b458f-b0e4-4749-bb75-3efefa9dc8cc => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:23:45 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] VM Started (Lifecycle Event)
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-4202cbea-b7bb-4eab-bc04-093ba4d65964 req-7801901c-75a4-42dc-be53-55c584ad0357 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-deleted-52014d35-b37b-41ec-ab07-1ec05db59785 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-4202cbea-b7bb-4eab-bc04-093ba4d65964 req-7801901c-75a4-42dc-be53-55c584ad0357 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-deleted-babde51a-fce1-4954-8aa6-2e3715330cf0 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-4202cbea-b7bb-4eab-bc04-093ba4d65964 req-7801901c-75a4-42dc-be53-55c584ad0357 service nova] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Received event network-vif-deleted-892001ed-6dfd-4e71-baa0-dae05528700d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:23:45 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:23:45 user nova-compute[72201]: INFO nova.compute.manager [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Took 6.44 seconds to spawn the instance on the hypervisor.
Aug 01 15:23:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:23:45 user nova-compute[72201]: INFO nova.compute.manager [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Took 7.30 seconds to build instance.
Aug 01 15:23:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f115f2e4-59ab-4eb9-b620-50212a5eb852 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "080b458f-b0e4-4749-bb75-3efefa9dc8cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.411s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquiring lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquiring lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:48 user nova-compute[72201]: INFO nova.compute.manager [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Terminating instance
Aug 01 15:23:48 user nova-compute[72201]: DEBUG nova.compute.manager [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:23:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:49 user nova-compute[72201]: DEBUG nova.compute.manager [req-bc05b289-bce4-4745-9af3-4a7483e1b462 req-24074987-87f9-4c4c-9c43-f71a6a5ee431 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Received event network-vif-unplugged-1740420d-31a4-494e-a19f-965960ba2b7c {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bc05b289-bce4-4745-9af3-4a7483e1b462 req-24074987-87f9-4c4c-9c43-f71a6a5ee431 service nova] Acquiring lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bc05b289-bce4-4745-9af3-4a7483e1b462 req-24074987-87f9-4c4c-9c43-f71a6a5ee431 service nova] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bc05b289-bce4-4745-9af3-4a7483e1b462 req-24074987-87f9-4c4c-9c43-f71a6a5ee431 service nova] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:49 user nova-compute[72201]: DEBUG nova.compute.manager [req-bc05b289-bce4-4745-9af3-4a7483e1b462 req-24074987-87f9-4c4c-9c43-f71a6a5ee431 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] No waiting events found dispatching network-vif-unplugged-1740420d-31a4-494e-a19f-965960ba2b7c {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:49 user nova-compute[72201]: DEBUG nova.compute.manager [req-bc05b289-bce4-4745-9af3-4a7483e1b462 req-24074987-87f9-4c4c-9c43-f71a6a5ee431 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Received event network-vif-unplugged-1740420d-31a4-494e-a19f-965960ba2b7c for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:23:49 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Instance destroyed successfully.
Aug 01 15:23:49 user nova-compute[72201]: DEBUG nova.objects.instance [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lazy-loading 'resources' on Instance uuid 0331ddd6-3aa1-47df-b1a3-4d539d26c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:23:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T15:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-550987008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-550987008',id=9,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKW0L2BXVsQ16XJ1IgW7J0+ugbX8pR23c/F0Bw5rv53o6+cDAxLCYwwmfBY+G8LBeeB3d6298OqDBKDi82m1vX50J7S1dTl4hFC+o+fm8gp01ukaYRBYhLpJ7oFuNVTSw==',key_name='tempest-keypair-1696360347',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:20:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1ec3967bfce4075a5b38e1f0ec13907',ramdisk_id='',reservation_id='r-7ql6n7s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1871630489',owner_user_name='tempest-TaggedAttachmentsTest-1871630489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:20:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecc1134a7e7a4eca98878addce19027b',uuid=0331ddd6-3aa1-47df-b1a3-4d539d26c708,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1740420d-31a4-494e-a19f-965960ba2b7c", "address": "fa:16:3e:b4:92:64", "network": {"id": "acf9d14a-8412-4dc0-80f9-ddfe2774470e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2056245363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1740420d-31", "ovs_interfaceid": "1740420d-31a4-494e-a19f-965960ba2b7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:23:49 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Converting VIF {"id": "1740420d-31a4-494e-a19f-965960ba2b7c", "address": "fa:16:3e:b4:92:64", "network": {"id": "acf9d14a-8412-4dc0-80f9-ddfe2774470e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2056245363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec3967bfce4075a5b38e1f0ec13907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1740420d-31", "ovs_interfaceid": "1740420d-31a4-494e-a19f-965960ba2b7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:23:49 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:92:64,bridge_name='br-int',has_traffic_filtering=True,id=1740420d-31a4-494e-a19f-965960ba2b7c,network=Network(acf9d14a-8412-4dc0-80f9-ddfe2774470e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1740420d-31') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:23:49 user nova-compute[72201]: DEBUG os_vif [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:92:64,bridge_name='br-int',has_traffic_filtering=True,id=1740420d-31a4-494e-a19f-965960ba2b7c,network=Network(acf9d14a-8412-4dc0-80f9-ddfe2774470e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1740420d-31') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:23:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1740420d-31, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:23:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:23:49 user nova-compute[72201]: INFO os_vif [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:92:64,bridge_name='br-int',has_traffic_filtering=True,id=1740420d-31a4-494e-a19f-965960ba2b7c,network=Network(acf9d14a-8412-4dc0-80f9-ddfe2774470e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1740420d-31')
Aug 01 15:23:49 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Deleting instance files /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708_del
Aug 01 15:23:49 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Deletion of /opt/stack/data/nova/instances/0331ddd6-3aa1-47df-b1a3-4d539d26c708_del complete
Aug 01 15:23:49 user nova-compute[72201]: INFO nova.compute.manager [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 01 15:23:49 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:23:49 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:23:49 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:23:50 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:23:50 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Took 1.01 seconds to deallocate network for instance.
Aug 01 15:23:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-68b42fc0-9c38-4ec7-b5f8-2b1465a60344 req-46d5dd8d-2a7c-46f9-94c0-fc5af887a080 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Received event network-vif-deleted-1740420d-31a4-494e-a19f-965960ba2b7c {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:50 user nova-compute[72201]: INFO nova.compute.manager [req-68b42fc0-9c38-4ec7-b5f8-2b1465a60344 req-46d5dd8d-2a7c-46f9-94c0-fc5af887a080 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Neutron deleted interface 1740420d-31a4-494e-a19f-965960ba2b7c; detaching it from the instance and deleting it from the info cache
Aug 01 15:23:50 user nova-compute[72201]: DEBUG nova.network.neutron [req-68b42fc0-9c38-4ec7-b5f8-2b1465a60344 req-46d5dd8d-2a7c-46f9-94c0-fc5af887a080 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:23:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-68b42fc0-9c38-4ec7-b5f8-2b1465a60344 req-46d5dd8d-2a7c-46f9-94c0-fc5af887a080 service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Detach interface failed, port_id=1740420d-31a4-494e-a19f-965960ba2b7c, reason: Instance 0331ddd6-3aa1-47df-b1a3-4d539d26c708 could not be found. {{(pid=72201) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 15:23:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:51 user nova-compute[72201]: DEBUG nova.compute.manager [req-0562c97a-8073-494d-9f79-ea276e43dd5e req-0b99bbf1-19eb-47c0-ae7b-9add80dfab4c service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Received event network-vif-plugged-1740420d-31a4-494e-a19f-965960ba2b7c {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:23:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0562c97a-8073-494d-9f79-ea276e43dd5e req-0b99bbf1-19eb-47c0-ae7b-9add80dfab4c service nova] Acquiring lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0562c97a-8073-494d-9f79-ea276e43dd5e req-0b99bbf1-19eb-47c0-ae7b-9add80dfab4c service nova] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0562c97a-8073-494d-9f79-ea276e43dd5e req-0b99bbf1-19eb-47c0-ae7b-9add80dfab4c service nova] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:51 user nova-compute[72201]: DEBUG nova.compute.manager [req-0562c97a-8073-494d-9f79-ea276e43dd5e req-0b99bbf1-19eb-47c0-ae7b-9add80dfab4c service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] No waiting events found dispatching network-vif-plugged-1740420d-31a4-494e-a19f-965960ba2b7c {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:23:51 user nova-compute[72201]: WARNING nova.compute.manager [req-0562c97a-8073-494d-9f79-ea276e43dd5e req-0b99bbf1-19eb-47c0-ae7b-9add80dfab4c service nova] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Received unexpected event network-vif-plugged-1740420d-31a4-494e-a19f-965960ba2b7c for instance with vm_state deleted and task_state None.
Aug 01 15:23:51 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:23:51 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:23:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:51 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Deleted allocations for instance 0331ddd6-3aa1-47df-b1a3-4d539d26c708
Aug 01 15:23:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-98c0ab84-3da4-4f51-b0d0-e901ea3cff39 tempest-TaggedAttachmentsTest-1871630489 tempest-TaggedAttachmentsTest-1871630489-project-member] Lock "0331ddd6-3aa1-47df-b1a3-4d539d26c708" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.621s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:52 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903417.6110802, d86ed500-ec1a-4e2c-a137-7a654ada6e11 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:23:52 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] VM Stopped (Lifecycle Event)
Aug 01 15:23:52 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ca2d1889-e6cf-449c-84c3-f6cec1dec4e9 None None] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:23:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBjwYhqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:23:54 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:23:54 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:23:54 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c46dcf-cc93-4ba7-b8bb-84727c931f39]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:23:54 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6ec5ed-3f38-43b2-8a56-85c653f3bd0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb] added
Aug 01 15:23:54 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[94105973-e494-4714-ac4e-2f19b8485f9c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[16567512-d9c6-4ad6-b82b-0dd6a9466a95]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tBjwYhqN {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tBjwYhqN" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6b9dd2-3ebd-44cd-829c-730a4ad79c08]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tBjwYhqN'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f6fd79-fb19-4696-bfbc-0f88ef048381]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f87d09c-6a93-4bbd-bd04-38ff2526ea47]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 15:23:54 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 15:23:54 user nova-compute[72201]:  {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:23:54 user nova-compute[72201]: WARNING os_brick.initiator.connectors.iscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 15:23:54 user nova-compute[72201]: 
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b111a5e7-274e-4e33-b520-b08b91816064]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb, portal: 172.16.0.220,3260]
Aug 01 15:23:54 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb, portal: 172.16.0.220,3260] successful.
Aug 01 15:23:54 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a849e3e-fc54-4cf1-8877-af291df67dc4]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c73b76c-2270-4ebf-a623-baa4562a5965]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:23:54 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:23:54 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e140b4a-d9ac-4342-ad4a-344ef643b1d1]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:23:54 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: None {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:23:55 user nova-compute[72201]: INFO nova.compute.manager [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] [instance: d86ed500-ec1a-4e2c-a137-7a654ada6e11] Took 11.02 seconds to detach 3 volumes for instance.
Aug 01 15:23:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:55 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:23:55 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:23:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:55 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Deleted allocations for instance d86ed500-ec1a-4e2c-a137-7a654ada6e11
Aug 01 15:23:55 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:23:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBjwYhqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:23:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:23:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26134663533306665', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:23:55 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134663533306665', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:23:55 user nova-compute[72201]: DEBUG nova.objects.instance [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lazy-loading 'flavor' on Instance uuid 3e869e37-c921-48e3-b89a-946bbcc1a5ed {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:23:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5ad79297-bbff-4334-b19c-0218e5fa73fe tempest-TaggedBootDevicesTest_v242-1828701596 tempest-TaggedBootDevicesTest_v242-1828701596-project-member] Lock "d86ed500-ec1a-4e2c-a137-7a654ada6e11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 19.987s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:55 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:23:55 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:23:55 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 15:23:55 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:23:55 user nova-compute[72201]:   <serial>3d7258d0-79fd-4a0d-a041-1805193377fb</serial>
Aug 01 15:23:55 user nova-compute[72201]: </disk>
Aug 01 15:23:55 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:23:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:23:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:23:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] No VIF found with MAC fa:16:3e:c4:7c:00, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:23:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5f8a09aa-f4ef-404c-a574-b5eca4a3ef6c tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.530s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:23:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:23:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "e2ca19ea-868c-40ad-a453-f6e348cfac15" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:23:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:23:59 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lazy-loading 'flavor' on Instance uuid e2ca19ea-868c-40ad-a453-f6e348cfac15 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "e2ca19ea-868c-40ad-a453-f6e348cfac15" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:00 user nova-compute[72201]: INFO nova.compute.manager [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Attaching volume 1d89fc35-7179-4837-9234-74e82df62143 to /dev/vdb
Aug 01 15:24:00 user nova-compute[72201]: DEBUG os_brick.utils [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[955fbca0-2ac3-4eb4-a170-39d2194171cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[960005ab-725d-410f-bfd9-f0b67847de51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c278b6-e123-4aea-bc53-c2fb016ee161]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1b401e-1831-47b7-8cd2-8239d35c37d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:24:00 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:24:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4a204e-6f28-4df6-a98b-1bbc891e5fc3]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG os_brick.utils [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:24:00 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Updating existing volume attachment record: 33f08bfc-822c-478e-be28-cdf4ab85751b {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:24:02 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:24:02 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:24:02 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:24:02 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:24:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-0f059ccc-f609-4cf3-a644-c3d1305ae26e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:24:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-0f059ccc-f609-4cf3-a644-c3d1305ae26e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:24:02 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:24:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:03 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Updating instance_info_cache with network_info: [{"id": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "address": "fa:16:3e:2d:e0:8c", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1fc053-fd", "ovs_interfaceid": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:24:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-0f059ccc-f609-4cf3-a644-c3d1305ae26e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:24:03 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:24:03 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:24:03 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:24:03 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:24:03 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:24:03 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:24:03 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:24:03 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:24:03 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:24:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:03 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:24:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:04 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903429.7444944, 0331ddd6-3aa1-47df-b1a3-4d539d26c708 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:24:04 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] VM Stopped (Lifecycle Event)
Aug 01 15:24:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:04 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d4c627b5-a66a-45e0-8abf-1a1c9ca8cd2e None None] [instance: 0331ddd6-3aa1-47df-b1a3-4d539d26c708] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:24:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-1bf3f50c-759a-4264-8f61-2d598723fb6e req-f71b3546-c0cf-497b-9259-efaaa84f959a service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received event network-changed-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:24:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-1bf3f50c-759a-4264-8f61-2d598723fb6e req-f71b3546-c0cf-497b-9259-efaaa84f959a service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Refreshing instance network info cache due to event network-changed-a2128465-b362-4945-945b-c02795ea1705. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:24:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1bf3f50c-759a-4264-8f61-2d598723fb6e req-f71b3546-c0cf-497b-9259-efaaa84f959a service nova] Acquiring lock "refresh_cache-3e869e37-c921-48e3-b89a-946bbcc1a5ed" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:24:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1bf3f50c-759a-4264-8f61-2d598723fb6e req-f71b3546-c0cf-497b-9259-efaaa84f959a service nova] Acquired lock "refresh_cache-3e869e37-c921-48e3-b89a-946bbcc1a5ed" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:24:05 user nova-compute[72201]: DEBUG nova.network.neutron [req-1bf3f50c-759a-4264-8f61-2d598723fb6e req-f71b3546-c0cf-497b-9259-efaaa84f959a service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Refreshing network info cache for port a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:24:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:24:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:06 user nova-compute[72201]: DEBUG nova.network.neutron [req-1bf3f50c-759a-4264-8f61-2d598723fb6e req-f71b3546-c0cf-497b-9259-efaaa84f959a service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Updated VIF entry in instance network info cache for port a2128465-b362-4945-945b-c02795ea1705. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:24:06 user nova-compute[72201]: DEBUG nova.network.neutron [req-1bf3f50c-759a-4264-8f61-2d598723fb6e req-f71b3546-c0cf-497b-9259-efaaa84f959a service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Updating instance_info_cache with network_info: [{"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:24:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1bf3f50c-759a-4264-8f61-2d598723fb6e req-f71b3546-c0cf-497b-9259-efaaa84f959a service nova] Releasing lock "refresh_cache-3e869e37-c921-48e3-b89a-946bbcc1a5ed" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:24:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:07 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:24:07 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:24:07 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=7500MB free_disk=25.611278533935547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:24:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:07 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance b64f1cfb-64f2-4493-8721-fc63fcd93bb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:24:07 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e2ca19ea-868c-40ad-a453-f6e348cfac15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:24:07 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 0f059ccc-f609-4cf3-a644-c3d1305ae26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:24:07 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 02d227b0-2b25-467f-a318-ab46aa391a31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:24:07 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance c918ea78-9bf8-421c-9a31-0da4104cd032 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:24:07 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 3e869e37-c921-48e3-b89a-946bbcc1a5ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:24:07 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance d4146775-a271-4822-84ec-e723ff09c386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:24:07 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 080b458f-b0e4-4749-bb75-3efefa9dc8cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:24:07 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:24:07 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:24:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-b6c16486-03d9-4cd8-bec4-d02e8843087c req-043b8757-3bcd-49a9-93a7-f9eb15eec97d service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received event network-changed-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:24:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-b6c16486-03d9-4cd8-bec4-d02e8843087c req-043b8757-3bcd-49a9-93a7-f9eb15eec97d service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Refreshing instance network info cache due to event network-changed-a2128465-b362-4945-945b-c02795ea1705. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:24:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b6c16486-03d9-4cd8-bec4-d02e8843087c req-043b8757-3bcd-49a9-93a7-f9eb15eec97d service nova] Acquiring lock "refresh_cache-3e869e37-c921-48e3-b89a-946bbcc1a5ed" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:24:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b6c16486-03d9-4cd8-bec4-d02e8843087c req-043b8757-3bcd-49a9-93a7-f9eb15eec97d service nova] Acquired lock "refresh_cache-3e869e37-c921-48e3-b89a-946bbcc1a5ed" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:24:07 user nova-compute[72201]: DEBUG nova.network.neutron [req-b6c16486-03d9-4cd8-bec4-d02e8843087c req-043b8757-3bcd-49a9-93a7-f9eb15eec97d service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Refreshing network info cache for port a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:24:07 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:24:07 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:24:07 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:24:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:08 user nova-compute[72201]: DEBUG nova.network.neutron [req-b6c16486-03d9-4cd8-bec4-d02e8843087c req-043b8757-3bcd-49a9-93a7-f9eb15eec97d service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Updated VIF entry in instance network info cache for port a2128465-b362-4945-945b-c02795ea1705. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:24:08 user nova-compute[72201]: DEBUG nova.network.neutron [req-b6c16486-03d9-4cd8-bec4-d02e8843087c req-043b8757-3bcd-49a9-93a7-f9eb15eec97d service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Updating instance_info_cache with network_info: [{"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:24:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b6c16486-03d9-4cd8-bec4-d02e8843087c req-043b8757-3bcd-49a9-93a7-f9eb15eec97d service nova] Releasing lock "refresh_cache-3e869e37-c921-48e3-b89a-946bbcc1a5ed" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDAPtnGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:24:09 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:24:09 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:24:09 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[03360a99-9e91-4993-8515-2f0ed81b3f09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:24:09 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3921488-8a2e-434c-a965-11e5017a6df2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143] added
Aug 01 15:24:09 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5677cc86-0f7e-479f-91bf-877bbb608b10]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fdd8c0-ac1c-46ab-80ad-5f657c8c9d38]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NDAPtnGz {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NDAPtnGz" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bb55f6-112f-4e78-a358-edc136b934a5]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NDAPtnGz'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5dd836-755c-4b15-ad24-5a3c80325133]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4442f3-5e22-4a32-84e9-c204ee06a7d3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:24:09 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:24:09 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ac34fe-91bd-40d3-8972-e799e0bb0e82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143, portal: 172.16.0.220,3260]
Aug 01 15:24:09 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143, portal: 172.16.0.220,3260] successful.
Aug 01 15:24:09 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f91344a-5344-42aa-8ff0-259ae76605f3]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea44c72-0daf-4e40-88be-af42b20305dd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:24:09 user nova-compute[72201]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 (non-flash)
Aug 01 15:24:09 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:24:09 user nova-compute[72201]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 (non-flash)
Aug 01 15:24:09 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b7612d-0086-4ede-8867-5d4f438d1ea5]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: None {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:24:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:10 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:24:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDAPtnGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:24:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:24:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23330613238306131', 'path': '/dev/sdc'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:24:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330613238306131', 'path': '/dev/sdc'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:24:10 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lazy-loading 'flavor' on Instance uuid e2ca19ea-868c-40ad-a453-f6e348cfac15 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:24:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:24:10 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:24:10 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 15:24:10 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:24:10 user nova-compute[72201]:   <serial>1d89fc35-7179-4837-9234-74e82df62143</serial>
Aug 01 15:24:10 user nova-compute[72201]: </disk>
Aug 01 15:24:10 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] No VIF found with MAC fa:16:3e:50:a8:af, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddd3a2c1-ffe2-4e2d-95de-f5fcc8ac7a36 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.580s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Acquiring lock "c918ea78-9bf8-421c-9a31-0da4104cd032" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Acquiring lock "c918ea78-9bf8-421c-9a31-0da4104cd032-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:11 user nova-compute[72201]: INFO nova.compute.manager [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Terminating instance
Aug 01 15:24:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:11 user nova-compute[72201]: INFO nova.compute.manager [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Rebooting instance
Aug 01 15:24:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "refresh_cache-3e869e37-c921-48e3-b89a-946bbcc1a5ed" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquired lock "refresh_cache-3e869e37-c921-48e3-b89a-946bbcc1a5ed" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG nova.network.neutron [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG nova.compute.manager [req-96485ce4-40a8-4174-ae16-6c92e3e6f0ba req-b65f6c0f-1f15-461c-88b5-09b53861062d service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Received event network-vif-unplugged-9fa0e19a-91cd-4217-805e-f16384cdc202 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-96485ce4-40a8-4174-ae16-6c92e3e6f0ba req-b65f6c0f-1f15-461c-88b5-09b53861062d service nova] Acquiring lock "c918ea78-9bf8-421c-9a31-0da4104cd032-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-96485ce4-40a8-4174-ae16-6c92e3e6f0ba req-b65f6c0f-1f15-461c-88b5-09b53861062d service nova] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-96485ce4-40a8-4174-ae16-6c92e3e6f0ba req-b65f6c0f-1f15-461c-88b5-09b53861062d service nova] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG nova.compute.manager [req-96485ce4-40a8-4174-ae16-6c92e3e6f0ba req-b65f6c0f-1f15-461c-88b5-09b53861062d service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] No waiting events found dispatching network-vif-unplugged-9fa0e19a-91cd-4217-805e-f16384cdc202 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:24:11 user nova-compute[72201]: DEBUG nova.compute.manager [req-96485ce4-40a8-4174-ae16-6c92e3e6f0ba req-b65f6c0f-1f15-461c-88b5-09b53861062d service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Received event network-vif-unplugged-9fa0e19a-91cd-4217-805e-f16384cdc202 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:24:12 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Instance destroyed successfully.
Aug 01 15:24:12 user nova-compute[72201]: DEBUG nova.objects.instance [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lazy-loading 'resources' on Instance uuid c918ea78-9bf8-421c-9a31-0da4104cd032 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:24:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2063844553',display_name='tempest-TestVolumeSwap-server-2063844553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2063844553',id=8,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG31zKdjA+nV3aViiy/kA7pD76euxim7XGL8RdaM7NlJPaMI82FEiG2z4hgiDpepdhdpGZD/NLDfQyGKa+MJFH//JHaXb7ubOrH464F7FjIz8ZPJ7vVujz70wKWIEiLMQw==',key_name='tempest-keypair-1763906668',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:20:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a72226dbcf9349bbbedd3303f48f5182',ramdisk_id='',reservation_id='r-0dcz74z5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1195353484',owner_user_name='tempest-TestVolumeSwap-1195353484-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:20:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='061c5fc508834521bad235359e96006b',uuid=c918ea78-9bf8-421c-9a31-0da4104cd032,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fa0e19a-91cd-4217-805e-f16384cdc202", "address": "fa:16:3e:ed:51:e0", "network": {"id": "e2b28e3d-396a-4811-9197-38a25d473000", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1150356177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72226dbcf9349bbbedd3303f48f5182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa0e19a-91", "ovs_interfaceid": "9fa0e19a-91cd-4217-805e-f16384cdc202", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:24:12 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Converting VIF {"id": "9fa0e19a-91cd-4217-805e-f16384cdc202", "address": "fa:16:3e:ed:51:e0", "network": {"id": "e2b28e3d-396a-4811-9197-38a25d473000", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1150356177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72226dbcf9349bbbedd3303f48f5182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa0e19a-91", "ovs_interfaceid": "9fa0e19a-91cd-4217-805e-f16384cdc202", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:24:12 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:51:e0,bridge_name='br-int',has_traffic_filtering=True,id=9fa0e19a-91cd-4217-805e-f16384cdc202,network=Network(e2b28e3d-396a-4811-9197-38a25d473000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa0e19a-91') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:24:12 user nova-compute[72201]: DEBUG os_vif [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:51:e0,bridge_name='br-int',has_traffic_filtering=True,id=9fa0e19a-91cd-4217-805e-f16384cdc202,network=Network(e2b28e3d-396a-4811-9197-38a25d473000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa0e19a-91') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:24:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fa0e19a-91, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:24:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:12 user nova-compute[72201]: INFO os_vif [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:51:e0,bridge_name='br-int',has_traffic_filtering=True,id=9fa0e19a-91cd-4217-805e-f16384cdc202,network=Network(e2b28e3d-396a-4811-9197-38a25d473000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa0e19a-91')
Aug 01 15:24:12 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Deleting instance files /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032_del
Aug 01 15:24:12 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Deletion of /opt/stack/data/nova/instances/c918ea78-9bf8-421c-9a31-0da4104cd032_del complete
Aug 01 15:24:12 user nova-compute[72201]: INFO nova.compute.manager [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 15:24:12 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:24:12 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:24:12 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:24:12 user nova-compute[72201]: INFO nova.compute.manager [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Rebuilding instance
Aug 01 15:24:12 user nova-compute[72201]: DEBUG nova.objects.instance [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lazy-loading 'trusted_certs' on Instance uuid e2ca19ea-868c-40ad-a453-f6e348cfac15 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:24:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:24:12 user nova-compute[72201]: DEBUG nova.objects.instance [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lazy-loading 'pci_requests' on Instance uuid e2ca19ea-868c-40ad-a453-f6e348cfac15 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:24:12 user nova-compute[72201]: DEBUG nova.objects.instance [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lazy-loading 'pci_devices' on Instance uuid e2ca19ea-868c-40ad-a453-f6e348cfac15 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:24:12 user nova-compute[72201]: DEBUG nova.objects.instance [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lazy-loading 'resources' on Instance uuid e2ca19ea-868c-40ad-a453-f6e348cfac15 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:24:12 user nova-compute[72201]: DEBUG nova.objects.instance [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lazy-loading 'migration_context' on Instance uuid e2ca19ea-868c-40ad-a453-f6e348cfac15 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:24:12 user nova-compute[72201]: DEBUG nova.objects.instance [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72201) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 15:24:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG nova.network.neutron [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Updating instance_info_cache with network_info: [{"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Releasing lock "refresh_cache-3e869e37-c921-48e3-b89a-946bbcc1a5ed" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG nova.compute.manager [req-973c6918-c2ee-4b89-acfa-dbf3460612dc req-33fb7385-12eb-477e-a961-c0df4930ef3d service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Received event network-vif-deleted-9fa0e19a-91cd-4217-805e-f16384cdc202 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:24:13 user nova-compute[72201]: INFO nova.compute.manager [req-973c6918-c2ee-4b89-acfa-dbf3460612dc req-33fb7385-12eb-477e-a961-c0df4930ef3d service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Neutron deleted interface 9fa0e19a-91cd-4217-805e-f16384cdc202; detaching it from the instance and deleting it from the info cache
Aug 01 15:24:13 user nova-compute[72201]: DEBUG nova.network.neutron [req-973c6918-c2ee-4b89-acfa-dbf3460612dc req-33fb7385-12eb-477e-a961-c0df4930ef3d service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:24:13 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Took 1.11 seconds to deallocate network for instance.
Aug 01 15:24:13 user nova-compute[72201]: DEBUG nova.compute.manager [req-973c6918-c2ee-4b89-acfa-dbf3460612dc req-33fb7385-12eb-477e-a961-c0df4930ef3d service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Detach interface failed, port_id=9fa0e19a-91cd-4217-805e-f16384cdc202, reason: Instance c918ea78-9bf8-421c-9a31-0da4104cd032 could not be found. {{(pid=72201) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:13 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Instance destroyed successfully.
Aug 01 15:24:13 user nova-compute[72201]: INFO nova.compute.manager [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Detaching volume 1d89fc35-7179-4837-9234-74e82df62143
Aug 01 15:24:13 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:24:13 user nova-compute[72201]: INFO nova.virt.block_device [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Attempting to driver detach volume 1d89fc35-7179-4837-9234-74e82df62143 from mountpoint /dev/vdb
Aug 01 15:24:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Attempting to detach device vdb from instance e2ca19ea-868c-40ad-a453-f6e348cfac15 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:24:13 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:24:13 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 15:24:13 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:24:13 user nova-compute[72201]:   <serial>1d89fc35-7179-4837-9234-74e82df62143</serial>
Aug 01 15:24:13 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:24:13 user nova-compute[72201]: </disk>
Aug 01 15:24:13 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:13 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Successfully detached device vdb from instance e2ca19ea-868c-40ad-a453-f6e348cfac15 from the persistent domain config.
Aug 01 15:24:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDAPtnGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:24:13 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 15:24:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ece180-0be5-4d84-a668-87fd0637004f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:13 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Deleted allocations for instance c918ea78-9bf8-421c-9a31-0da4104cd032
Aug 01 15:24:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38a584d-6df5-4d23-a1b7-275046df60a4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:24:13 user nova-compute[72201]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 (non-flash)
Aug 01 15:24:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:24:13 user nova-compute[72201]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 (non-flash)
Aug 01 15:24:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c5a7130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143'): ({'sdc'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Removing single pathed devices sdc {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6423b9d6-684e-4cc7-87dc-64f02ccebe85]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff39229b-d293-437a-9f98-ab576215dc19]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Flushing IO for device /dev/sdc {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ad5c3e-2e0f-432f-80ce-415965cbb9e5]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d304b797-72e3-462f-a323-852981f1a734 tempest-TestVolumeSwap-1195353484 tempest-TestVolumeSwap-1195353484-project-member] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.718s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f358bd-d31a-4375-8e55-5fe2deb0370d]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_14a94d', '/dev/disk/by-id/scsi-23330613238306131', '/dev/disk/by-id/scsi-1SCST_BIO14a94d-30a280a12d10daf3') {{(pid=83290) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03789fc-be95-4b84-a652-b5ca37f243df]: (4, None) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Instance destroyed successfully.
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c2a78b-6a91-49a3-8358-3b3b3a64169c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.objects.instance [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lazy-loading 'resources' on Instance uuid 3e869e37-c921-48e3-b89a-946bbcc1a5ed {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1436254959',display_name='tempest-TestMinimumBasicScenario-server-1436254959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1436254959',id=13,image_ref='01e1b9e2-1afb-49c6-88ca-e8c8a2144418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXoI7zVJBdB0lr76+ibKx3rQTpkh4ZH+yifRw2rO8nKGcImkfspfIluEMinD7nXk08i9/YN+XHFBkn4ywU/yP/bAjF2s6xHFjvo2R0jo8pEhg87HKQHG3uQq9h9kIwiKA==',key_name='tempest-TestMinimumBasicScenario-2124161389',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:21:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5e1f59585b44545ae3ec0cdfa480fab',ramdisk_id='',reservation_id='r-5r163mpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='01e1b9e2-1afb-49c6-88ca-e8c8a2144418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1524896067',owner_user_name='tempest-TestMinimumBasicScenario-1524896067-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:24:13Z,user_data=None,user_id='2c5267b768cf46958384d9ad4c585f82',uuid=3e869e37-c921-48e3-b89a-946bbcc1a5ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Converting VIF {"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=a2128465-b362-4945-945b-c02795ea1705,network=Network(d1dbf82c-df93-48ae-b118-278943635ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2128465-b3') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_vif [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=a2128465-b362-4945-945b-c02795ea1705,network=Network(d1dbf82c-df93-48ae-b118-278943635ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2128465-b3') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.compute.manager [req-6d22d776-1a8f-4bb3-aefb-dce72fb026fd req-a5284118-ba53-4d3c-9b3e-6caa2a2055db service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Received event network-vif-plugged-9fa0e19a-91cd-4217-805e-f16384cdc202 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6d22d776-1a8f-4bb3-aefb-dce72fb026fd req-a5284118-ba53-4d3c-9b3e-6caa2a2055db service nova] Acquiring lock "c918ea78-9bf8-421c-9a31-0da4104cd032-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6d22d776-1a8f-4bb3-aefb-dce72fb026fd req-a5284118-ba53-4d3c-9b3e-6caa2a2055db service nova] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6d22d776-1a8f-4bb3-aefb-dce72fb026fd req-a5284118-ba53-4d3c-9b3e-6caa2a2055db service nova] Lock "c918ea78-9bf8-421c-9a31-0da4104cd032-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.compute.manager [req-6d22d776-1a8f-4bb3-aefb-dce72fb026fd req-a5284118-ba53-4d3c-9b3e-6caa2a2055db service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] No waiting events found dispatching network-vif-plugged-9fa0e19a-91cd-4217-805e-f16384cdc202 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:24:14 user nova-compute[72201]: WARNING nova.compute.manager [req-6d22d776-1a8f-4bb3-aefb-dce72fb026fd req-a5284118-ba53-4d3c-9b3e-6caa2a2055db service nova] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Received unexpected event network-vif-plugged-9fa0e19a-91cd-4217-805e-f16384cdc202 for instance with vm_state deleted and task_state None.
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.compute.manager [req-6d22d776-1a8f-4bb3-aefb-dce72fb026fd req-a5284118-ba53-4d3c-9b3e-6caa2a2055db service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Received event network-vif-unplugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6d22d776-1a8f-4bb3-aefb-dce72fb026fd req-a5284118-ba53-4d3c-9b3e-6caa2a2055db service nova] Acquiring lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6d22d776-1a8f-4bb3-aefb-dce72fb026fd req-a5284118-ba53-4d3c-9b3e-6caa2a2055db service nova] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6d22d776-1a8f-4bb3-aefb-dce72fb026fd req-a5284118-ba53-4d3c-9b3e-6caa2a2055db service nova] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.compute.manager [req-6d22d776-1a8f-4bb3-aefb-dce72fb026fd req-a5284118-ba53-4d3c-9b3e-6caa2a2055db service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] No waiting events found dispatching network-vif-unplugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:24:14 user nova-compute[72201]: WARNING nova.compute.manager [req-6d22d776-1a8f-4bb3-aefb-dce72fb026fd req-a5284118-ba53-4d3c-9b3e-6caa2a2055db service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Received unexpected event network-vif-unplugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 for instance with vm_state active and task_state rebuilding.
Aug 01 15:24:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2128465-b3, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:14 user nova-compute[72201]: INFO os_vif [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=a2128465-b362-4945-945b-c02795ea1705,network=Network(d1dbf82c-df93-48ae-b118-278943635ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2128465-b3')
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBjwYhqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:24:14 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[284e7cf8-d7e8-4d05-9bfe-62df1301b1ef]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143, portal: 172.16.0.220,3260]
Aug 01 15:24:14 user nova-compute[72201]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143, portal: 172.16.0.220,3260] successful.
Aug 01 15:24:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ef6b61-6041-42a2-aba7-fc7089c9f210]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] <== disconnect_volume: return (329ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.035s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca142d0b-4bc7-4853-8ec0-b148f824fb21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa7e849-3f94-4b20-8436-1acaed9fc748]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:24:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:24:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c65fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb'): ({'sdb'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Removing single pathed devices sdb {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1a8d00-b340-4097-956f-1a72614d7280]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed7e269-024e-4d97-8717-4595a3e5e713]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Flushing IO for device /dev/sdb {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11f61f7-949f-4e7f-a814-629edb986aab]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f61703-af99-4344-b1fd-1bd554445202]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e3a83b-2771-46ea-915c-b2ff0dc8e374]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcda183-1037-4113-a770-5d81e2d32bd9]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb, portal: 172.16.0.220,3260]
Aug 01 15:24:14 user nova-compute[72201]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb, portal: 172.16.0.220,3260] successful.
Aug 01 15:24:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc69b01-d943-45dc-8ee8-3db139175cb4]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] <== disconnect_volume: return (328ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Start _get_guest_xml network_info=[{"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=01e1b9e2-1afb-49c6-88ca-e8c8a2144418,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '01e1b9e2-1afb-49c6-88ca-e8c8a2144418'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBjwYhqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '3e869e37-c921-48e3-b89a-946bbcc1a5ed', 'attached_at': '', 'detached_at': '', 'volume_id': '3d7258d0-79fd-4a0d-a041-1805193377fb', 'serial': '3d7258d0-79fd-4a0d-a041-1805193377fb'}, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'c2621fe9-67a7-4a44-9c79-d2da43fdaf15', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:24:14 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:24:14 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=01e1b9e2-1afb-49c6-88ca-e8c8a2144418,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.objects.instance [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3e869e37-c921-48e3-b89a-946bbcc1a5ed {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBjwYhqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:24:14 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:24:14 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:24:14 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfc4eb8-4dc4-45e6-a92a-1c2c3d7b64ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:24:14 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d66dc0-5d17-4f5d-8066-06afcaf08836]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb] added
Aug 01 15:24:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db827f1-490c-4a20-a831-876b684cd71c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7d3e73-62e5-4e20-a8c5-0980d9b3a574]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tBjwYhqN {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tBjwYhqN" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabdf33b-1e8c-4949-bf47-f5b4816fa4ad]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tBjwYhqN'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af04b99-1571-4eeb-8f17-b50366042fd4]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8febffe-26da-412e-bbcd-1d57ebcd4010]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 15:24:14 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 15:24:14 user nova-compute[72201]:  {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:24:14 user nova-compute[72201]: WARNING os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 15:24:14 user nova-compute[72201]: 
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc8e06f-489f-45b2-8928-299edc157286]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb, portal: 172.16.0.220,3260]
Aug 01 15:24:14 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb, portal: 172.16.0.220,3260] successful.
Aug 01 15:24:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f523205-8ad4-43cb-8939-bd6ad7bdfd00]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[45793519-80d1-4cc7-bd08-d456eee0a051]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:24:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:24:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d499566d-0305-4a98-b276-c96da29615bd]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: None {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:24:15 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Instance destroyed successfully.
Aug 01 15:24:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:20:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-259126896',display_name='tempest-ServerActionsTestOtherA-server-1100798592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-259126896',id=3,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj9M7ZGdr6vvGAAN6LlX0Yd4KFWs7o7dSiIrZzG0de25MryOgdU0IQWkOsGcYGYZLChUKVpEI60JU+ZGbYHXhk4M5ia3Yx+QGjlFCbCEmncodiyKPCipVQmd8JPh2FoTg==',key_name='tempest-keypair-1499887671',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:20:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e85c7d5f159c4ff2896b5549cf73b977',ramdisk_id='',reservation_id='r-a8sv6s0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-765053637',owner_user_name='tempest-ServerActionsTestOtherA-765053637-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:24:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ccd18b99219749fe8febdc0da8fc4388',uuid=e2ca19ea-868c-40ad-a453-f6e348cfac15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converting VIF {"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:a8:af,bridge_name='br-int',has_traffic_filtering=True,id=bc611803-5aa5-4b8b-961b-cd6c43317b21,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc611803-5a') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG os_vif [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:a8:af,bridge_name='br-int',has_traffic_filtering=True,id=bc611803-5aa5-4b8b-961b-cd6c43317b21,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc611803-5a') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc611803-5a, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:24:15 user nova-compute[72201]: INFO os_vif [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:a8:af,bridge_name='br-int',has_traffic_filtering=True,id=bc611803-5aa5-4b8b-961b-cd6c43317b21,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc611803-5a')
Aug 01 15:24:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDAPtnGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:24:15 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 15:24:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBjwYhqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26134663533306665', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134663533306665', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.741s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[48836463-9d30-4821-983a-0ad69788ffa9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1436254959',display_name='tempest-TestMinimumBasicScenario-server-1436254959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1436254959',id=13,image_ref='01e1b9e2-1afb-49c6-88ca-e8c8a2144418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXoI7zVJBdB0lr76+ibKx3rQTpkh4ZH+yifRw2rO8nKGcImkfspfIluEMinD7nXk08i9/YN+XHFBkn4ywU/yP/bAjF2s6xHFjvo2R0jo8pEhg87HKQHG3uQq9h9kIwiKA==',key_name='tempest-TestMinimumBasicScenario-2124161389',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:21:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5e1f59585b44545ae3ec0cdfa480fab',ramdisk_id='',reservation_id='r-5r163mpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='01e1b9e2-1afb-49c6-88ca-e8c8a2144418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1524896067',owner_user_name='tempest-TestMinimumBasicScenario-1524896067-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:24:13Z,user_data=None,user_id='2c5267b768cf46958384d9ad4c585f82',uuid=3e869e37-c921-48e3-b89a-946bbcc1a5ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Converting VIF {"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=a2128465-b362-4945-945b-c02795ea1705,network=Network(d1dbf82c-df93-48ae-b118-278943635ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2128465-b3') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG nova.objects.instance [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e869e37-c921-48e3-b89a-946bbcc1a5ed {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:24:15 user nova-compute[72201]:   <uuid>3e869e37-c921-48e3-b89a-946bbcc1a5ed</uuid>
Aug 01 15:24:15 user nova-compute[72201]:   <name>instance-0000000d</name>
Aug 01 15:24:15 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:24:15 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:24:15 user nova-compute[72201]:   <metadata>
Aug 01 15:24:15 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:24:15 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:24:15 user nova-compute[72201]:       <nova:name>tempest-TestMinimumBasicScenario-server-1436254959</nova:name>
Aug 01 15:24:15 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:24:14</nova:creationTime>
Aug 01 15:24:15 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:24:15 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:24:15 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:24:15 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:24:15 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:24:15 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:24:15 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:24:15 user nova-compute[72201]:       <nova:owner>
Aug 01 15:24:15 user nova-compute[72201]:         <nova:user uuid="2c5267b768cf46958384d9ad4c585f82">tempest-TestMinimumBasicScenario-1524896067-project-member</nova:user>
Aug 01 15:24:15 user nova-compute[72201]:         <nova:project uuid="b5e1f59585b44545ae3ec0cdfa480fab">tempest-TestMinimumBasicScenario-1524896067</nova:project>
Aug 01 15:24:15 user nova-compute[72201]:       </nova:owner>
Aug 01 15:24:15 user nova-compute[72201]:       <nova:root type="image" uuid="01e1b9e2-1afb-49c6-88ca-e8c8a2144418"/>
Aug 01 15:24:15 user nova-compute[72201]:       <nova:ports>
Aug 01 15:24:15 user nova-compute[72201]:         <nova:port uuid="a2128465-b362-4945-945b-c02795ea1705">
Aug 01 15:24:15 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 15:24:15 user nova-compute[72201]:         </nova:port>
Aug 01 15:24:15 user nova-compute[72201]:       </nova:ports>
Aug 01 15:24:15 user nova-compute[72201]:     </nova:instance>
Aug 01 15:24:15 user nova-compute[72201]:   </metadata>
Aug 01 15:24:15 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:24:15 user nova-compute[72201]:     <system>
Aug 01 15:24:15 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:24:15 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:24:15 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:24:15 user nova-compute[72201]:       <entry name="serial">3e869e37-c921-48e3-b89a-946bbcc1a5ed</entry>
Aug 01 15:24:15 user nova-compute[72201]:       <entry name="uuid">3e869e37-c921-48e3-b89a-946bbcc1a5ed</entry>
Aug 01 15:24:15 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:24:15 user nova-compute[72201]:     </system>
Aug 01 15:24:15 user nova-compute[72201]:   </sysinfo>
Aug 01 15:24:15 user nova-compute[72201]:   <os>
Aug 01 15:24:15 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:24:15 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:24:15 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:24:15 user nova-compute[72201]:   </os>
Aug 01 15:24:15 user nova-compute[72201]:   <features>
Aug 01 15:24:15 user nova-compute[72201]:     <acpi/>
Aug 01 15:24:15 user nova-compute[72201]:     <apic/>
Aug 01 15:24:15 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:24:15 user nova-compute[72201]:   </features>
Aug 01 15:24:15 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:24:15 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:24:15 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:24:15 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:24:15 user nova-compute[72201]:   </clock>
Aug 01 15:24:15 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:24:15 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:24:15 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:24:15 user nova-compute[72201]:   </cpu>
Aug 01 15:24:15 user nova-compute[72201]:   <devices>
Aug 01 15:24:15 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:24:15 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:24:15 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk"/>
Aug 01 15:24:15 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:24:15 user nova-compute[72201]:     </disk>
Aug 01 15:24:15 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:24:15 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:24:15 user nova-compute[72201]:       <source dev="/dev/sdb"/>
Aug 01 15:24:15 user nova-compute[72201]:       <target dev="vdb" bus="virtio"/>
Aug 01 15:24:15 user nova-compute[72201]:       <serial>3d7258d0-79fd-4a0d-a041-1805193377fb</serial>
Aug 01 15:24:15 user nova-compute[72201]:     </disk>
Aug 01 15:24:15 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:24:15 user nova-compute[72201]:       <mac address="fa:16:3e:c4:7c:00"/>
Aug 01 15:24:15 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:24:15 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:24:15 user nova-compute[72201]:       <target dev="tapa2128465-b3"/>
Aug 01 15:24:15 user nova-compute[72201]:     </interface>
Aug 01 15:24:15 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:24:15 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/console.log" append="off"/>
Aug 01 15:24:15 user nova-compute[72201]:     </serial>
Aug 01 15:24:15 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:24:15 user nova-compute[72201]:     <video>
Aug 01 15:24:15 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:24:15 user nova-compute[72201]:     </video>
Aug 01 15:24:15 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:24:15 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:24:15 user nova-compute[72201]:     </rng>
Aug 01 15:24:15 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:24:15 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:24:15 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:24:15 user nova-compute[72201]:     </memballoon>
Aug 01 15:24:15 user nova-compute[72201]:   </devices>
Aug 01 15:24:15 user nova-compute[72201]: </domain>
Aug 01 15:24:15 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cf06bc-f05c-4ec6-9f13-e6b2ad82e3ec]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:24:15 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:24:15 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c65f760>, {}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Disconnecting from: [] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.088s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] <== disconnect_volume: return (829ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:24:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:24:15 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Deleting instance files /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15_del
Aug 01 15:24:15 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Deletion of /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15_del complete
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-89dde0bf-8f6e-4bd4-88a6-933d00bc224b req-bf1deffc-1e85-4ac7-9457-074b3f7950b2 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Received event network-vif-plugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-89dde0bf-8f6e-4bd4-88a6-933d00bc224b req-bf1deffc-1e85-4ac7-9457-074b3f7950b2 service nova] Acquiring lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-89dde0bf-8f6e-4bd4-88a6-933d00bc224b req-bf1deffc-1e85-4ac7-9457-074b3f7950b2 service nova] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-89dde0bf-8f6e-4bd4-88a6-933d00bc224b req-bf1deffc-1e85-4ac7-9457-074b3f7950b2 service nova] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-89dde0bf-8f6e-4bd4-88a6-933d00bc224b req-bf1deffc-1e85-4ac7-9457-074b3f7950b2 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] No waiting events found dispatching network-vif-plugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:24:16 user nova-compute[72201]: WARNING nova.compute.manager [req-89dde0bf-8f6e-4bd4-88a6-933d00bc224b req-bf1deffc-1e85-4ac7-9457-074b3f7950b2 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Received unexpected event network-vif-plugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 for instance with vm_state active and task_state rebuilding.
Aug 01 15:24:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-89dde0bf-8f6e-4bd4-88a6-933d00bc224b req-bf1deffc-1e85-4ac7-9457-074b3f7950b2 service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received event network-vif-unplugged-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-89dde0bf-8f6e-4bd4-88a6-933d00bc224b req-bf1deffc-1e85-4ac7-9457-074b3f7950b2 service nova] Acquiring lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-89dde0bf-8f6e-4bd4-88a6-933d00bc224b req-bf1deffc-1e85-4ac7-9457-074b3f7950b2 service nova] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-89dde0bf-8f6e-4bd4-88a6-933d00bc224b req-bf1deffc-1e85-4ac7-9457-074b3f7950b2 service nova] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-89dde0bf-8f6e-4bd4-88a6-933d00bc224b req-bf1deffc-1e85-4ac7-9457-074b3f7950b2 service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] No waiting events found dispatching network-vif-unplugged-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:24:16 user nova-compute[72201]: WARNING nova.compute.manager [req-89dde0bf-8f6e-4bd4-88a6-933d00bc224b req-bf1deffc-1e85-4ac7-9457-074b3f7950b2 service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received unexpected event network-vif-unplugged-a2128465-b362-4945-945b-c02795ea1705 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 15:24:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-89dde0bf-8f6e-4bd4-88a6-933d00bc224b req-bf1deffc-1e85-4ac7-9457-074b3f7950b2 service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received event network-vif-plugged-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-89dde0bf-8f6e-4bd4-88a6-933d00bc224b req-bf1deffc-1e85-4ac7-9457-074b3f7950b2 service nova] Acquiring lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-89dde0bf-8f6e-4bd4-88a6-933d00bc224b req-bf1deffc-1e85-4ac7-9457-074b3f7950b2 service nova] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-89dde0bf-8f6e-4bd4-88a6-933d00bc224b req-bf1deffc-1e85-4ac7-9457-074b3f7950b2 service nova] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-89dde0bf-8f6e-4bd4-88a6-933d00bc224b req-bf1deffc-1e85-4ac7-9457-074b3f7950b2 service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] No waiting events found dispatching network-vif-plugged-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:24:16 user nova-compute[72201]: WARNING nova.compute.manager [req-89dde0bf-8f6e-4bd4-88a6-933d00bc224b req-bf1deffc-1e85-4ac7-9457-074b3f7950b2 service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received unexpected event network-vif-plugged-a2128465-b362-4945-945b-c02795ea1705 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG nova.objects.instance [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3e869e37-c921-48e3-b89a-946bbcc1a5ed {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b594736f5326cc44b2c21b0265dc7a86f25b8fc2 --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:16 user nova-compute[72201]: INFO nova.virt.block_device [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Booting with volume 1d89fc35-7179-4837-9234-74e82df62143 at /dev/vdb
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b594736f5326cc44b2c21b0265dc7a86f25b8fc2 --force-share --output=json" returned: 0 in 0.173s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG os_brick.utils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df7e456-e9d3-49bf-95a3-026e53bc18f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a85f4b0-ab99-477d-b9f6-c20e860ebec0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Cannot resize image /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG nova.objects.instance [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lazy-loading 'migration_context' on Instance uuid 3e869e37-c921-48e3-b89a-946bbcc1a5ed {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b78c67-fa68-4357-9be1-68cf8d356bce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d67e44c-c567-4bae-a437-948675b951f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1436254959',display_name='tempest-TestMinimumBasicScenario-server-1436254959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1436254959',id=13,image_ref='01e1b9e2-1afb-49c6-88ca-e8c8a2144418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXoI7zVJBdB0lr76+ibKx3rQTpkh4ZH+yifRw2rO8nKGcImkfspfIluEMinD7nXk08i9/YN+XHFBkn4ywU/yP/bAjF2s6xHFjvo2R0jo8pEhg87HKQHG3uQq9h9kIwiKA==',key_name='tempest-TestMinimumBasicScenario-2124161389',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:21:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='b5e1f59585b44545ae3ec0cdfa480fab',ramdisk_id='',reservation_id='r-5r163mpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='01e1b9e2-1afb-49c6-88ca-e8c8a2144418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1524896067',owner_user_name='tempest-TestMinimumBasicScenario-1524896067-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:24:13Z,user_data=None,user_id='2c5267b768cf46958384d9ad4c585f82',uuid=3e869e37-c921-48e3-b89a-946bbcc1a5ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Converting VIF {"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=a2128465-b362-4945-945b-c02795ea1705,network=Network(d1dbf82c-df93-48ae-b118-278943635ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2128465-b3') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG os_vif [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=a2128465-b362-4945-945b-c02795ea1705,network=Network(d1dbf82c-df93-48ae-b118-278943635ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2128465-b3') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:24:16 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:24:16 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[685b0719-2c1d-4980-8291-c27ae856f206]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG os_brick.utils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Updating existing volume attachment record: 6d2660cf-3880-4c1c-aa36-d494049194b5 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2128465-b3, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa2128465-b3, col_values=(('external_ids', {'iface-id': 'a2128465-b362-4945-945b-c02795ea1705', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:7c:00', 'vm-uuid': '3e869e37-c921-48e3-b89a-946bbcc1a5ed'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:24:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:16 user nova-compute[72201]: INFO os_vif [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=a2128465-b362-4945-945b-c02795ea1705,network=Network(d1dbf82c-df93-48ae-b118-278943635ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2128465-b3')
Aug 01 15:24:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:18 user nova-compute[72201]: DEBUG nova.compute.manager [req-14143e69-0db6-4e6f-bd58-224bdb5579f7 req-0785783e-ed8c-44ad-b97b-8cd95093aade service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received event network-vif-plugged-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:24:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-14143e69-0db6-4e6f-bd58-224bdb5579f7 req-0785783e-ed8c-44ad-b97b-8cd95093aade service nova] Acquiring lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-14143e69-0db6-4e6f-bd58-224bdb5579f7 req-0785783e-ed8c-44ad-b97b-8cd95093aade service nova] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-14143e69-0db6-4e6f-bd58-224bdb5579f7 req-0785783e-ed8c-44ad-b97b-8cd95093aade service nova] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:18 user nova-compute[72201]: DEBUG nova.compute.manager [req-14143e69-0db6-4e6f-bd58-224bdb5579f7 req-0785783e-ed8c-44ad-b97b-8cd95093aade service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] No waiting events found dispatching network-vif-plugged-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:24:18 user nova-compute[72201]: WARNING nova.compute.manager [req-14143e69-0db6-4e6f-bd58-224bdb5579f7 req-0785783e-ed8c-44ad-b97b-8cd95093aade service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received unexpected event network-vif-plugged-a2128465-b362-4945-945b-c02795ea1705 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 15:24:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Acquiring lock "f922b46e-baa5-4df4-8ffa-59addad85748" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "f922b46e-baa5-4df4-8ffa-59addad85748" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:19 user nova-compute[72201]: DEBUG nova.compute.manager [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:24:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:19 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:24:19 user nova-compute[72201]: INFO nova.compute.claims [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Claim successful on node user
Aug 01 15:24:19 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:24:19 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:24:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:19 user nova-compute[72201]: DEBUG nova.compute.manager [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:24:19 user nova-compute[72201]: DEBUG nova.compute.manager [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:24:19 user nova-compute[72201]: DEBUG nova.network.neutron [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:24:19 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:24:19 user nova-compute[72201]: DEBUG nova.compute.manager [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:24:19 user nova-compute[72201]: DEBUG nova.policy [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59ec55bc93f54ef6ad59d5624c19d26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a697b16b874115aedf4e49d7b042b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:24:19 user nova-compute[72201]: DEBUG nova.compute.manager [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:24:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:24:19 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Creating image(s)
Aug 01 15:24:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Acquiring lock "/opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "/opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "/opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.141s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748/disk 1073741824" returned: 0 in 0.046s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG nova.compute.manager [req-ce730460-4827-42aa-b1ec-610ee089a751 req-09a7fa60-6648-4c2f-8203-93a11457db54 service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received event network-vif-plugged-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ce730460-4827-42aa-b1ec-610ee089a751 req-09a7fa60-6648-4c2f-8203-93a11457db54 service nova] Acquiring lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ce730460-4827-42aa-b1ec-610ee089a751 req-09a7fa60-6648-4c2f-8203-93a11457db54 service nova] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ce730460-4827-42aa-b1ec-610ee089a751 req-09a7fa60-6648-4c2f-8203-93a11457db54 service nova] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG nova.compute.manager [req-ce730460-4827-42aa-b1ec-610ee089a751 req-09a7fa60-6648-4c2f-8203-93a11457db54 service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] No waiting events found dispatching network-vif-plugged-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:24:20 user nova-compute[72201]: WARNING nova.compute.manager [req-ce730460-4827-42aa-b1ec-610ee089a751 req-09a7fa60-6648-4c2f-8203-93a11457db54 service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received unexpected event network-vif-plugged-a2128465-b362-4945-945b-c02795ea1705 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 15:24:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.157s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG nova.network.neutron [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Successfully created port: ac4d508a-46a5-49ed-850f-5f43eb62ce45 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Removed pending event for 3e869e37-c921-48e3-b89a-946bbcc1a5ed due to event {{(pid=72201) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903460.4025226, 3e869e37-c921-48e3-b89a-946bbcc1a5ed => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:24:20 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] VM Resumed (Lifecycle Event)
Aug 01 15:24:20 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:24:20 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Instance rebooted successfully.
Aug 01 15:24:20 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:24:20 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 01 15:24:20 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903460.4045012, 3e869e37-c921-48e3-b89a-946bbcc1a5ed => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:24:20 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] VM Started (Lifecycle Event)
Aug 01 15:24:20 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Cannot resize image /opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG nova.objects.instance [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lazy-loading 'migration_context' on Instance uuid f922b46e-baa5-4df4-8ffa-59addad85748 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Ensure instance console log exists: /opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3465ff86-c2ac-4e4f-b8cc-7d66e976b09b tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.879s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:20 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.network.neutron [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Successfully updated port: ac4d508a-46a5-49ed-850f-5f43eb62ce45 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Acquiring lock "refresh_cache-f922b46e-baa5-4df4-8ffa-59addad85748" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Acquired lock "refresh_cache-f922b46e-baa5-4df4-8ffa-59addad85748" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.network.neutron [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-444719a5-5f52-4522-b7e9-fd00d80077cb req-49284dde-03fe-4891-b6e5-2cf729f8f3cd service nova] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Received event network-changed-ac4d508a-46a5-49ed-850f-5f43eb62ce45 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-444719a5-5f52-4522-b7e9-fd00d80077cb req-49284dde-03fe-4891-b6e5-2cf729f8f3cd service nova] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Refreshing instance network info cache due to event network-changed-ac4d508a-46a5-49ed-850f-5f43eb62ce45. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-444719a5-5f52-4522-b7e9-fd00d80077cb req-49284dde-03fe-4891-b6e5-2cf729f8f3cd service nova] Acquiring lock "refresh_cache-f922b46e-baa5-4df4-8ffa-59addad85748" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.network.neutron [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.network.neutron [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Updating instance_info_cache with network_info: [{"id": "ac4d508a-46a5-49ed-850f-5f43eb62ce45", "address": "fa:16:3e:07:11:70", "network": {"id": "95f92796-92dc-4732-a567-57b506b0d89b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403146244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a697b16b874115aedf4e49d7b042b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4d508a-46", "ovs_interfaceid": "ac4d508a-46a5-49ed-850f-5f43eb62ce45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Releasing lock "refresh_cache-f922b46e-baa5-4df4-8ffa-59addad85748" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Instance network_info: |[{"id": "ac4d508a-46a5-49ed-850f-5f43eb62ce45", "address": "fa:16:3e:07:11:70", "network": {"id": "95f92796-92dc-4732-a567-57b506b0d89b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403146244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a697b16b874115aedf4e49d7b042b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4d508a-46", "ovs_interfaceid": "ac4d508a-46a5-49ed-850f-5f43eb62ce45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-444719a5-5f52-4522-b7e9-fd00d80077cb req-49284dde-03fe-4891-b6e5-2cf729f8f3cd service nova] Acquired lock "refresh_cache-f922b46e-baa5-4df4-8ffa-59addad85748" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.network.neutron [req-444719a5-5f52-4522-b7e9-fd00d80077cb req-49284dde-03fe-4891-b6e5-2cf729f8f3cd service nova] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Refreshing network info cache for port ac4d508a-46a5-49ed-850f-5f43eb62ce45 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Start _get_guest_xml network_info=[{"id": "ac4d508a-46a5-49ed-850f-5f43eb62ce45", "address": "fa:16:3e:07:11:70", "network": {"id": "95f92796-92dc-4732-a567-57b506b0d89b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403146244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a697b16b874115aedf4e49d7b042b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4d508a-46", "ovs_interfaceid": "ac4d508a-46a5-49ed-850f-5f43eb62ce45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:24:21 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:24:21 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-478710310',display_name='tempest-VolumesActionsTest-instance-478710310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-478710310',id=16,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a697b16b874115aedf4e49d7b042b7',ramdisk_id='',reservation_id='r-j5456x8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-343582602',owner_user_name='tempest-VolumesActionsTest-343582602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:24:20Z,user_data=None,user_id='59ec55bc93f54ef6ad59d5624c19d26d',uuid=f922b46e-baa5-4df4-8ffa-59addad85748,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac4d508a-46a5-49ed-850f-5f43eb62ce45", "address": "fa:16:3e:07:11:70", "network": {"id": "95f92796-92dc-4732-a567-57b506b0d89b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403146244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a697b16b874115aedf4e49d7b042b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4d508a-46", "ovs_interfaceid": "ac4d508a-46a5-49ed-850f-5f43eb62ce45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Converting VIF {"id": "ac4d508a-46a5-49ed-850f-5f43eb62ce45", "address": "fa:16:3e:07:11:70", "network": {"id": "95f92796-92dc-4732-a567-57b506b0d89b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403146244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a697b16b874115aedf4e49d7b042b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4d508a-46", "ovs_interfaceid": "ac4d508a-46a5-49ed-850f-5f43eb62ce45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:11:70,bridge_name='br-int',has_traffic_filtering=True,id=ac4d508a-46a5-49ed-850f-5f43eb62ce45,network=Network(95f92796-92dc-4732-a567-57b506b0d89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4d508a-46') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.objects.instance [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lazy-loading 'pci_devices' on Instance uuid f922b46e-baa5-4df4-8ffa-59addad85748 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:24:21 user nova-compute[72201]:   <uuid>f922b46e-baa5-4df4-8ffa-59addad85748</uuid>
Aug 01 15:24:21 user nova-compute[72201]:   <name>instance-00000010</name>
Aug 01 15:24:21 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:24:21 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:24:21 user nova-compute[72201]:   <metadata>
Aug 01 15:24:21 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:24:21 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:24:21 user nova-compute[72201]:       <nova:name>tempest-VolumesActionsTest-instance-478710310</nova:name>
Aug 01 15:24:21 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:24:21</nova:creationTime>
Aug 01 15:24:21 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:24:21 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:24:21 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:24:21 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:24:21 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:24:21 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:24:21 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:24:21 user nova-compute[72201]:       <nova:owner>
Aug 01 15:24:21 user nova-compute[72201]:         <nova:user uuid="59ec55bc93f54ef6ad59d5624c19d26d">tempest-VolumesActionsTest-343582602-project-member</nova:user>
Aug 01 15:24:21 user nova-compute[72201]:         <nova:project uuid="19a697b16b874115aedf4e49d7b042b7">tempest-VolumesActionsTest-343582602</nova:project>
Aug 01 15:24:21 user nova-compute[72201]:       </nova:owner>
Aug 01 15:24:21 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:24:21 user nova-compute[72201]:       <nova:ports>
Aug 01 15:24:21 user nova-compute[72201]:         <nova:port uuid="ac4d508a-46a5-49ed-850f-5f43eb62ce45">
Aug 01 15:24:21 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 15:24:21 user nova-compute[72201]:         </nova:port>
Aug 01 15:24:21 user nova-compute[72201]:       </nova:ports>
Aug 01 15:24:21 user nova-compute[72201]:     </nova:instance>
Aug 01 15:24:21 user nova-compute[72201]:   </metadata>
Aug 01 15:24:21 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:24:21 user nova-compute[72201]:     <system>
Aug 01 15:24:21 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:24:21 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:24:21 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:24:21 user nova-compute[72201]:       <entry name="serial">f922b46e-baa5-4df4-8ffa-59addad85748</entry>
Aug 01 15:24:21 user nova-compute[72201]:       <entry name="uuid">f922b46e-baa5-4df4-8ffa-59addad85748</entry>
Aug 01 15:24:21 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:24:21 user nova-compute[72201]:     </system>
Aug 01 15:24:21 user nova-compute[72201]:   </sysinfo>
Aug 01 15:24:21 user nova-compute[72201]:   <os>
Aug 01 15:24:21 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:24:21 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:24:21 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:24:21 user nova-compute[72201]:   </os>
Aug 01 15:24:21 user nova-compute[72201]:   <features>
Aug 01 15:24:21 user nova-compute[72201]:     <acpi/>
Aug 01 15:24:21 user nova-compute[72201]:     <apic/>
Aug 01 15:24:21 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:24:21 user nova-compute[72201]:   </features>
Aug 01 15:24:21 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:24:21 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:24:21 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:24:21 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:24:21 user nova-compute[72201]:   </clock>
Aug 01 15:24:21 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:24:21 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:24:21 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:24:21 user nova-compute[72201]:   </cpu>
Aug 01 15:24:21 user nova-compute[72201]:   <devices>
Aug 01 15:24:21 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:24:21 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:24:21 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748/disk"/>
Aug 01 15:24:21 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:24:21 user nova-compute[72201]:     </disk>
Aug 01 15:24:21 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:24:21 user nova-compute[72201]:       <mac address="fa:16:3e:07:11:70"/>
Aug 01 15:24:21 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:24:21 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:24:21 user nova-compute[72201]:       <target dev="tapac4d508a-46"/>
Aug 01 15:24:21 user nova-compute[72201]:     </interface>
Aug 01 15:24:21 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:24:21 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748/console.log" append="off"/>
Aug 01 15:24:21 user nova-compute[72201]:     </serial>
Aug 01 15:24:21 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:24:21 user nova-compute[72201]:     <video>
Aug 01 15:24:21 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:24:21 user nova-compute[72201]:     </video>
Aug 01 15:24:21 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:24:21 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:24:21 user nova-compute[72201]:     </rng>
Aug 01 15:24:21 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:24:21 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:24:21 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:24:21 user nova-compute[72201]:     </memballoon>
Aug 01 15:24:21 user nova-compute[72201]:   </devices>
Aug 01 15:24:21 user nova-compute[72201]: </domain>
Aug 01 15:24:21 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-478710310',display_name='tempest-VolumesActionsTest-instance-478710310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-478710310',id=16,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a697b16b874115aedf4e49d7b042b7',ramdisk_id='',reservation_id='r-j5456x8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-343582602',owner_user_name='tempest-VolumesActionsTest-343582602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:24:20Z,user_data=None,user_id='59ec55bc93f54ef6ad59d5624c19d26d',uuid=f922b46e-baa5-4df4-8ffa-59addad85748,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac4d508a-46a5-49ed-850f-5f43eb62ce45", "address": "fa:16:3e:07:11:70", "network": {"id": "95f92796-92dc-4732-a567-57b506b0d89b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403146244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a697b16b874115aedf4e49d7b042b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4d508a-46", "ovs_interfaceid": "ac4d508a-46a5-49ed-850f-5f43eb62ce45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Converting VIF {"id": "ac4d508a-46a5-49ed-850f-5f43eb62ce45", "address": "fa:16:3e:07:11:70", "network": {"id": "95f92796-92dc-4732-a567-57b506b0d89b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403146244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a697b16b874115aedf4e49d7b042b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4d508a-46", "ovs_interfaceid": "ac4d508a-46a5-49ed-850f-5f43eb62ce45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:11:70,bridge_name='br-int',has_traffic_filtering=True,id=ac4d508a-46a5-49ed-850f-5f43eb62ce45,network=Network(95f92796-92dc-4732-a567-57b506b0d89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4d508a-46') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG os_vif [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:11:70,bridge_name='br-int',has_traffic_filtering=True,id=ac4d508a-46a5-49ed-850f-5f43eb62ce45,network=Network(95f92796-92dc-4732-a567-57b506b0d89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4d508a-46') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac4d508a-46, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapac4d508a-46, col_values=(('external_ids', {'iface-id': 'ac4d508a-46a5-49ed-850f-5f43eb62ce45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:11:70', 'vm-uuid': 'f922b46e-baa5-4df4-8ffa-59addad85748'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:21 user nova-compute[72201]: INFO os_vif [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:11:70,bridge_name='br-int',has_traffic_filtering=True,id=ac4d508a-46a5-49ed-850f-5f43eb62ce45,network=Network(95f92796-92dc-4732-a567-57b506b0d89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4d508a-46')
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:24:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] No VIF found with MAC fa:16:3e:07:11:70, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:24:22 user nova-compute[72201]: DEBUG nova.network.neutron [req-444719a5-5f52-4522-b7e9-fd00d80077cb req-49284dde-03fe-4891-b6e5-2cf729f8f3cd service nova] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Updated VIF entry in instance network info cache for port ac4d508a-46a5-49ed-850f-5f43eb62ce45. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:24:22 user nova-compute[72201]: DEBUG nova.network.neutron [req-444719a5-5f52-4522-b7e9-fd00d80077cb req-49284dde-03fe-4891-b6e5-2cf729f8f3cd service nova] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Updating instance_info_cache with network_info: [{"id": "ac4d508a-46a5-49ed-850f-5f43eb62ce45", "address": "fa:16:3e:07:11:70", "network": {"id": "95f92796-92dc-4732-a567-57b506b0d89b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403146244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a697b16b874115aedf4e49d7b042b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4d508a-46", "ovs_interfaceid": "ac4d508a-46a5-49ed-850f-5f43eb62ce45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:24:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-444719a5-5f52-4522-b7e9-fd00d80077cb req-49284dde-03fe-4891-b6e5-2cf729f8f3cd service nova] Releasing lock "refresh_cache-f922b46e-baa5-4df4-8ffa-59addad85748" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:24:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-3a897626-ac6e-454a-8d27-7892b0641814 req-06a291b6-71c1-4252-b1d3-cf4ae032e715 service nova] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Received event network-vif-plugged-ac4d508a-46a5-49ed-850f-5f43eb62ce45 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:24:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3a897626-ac6e-454a-8d27-7892b0641814 req-06a291b6-71c1-4252-b1d3-cf4ae032e715 service nova] Acquiring lock "f922b46e-baa5-4df4-8ffa-59addad85748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3a897626-ac6e-454a-8d27-7892b0641814 req-06a291b6-71c1-4252-b1d3-cf4ae032e715 service nova] Lock "f922b46e-baa5-4df4-8ffa-59addad85748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3a897626-ac6e-454a-8d27-7892b0641814 req-06a291b6-71c1-4252-b1d3-cf4ae032e715 service nova] Lock "f922b46e-baa5-4df4-8ffa-59addad85748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-3a897626-ac6e-454a-8d27-7892b0641814 req-06a291b6-71c1-4252-b1d3-cf4ae032e715 service nova] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] No waiting events found dispatching network-vif-plugged-ac4d508a-46a5-49ed-850f-5f43eb62ce45 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:24:23 user nova-compute[72201]: WARNING nova.compute.manager [req-3a897626-ac6e-454a-8d27-7892b0641814 req-06a291b6-71c1-4252-b1d3-cf4ae032e715 service nova] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Received unexpected event network-vif-plugged-ac4d508a-46a5-49ed-850f-5f43eb62ce45 for instance with vm_state building and task_state spawning.
Aug 01 15:24:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:24:25 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Creating image(s)
Aug 01 15:24:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "/opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "/opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.144s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-2fcc207b-b33b-498c-9956-2a671305fe28 req-f187f618-63ee-477a-889a-2c11cafba5ed service nova] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Received event network-vif-plugged-ac4d508a-46a5-49ed-850f-5f43eb62ce45 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2fcc207b-b33b-498c-9956-2a671305fe28 req-f187f618-63ee-477a-889a-2c11cafba5ed service nova] Acquiring lock "f922b46e-baa5-4df4-8ffa-59addad85748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2fcc207b-b33b-498c-9956-2a671305fe28 req-f187f618-63ee-477a-889a-2c11cafba5ed service nova] Lock "f922b46e-baa5-4df4-8ffa-59addad85748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2fcc207b-b33b-498c-9956-2a671305fe28 req-f187f618-63ee-477a-889a-2c11cafba5ed service nova] Lock "f922b46e-baa5-4df4-8ffa-59addad85748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-2fcc207b-b33b-498c-9956-2a671305fe28 req-f187f618-63ee-477a-889a-2c11cafba5ed service nova] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] No waiting events found dispatching network-vif-plugged-ac4d508a-46a5-49ed-850f-5f43eb62ce45 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:24:25 user nova-compute[72201]: WARNING nova.compute.manager [req-2fcc207b-b33b-498c-9956-2a671305fe28 req-f187f618-63ee-477a-889a-2c11cafba5ed service nova] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Received unexpected event network-vif-plugged-ac4d508a-46a5-49ed-850f-5f43eb62ce45 for instance with vm_state building and task_state spawning.
Aug 01 15:24:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.144s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903465.683565, f922b46e-baa5-4df4-8ffa-59addad85748 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:24:25 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] VM Resumed (Lifecycle Event)
Aug 01 15:24:25 user nova-compute[72201]: DEBUG nova.compute.manager [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk 1073741824" returned: 0 in 0.076s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:24:25 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Instance spawned successfully.
Aug 01 15:24:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:24:25 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:24:25 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903465.6855063, f922b46e-baa5-4df4-8ffa-59addad85748 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:24:25 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] VM Started (Lifecycle Event)
Aug 01 15:24:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.180s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:24:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:25 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:24:25 user nova-compute[72201]: INFO nova.compute.manager [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Took 6.12 seconds to spawn the instance on the hypervisor.
Aug 01 15:24:25 user nova-compute[72201]: DEBUG nova.compute.manager [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Cannot resize image /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Ensure instance console log exists: /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Start _get_guest_xml network_info=[{"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDAPtnGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e2ca19ea-868c-40ad-a453-f6e348cfac15', 'attached_at': '', 'detached_at': '', 'volume_id': '1d89fc35-7179-4837-9234-74e82df62143', 'serial': '1d89fc35-7179-4837-9234-74e82df62143'}, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '6d2660cf-3880-4c1c-aa36-d494049194b5', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:24:26 user nova-compute[72201]: INFO nova.compute.manager [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Took 6.99 seconds to build instance.
Aug 01 15:24:26 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 15:24:26 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a2ea000-0d04-4a46-99cd-848d6386c545 tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "f922b46e-baa5-4df4-8ffa-59addad85748" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.114s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.objects.instance [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lazy-loading 'vcpu_model' on Instance uuid e2ca19ea-868c-40ad-a453-f6e348cfac15 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDAPtnGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:24:26 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:24:26 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:24:26 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e49277d-a8b6-4213-8825-e37a55db5443]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:24:26 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ba8085-22fc-42e3-9e72-6a81c78a2661]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143] added
Aug 01 15:24:26 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79276ce-10e5-4dcb-85d3-f7e91f3ff97b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[39638fbc-68e6-4bfd-82ba-7dd6dd099ff4]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NDAPtnGz {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NDAPtnGz" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a168c20-c3b3-4f0e-a718-852f89573ba3]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NDAPtnGz'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[db55516c-ae2e-4977-a2fa-21b3f4f5bfcb]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2b2083-7ec3-4f12-8561-3b7f470e1560]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:24:26 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:24:26 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e19a0f1-b391-44c6-b2cb-40c465231e15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143, portal: 172.16.0.220,3260]
Aug 01 15:24:26 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143, portal: 172.16.0.220,3260] successful.
Aug 01 15:24:26 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1332b394-1705-4ceb-881e-5e71f9d6fa2d]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f62d92f-49f4-4a01-8afc-8d1ad522b945]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:24:26 user nova-compute[72201]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 (non-flash)
Aug 01 15:24:26 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:24:26 user nova-compute[72201]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 (non-flash)
Aug 01 15:24:26 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.029s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[89977108-f0b4-4755-9459-b6253846e0a8]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDAPtnGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:24:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903452.064657, c918ea78-9bf8-421c-9a31-0da4104cd032 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:24:27 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] VM Stopped (Lifecycle Event)
Aug 01 15:24:27 user nova-compute[72201]: DEBUG nova.compute.manager [None req-81527317-9627-40ef-b819-97910fac0e77 None None] [instance: c918ea78-9bf8-421c-9a31-0da4104cd032] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23330613238306131', 'path': '/dev/sdc'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330613238306131', 'path': '/dev/sdc'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T15:20:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-259126896',display_name='tempest-ServerActionsTestOtherA-server-1100798592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-259126896',id=3,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj9M7ZGdr6vvGAAN6LlX0Yd4KFWs7o7dSiIrZzG0de25MryOgdU0IQWkOsGcYGYZLChUKVpEI60JU+ZGbYHXhk4M5ia3Yx+QGjlFCbCEmncodiyKPCipVQmd8JPh2FoTg==',key_name='tempest-keypair-1499887671',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:20:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e85c7d5f159c4ff2896b5549cf73b977',ramdisk_id='',reservation_id='r-a8sv6s0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-765053637',owner_user_name='tempest-ServerActionsTestOtherA-765053637-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:24:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ccd18b99219749fe8febdc0da8fc4388',uuid=e2ca19ea-868c-40ad-a453-f6e348cfac15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converting VIF {"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:a8:af,bridge_name='br-int',has_traffic_filtering=True,id=bc611803-5aa5-4b8b-961b-cd6c43317b21,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc611803-5a') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:24:27 user nova-compute[72201]:   <uuid>e2ca19ea-868c-40ad-a453-f6e348cfac15</uuid>
Aug 01 15:24:27 user nova-compute[72201]:   <name>instance-00000003</name>
Aug 01 15:24:27 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:24:27 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:24:27 user nova-compute[72201]:   <metadata>
Aug 01 15:24:27 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:24:27 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:24:27 user nova-compute[72201]:       <nova:name>tempest-ServerActionsTestOtherA-server-1100798592</nova:name>
Aug 01 15:24:27 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:24:26</nova:creationTime>
Aug 01 15:24:27 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:24:27 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:24:27 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:24:27 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:24:27 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:24:27 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:24:27 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:24:27 user nova-compute[72201]:       <nova:owner>
Aug 01 15:24:27 user nova-compute[72201]:         <nova:user uuid="ccd18b99219749fe8febdc0da8fc4388">tempest-ServerActionsTestOtherA-765053637-project-member</nova:user>
Aug 01 15:24:27 user nova-compute[72201]:         <nova:project uuid="e85c7d5f159c4ff2896b5549cf73b977">tempest-ServerActionsTestOtherA-765053637</nova:project>
Aug 01 15:24:27 user nova-compute[72201]:       </nova:owner>
Aug 01 15:24:27 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:24:27 user nova-compute[72201]:       <nova:ports>
Aug 01 15:24:27 user nova-compute[72201]:         <nova:port uuid="bc611803-5aa5-4b8b-961b-cd6c43317b21">
Aug 01 15:24:27 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 15:24:27 user nova-compute[72201]:         </nova:port>
Aug 01 15:24:27 user nova-compute[72201]:       </nova:ports>
Aug 01 15:24:27 user nova-compute[72201]:     </nova:instance>
Aug 01 15:24:27 user nova-compute[72201]:   </metadata>
Aug 01 15:24:27 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:24:27 user nova-compute[72201]:     <system>
Aug 01 15:24:27 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:24:27 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:24:27 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:24:27 user nova-compute[72201]:       <entry name="serial">e2ca19ea-868c-40ad-a453-f6e348cfac15</entry>
Aug 01 15:24:27 user nova-compute[72201]:       <entry name="uuid">e2ca19ea-868c-40ad-a453-f6e348cfac15</entry>
Aug 01 15:24:27 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:24:27 user nova-compute[72201]:     </system>
Aug 01 15:24:27 user nova-compute[72201]:   </sysinfo>
Aug 01 15:24:27 user nova-compute[72201]:   <os>
Aug 01 15:24:27 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:24:27 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:24:27 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:24:27 user nova-compute[72201]:   </os>
Aug 01 15:24:27 user nova-compute[72201]:   <features>
Aug 01 15:24:27 user nova-compute[72201]:     <acpi/>
Aug 01 15:24:27 user nova-compute[72201]:     <apic/>
Aug 01 15:24:27 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:24:27 user nova-compute[72201]:   </features>
Aug 01 15:24:27 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:24:27 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:24:27 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:24:27 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:24:27 user nova-compute[72201]:   </clock>
Aug 01 15:24:27 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:24:27 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:24:27 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:24:27 user nova-compute[72201]:   </cpu>
Aug 01 15:24:27 user nova-compute[72201]:   <devices>
Aug 01 15:24:27 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:24:27 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:24:27 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk"/>
Aug 01 15:24:27 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:24:27 user nova-compute[72201]:     </disk>
Aug 01 15:24:27 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:24:27 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:24:27 user nova-compute[72201]:       <source dev="/dev/sdc"/>
Aug 01 15:24:27 user nova-compute[72201]:       <target dev="vdb" bus="virtio"/>
Aug 01 15:24:27 user nova-compute[72201]:       <serial>1d89fc35-7179-4837-9234-74e82df62143</serial>
Aug 01 15:24:27 user nova-compute[72201]:     </disk>
Aug 01 15:24:27 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:24:27 user nova-compute[72201]:       <mac address="fa:16:3e:50:a8:af"/>
Aug 01 15:24:27 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:24:27 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:24:27 user nova-compute[72201]:       <target dev="tapbc611803-5a"/>
Aug 01 15:24:27 user nova-compute[72201]:     </interface>
Aug 01 15:24:27 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:24:27 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/console.log" append="off"/>
Aug 01 15:24:27 user nova-compute[72201]:     </serial>
Aug 01 15:24:27 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:24:27 user nova-compute[72201]:     <video>
Aug 01 15:24:27 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:24:27 user nova-compute[72201]:     </video>
Aug 01 15:24:27 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:24:27 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:24:27 user nova-compute[72201]:     </rng>
Aug 01 15:24:27 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:24:27 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:24:27 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:24:27 user nova-compute[72201]:     </memballoon>
Aug 01 15:24:27 user nova-compute[72201]:   </devices>
Aug 01 15:24:27 user nova-compute[72201]: </domain>
Aug 01 15:24:27 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T15:20:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-259126896',display_name='tempest-ServerActionsTestOtherA-server-1100798592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-259126896',id=3,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj9M7ZGdr6vvGAAN6LlX0Yd4KFWs7o7dSiIrZzG0de25MryOgdU0IQWkOsGcYGYZLChUKVpEI60JU+ZGbYHXhk4M5ia3Yx+QGjlFCbCEmncodiyKPCipVQmd8JPh2FoTg==',key_name='tempest-keypair-1499887671',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:20:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e85c7d5f159c4ff2896b5549cf73b977',ramdisk_id='',reservation_id='r-a8sv6s0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-765053637',owner_user_name='tempest-ServerActionsTestOtherA-765053637-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:24:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ccd18b99219749fe8febdc0da8fc4388',uuid=e2ca19ea-868c-40ad-a453-f6e348cfac15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converting VIF {"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:a8:af,bridge_name='br-int',has_traffic_filtering=True,id=bc611803-5aa5-4b8b-961b-cd6c43317b21,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc611803-5a') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG os_vif [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:a8:af,bridge_name='br-int',has_traffic_filtering=True,id=bc611803-5aa5-4b8b-961b-cd6c43317b21,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc611803-5a') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc611803-5a, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbc611803-5a, col_values=(('external_ids', {'iface-id': 'bc611803-5aa5-4b8b-961b-cd6c43317b21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:a8:af', 'vm-uuid': 'e2ca19ea-868c-40ad-a453-f6e348cfac15'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:27 user nova-compute[72201]: INFO os_vif [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:a8:af,bridge_name='br-int',has_traffic_filtering=True,id=bc611803-5aa5-4b8b-961b-cd6c43317b21,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc611803-5a')
Aug 01 15:24:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:24:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] No VIF found with MAC fa:16:3e:50:a8:af, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:24:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:28 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903453.5777783, e2ca19ea-868c-40ad-a453-f6e348cfac15 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:24:28 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] VM Stopped (Lifecycle Event)
Aug 01 15:24:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3c7c046f-985e-442e-b7b2-48bfc9b882c6 None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:24:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-cf2c48e5-e49b-4f14-b156-8941be44517a req-bdc72e05-1319-4551-8a4e-fcc56594a3f8 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Received event network-vif-plugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:24:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cf2c48e5-e49b-4f14-b156-8941be44517a req-bdc72e05-1319-4551-8a4e-fcc56594a3f8 service nova] Acquiring lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cf2c48e5-e49b-4f14-b156-8941be44517a req-bdc72e05-1319-4551-8a4e-fcc56594a3f8 service nova] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cf2c48e5-e49b-4f14-b156-8941be44517a req-bdc72e05-1319-4551-8a4e-fcc56594a3f8 service nova] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-cf2c48e5-e49b-4f14-b156-8941be44517a req-bdc72e05-1319-4551-8a4e-fcc56594a3f8 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] No waiting events found dispatching network-vif-plugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:24:29 user nova-compute[72201]: WARNING nova.compute.manager [req-cf2c48e5-e49b-4f14-b156-8941be44517a req-bdc72e05-1319-4551-8a4e-fcc56594a3f8 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Received unexpected event network-vif-plugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 15:24:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:31 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903471.8177176, e2ca19ea-868c-40ad-a453-f6e348cfac15 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:24:31 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] VM Resumed (Lifecycle Event)
Aug 01 15:24:31 user nova-compute[72201]: DEBUG nova.compute.manager [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:24:31 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:24:31 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Instance spawned successfully.
Aug 01 15:24:31 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:24:31 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:24:31 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:24:31 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:24:31 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:24:31 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:24:31 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:24:31 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:24:31 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:24:31 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 15:24:31 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903471.8218567, e2ca19ea-868c-40ad-a453-f6e348cfac15 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:24:31 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] VM Started (Lifecycle Event)
Aug 01 15:24:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-dbc610e7-8225-4eaa-81d3-d8bd39d9965f req-a400a139-81b5-46c2-9549-09cbd28df820 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Received event network-vif-plugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:24:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-dbc610e7-8225-4eaa-81d3-d8bd39d9965f req-a400a139-81b5-46c2-9549-09cbd28df820 service nova] Acquiring lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-dbc610e7-8225-4eaa-81d3-d8bd39d9965f req-a400a139-81b5-46c2-9549-09cbd28df820 service nova] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-dbc610e7-8225-4eaa-81d3-d8bd39d9965f req-a400a139-81b5-46c2-9549-09cbd28df820 service nova] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-dbc610e7-8225-4eaa-81d3-d8bd39d9965f req-a400a139-81b5-46c2-9549-09cbd28df820 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] No waiting events found dispatching network-vif-plugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:24:31 user nova-compute[72201]: WARNING nova.compute.manager [req-dbc610e7-8225-4eaa-81d3-d8bd39d9965f req-a400a139-81b5-46c2-9549-09cbd28df820 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Received unexpected event network-vif-plugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 15:24:31 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:24:31 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:24:31 user nova-compute[72201]: DEBUG nova.compute.manager [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:24:31 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 15:24:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:24:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:24:32 user nova-compute[72201]: DEBUG nova.objects.instance [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72201) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 15:24:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e3997d43-d52a-4c04-a10c-e831e1f8ea60 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.149s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:24:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:24:59 user nova-compute[72201]: INFO nova.compute.manager [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Rescuing
Aug 01 15:24:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "refresh_cache-b64f1cfb-64f2-4493-8721-fc63fcd93bb6" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:24:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquired lock "refresh_cache-b64f1cfb-64f2-4493-8721-fc63fcd93bb6" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:24:59 user nova-compute[72201]: DEBUG nova.network.neutron [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:25:00 user nova-compute[72201]: DEBUG nova.network.neutron [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Updating instance_info_cache with network_info: [{"id": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "address": "fa:16:3e:5d:24:e6", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8b84b-6b", "ovs_interfaceid": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:25:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Releasing lock "refresh_cache-b64f1cfb-64f2-4493-8721-fc63fcd93bb6" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:25:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.compute.manager [req-9cca671d-c0f8-465b-81e0-6474ce5a499b req-744e8582-fccf-4494-af40-0dbe13260254 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received event network-vif-unplugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9cca671d-c0f8-465b-81e0-6474ce5a499b req-744e8582-fccf-4494-af40-0dbe13260254 service nova] Acquiring lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9cca671d-c0f8-465b-81e0-6474ce5a499b req-744e8582-fccf-4494-af40-0dbe13260254 service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9cca671d-c0f8-465b-81e0-6474ce5a499b req-744e8582-fccf-4494-af40-0dbe13260254 service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.compute.manager [req-9cca671d-c0f8-465b-81e0-6474ce5a499b req-744e8582-fccf-4494-af40-0dbe13260254 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] No waiting events found dispatching network-vif-unplugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:25:01 user nova-compute[72201]: WARNING nova.compute.manager [req-9cca671d-c0f8-465b-81e0-6474ce5a499b req-744e8582-fccf-4494-af40-0dbe13260254 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received unexpected event network-vif-unplugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 for instance with vm_state active and task_state rescuing.
Aug 01 15:25:01 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Instance destroyed successfully.
Aug 01 15:25:01 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Attempting rescue
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72201) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Instance directory exists: not creating {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 15:25:01 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Creating image(s)
Aug 01 15:25:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "/opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "/opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "/opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.objects.instance [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'trusted_certs' on Instance uuid b64f1cfb-64f2-4493-8721-fc63fcd93bb6 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.215s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk.rescue {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk.rescue" returned: 0 in 0.068s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.objects.instance [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'migration_context' on Instance uuid b64f1cfb-64f2-4493-8721-fc63fcd93bb6 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Start _get_guest_xml network_info=[{"id": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "address": "fa:16:3e:5d:24:e6", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "vif_mac": "fa:16:3e:5d:24:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8b84b-6b", "ovs_interfaceid": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.objects.instance [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'resources' on Instance uuid b64f1cfb-64f2-4493-8721-fc63fcd93bb6 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.objects.instance [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'numa_topology' on Instance uuid b64f1cfb-64f2-4493-8721-fc63fcd93bb6 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:25:01 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:25:01 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.objects.instance [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'vcpu_model' on Instance uuid b64f1cfb-64f2-4493-8721-fc63fcd93bb6 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1810047219',display_name='tempest-ServerRescueNegativeTestJSON-server-1810047219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1810047219',id=2,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:20:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f130c48f19cf4ab7803c1169b759ccb6',ramdisk_id='',reservation_id='r-9or02wpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-773079660',owner_user_name='tempest-ServerRescueNegativeTestJSON-773079660-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:20:24Z,user_data=None,user_id='31a432c1165e4ff4a9a10b4d71ddc513',uuid=b64f1cfb-64f2-4493-8721-fc63fcd93bb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "address": "fa:16:3e:5d:24:e6", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "vif_mac": "fa:16:3e:5d:24:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8b84b-6b", "ovs_interfaceid": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converting VIF {"id": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "address": "fa:16:3e:5d:24:e6", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "vif_mac": "fa:16:3e:5d:24:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8b84b-6b", "ovs_interfaceid": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:24:e6,bridge_name='br-int',has_traffic_filtering=True,id=ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc8b84b-6b') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.objects.instance [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'pci_devices' on Instance uuid b64f1cfb-64f2-4493-8721-fc63fcd93bb6 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:25:01 user nova-compute[72201]:   <uuid>b64f1cfb-64f2-4493-8721-fc63fcd93bb6</uuid>
Aug 01 15:25:01 user nova-compute[72201]:   <name>instance-00000002</name>
Aug 01 15:25:01 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:25:01 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:25:01 user nova-compute[72201]:   <metadata>
Aug 01 15:25:01 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:25:01 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:25:01 user nova-compute[72201]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1810047219</nova:name>
Aug 01 15:25:01 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:25:01</nova:creationTime>
Aug 01 15:25:01 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:25:01 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:25:01 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:25:01 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:25:01 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:25:01 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:25:01 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:25:01 user nova-compute[72201]:       <nova:owner>
Aug 01 15:25:01 user nova-compute[72201]:         <nova:user uuid="31a432c1165e4ff4a9a10b4d71ddc513">tempest-ServerRescueNegativeTestJSON-773079660-project-member</nova:user>
Aug 01 15:25:01 user nova-compute[72201]:         <nova:project uuid="f130c48f19cf4ab7803c1169b759ccb6">tempest-ServerRescueNegativeTestJSON-773079660</nova:project>
Aug 01 15:25:01 user nova-compute[72201]:       </nova:owner>
Aug 01 15:25:01 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:25:01 user nova-compute[72201]:       <nova:ports>
Aug 01 15:25:01 user nova-compute[72201]:         <nova:port uuid="ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583">
Aug 01 15:25:01 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 15:25:01 user nova-compute[72201]:         </nova:port>
Aug 01 15:25:01 user nova-compute[72201]:       </nova:ports>
Aug 01 15:25:01 user nova-compute[72201]:     </nova:instance>
Aug 01 15:25:01 user nova-compute[72201]:   </metadata>
Aug 01 15:25:01 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:25:01 user nova-compute[72201]:     <system>
Aug 01 15:25:01 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:25:01 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:25:01 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:25:01 user nova-compute[72201]:       <entry name="serial">b64f1cfb-64f2-4493-8721-fc63fcd93bb6</entry>
Aug 01 15:25:01 user nova-compute[72201]:       <entry name="uuid">b64f1cfb-64f2-4493-8721-fc63fcd93bb6</entry>
Aug 01 15:25:01 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:25:01 user nova-compute[72201]:     </system>
Aug 01 15:25:01 user nova-compute[72201]:   </sysinfo>
Aug 01 15:25:01 user nova-compute[72201]:   <os>
Aug 01 15:25:01 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:25:01 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:25:01 user nova-compute[72201]:   </os>
Aug 01 15:25:01 user nova-compute[72201]:   <features>
Aug 01 15:25:01 user nova-compute[72201]:     <acpi/>
Aug 01 15:25:01 user nova-compute[72201]:     <apic/>
Aug 01 15:25:01 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:25:01 user nova-compute[72201]:   </features>
Aug 01 15:25:01 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:25:01 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:25:01 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:25:01 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:25:01 user nova-compute[72201]:   </clock>
Aug 01 15:25:01 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:25:01 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:25:01 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:25:01 user nova-compute[72201]:   </cpu>
Aug 01 15:25:01 user nova-compute[72201]:   <devices>
Aug 01 15:25:01 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:25:01 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:25:01 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk.rescue"/>
Aug 01 15:25:01 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:25:01 user nova-compute[72201]:     </disk>
Aug 01 15:25:01 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:25:01 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:25:01 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk"/>
Aug 01 15:25:01 user nova-compute[72201]:       <target dev="vdb" bus="virtio"/>
Aug 01 15:25:01 user nova-compute[72201]:     </disk>
Aug 01 15:25:01 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:25:01 user nova-compute[72201]:       <mac address="fa:16:3e:5d:24:e6"/>
Aug 01 15:25:01 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:25:01 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:25:01 user nova-compute[72201]:       <target dev="tapebc8b84b-6b"/>
Aug 01 15:25:01 user nova-compute[72201]:     </interface>
Aug 01 15:25:01 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:25:01 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/console.log" append="off"/>
Aug 01 15:25:01 user nova-compute[72201]:     </serial>
Aug 01 15:25:01 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:25:01 user nova-compute[72201]:     <video>
Aug 01 15:25:01 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:25:01 user nova-compute[72201]:     </video>
Aug 01 15:25:01 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:25:01 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:25:01 user nova-compute[72201]:     </rng>
Aug 01 15:25:01 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:25:01 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:25:01 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:25:01 user nova-compute[72201]:     </memballoon>
Aug 01 15:25:01 user nova-compute[72201]:   </devices>
Aug 01 15:25:01 user nova-compute[72201]: </domain>
Aug 01 15:25:01 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:25:01 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Instance destroyed successfully.
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:25:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] No VIF found with MAC fa:16:3e:5d:24:e6, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:25:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:03 user nova-compute[72201]: DEBUG nova.compute.manager [req-6a599645-de14-4a37-aba2-485ac136e762 req-f044e921-da49-4bf5-ba3a-e482dd153246 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received event network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:25:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6a599645-de14-4a37-aba2-485ac136e762 req-f044e921-da49-4bf5-ba3a-e482dd153246 service nova] Acquiring lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6a599645-de14-4a37-aba2-485ac136e762 req-f044e921-da49-4bf5-ba3a-e482dd153246 service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6a599645-de14-4a37-aba2-485ac136e762 req-f044e921-da49-4bf5-ba3a-e482dd153246 service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:03 user nova-compute[72201]: DEBUG nova.compute.manager [req-6a599645-de14-4a37-aba2-485ac136e762 req-f044e921-da49-4bf5-ba3a-e482dd153246 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] No waiting events found dispatching network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:25:03 user nova-compute[72201]: WARNING nova.compute.manager [req-6a599645-de14-4a37-aba2-485ac136e762 req-f044e921-da49-4bf5-ba3a-e482dd153246 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received unexpected event network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 for instance with vm_state active and task_state rescuing.
Aug 01 15:25:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-eb079e56-1a44-4ef4-9d60-91d11502a019 req-6d62e05b-cc63-4801-9a7c-3e6063f4b457 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received event network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:25:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-eb079e56-1a44-4ef4-9d60-91d11502a019 req-6d62e05b-cc63-4801-9a7c-3e6063f4b457 service nova] Acquiring lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-eb079e56-1a44-4ef4-9d60-91d11502a019 req-6d62e05b-cc63-4801-9a7c-3e6063f4b457 service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-eb079e56-1a44-4ef4-9d60-91d11502a019 req-6d62e05b-cc63-4801-9a7c-3e6063f4b457 service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-eb079e56-1a44-4ef4-9d60-91d11502a019 req-6d62e05b-cc63-4801-9a7c-3e6063f4b457 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] No waiting events found dispatching network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:25:05 user nova-compute[72201]: WARNING nova.compute.manager [req-eb079e56-1a44-4ef4-9d60-91d11502a019 req-6d62e05b-cc63-4801-9a7c-3e6063f4b457 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received unexpected event network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 for instance with vm_state active and task_state rescuing.
Aug 01 15:25:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-eb079e56-1a44-4ef4-9d60-91d11502a019 req-6d62e05b-cc63-4801-9a7c-3e6063f4b457 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received event network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:25:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-eb079e56-1a44-4ef4-9d60-91d11502a019 req-6d62e05b-cc63-4801-9a7c-3e6063f4b457 service nova] Acquiring lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-eb079e56-1a44-4ef4-9d60-91d11502a019 req-6d62e05b-cc63-4801-9a7c-3e6063f4b457 service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-eb079e56-1a44-4ef4-9d60-91d11502a019 req-6d62e05b-cc63-4801-9a7c-3e6063f4b457 service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-eb079e56-1a44-4ef4-9d60-91d11502a019 req-6d62e05b-cc63-4801-9a7c-3e6063f4b457 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] No waiting events found dispatching network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:25:05 user nova-compute[72201]: WARNING nova.compute.manager [req-eb079e56-1a44-4ef4-9d60-91d11502a019 req-6d62e05b-cc63-4801-9a7c-3e6063f4b457 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received unexpected event network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 for instance with vm_state active and task_state rescuing.
Aug 01 15:25:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Removed pending event for b64f1cfb-64f2-4493-8721-fc63fcd93bb6 due to event {{(pid=72201) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 15:25:06 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903506.1079276, b64f1cfb-64f2-4493-8721-fc63fcd93bb6 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:25:06 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] VM Resumed (Lifecycle Event)
Aug 01 15:25:06 user nova-compute[72201]: DEBUG nova.compute.manager [None req-c61b4f15-0cc2-40af-9578-308c5b6c614f tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:25:06 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:25:06 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:25:06 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 15:25:06 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903506.1117423, b64f1cfb-64f2-4493-8721-fc63fcd93bb6 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:25:06 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] VM Started (Lifecycle Event)
Aug 01 15:25:06 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:25:06 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:25:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:07 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:25:07 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:25:07 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:25:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-02d227b0-2b25-467f-a318-ab46aa391a31" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:25:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-02d227b0-2b25-467f-a318-ab46aa391a31" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:25:08 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:25:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:09 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Updating instance_info_cache with network_info: [{"id": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "address": "fa:16:3e:dc:2e:04", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd9ef98-ad", "ovs_interfaceid": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:25:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-02d227b0-2b25-467f-a318-ab46aa391a31" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:25:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:25:09 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:25:09 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:25:09 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:25:09 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:25:09 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:25:09 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:25:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:25:09 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:25:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:09 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:25:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:10 user nova-compute[72201]: DEBUG nova.compute.manager [req-d4b0f298-0459-4926-a7d2-df949389ef15 req-97d2e4b7-59d7-4b5b-9cf0-e703fa7cb751 service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Received event network-changed-befcc650-86a7-49a1-b877-7fd179b494e4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:25:10 user nova-compute[72201]: DEBUG nova.compute.manager [req-d4b0f298-0459-4926-a7d2-df949389ef15 req-97d2e4b7-59d7-4b5b-9cf0-e703fa7cb751 service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Refreshing instance network info cache due to event network-changed-befcc650-86a7-49a1-b877-7fd179b494e4. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:25:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d4b0f298-0459-4926-a7d2-df949389ef15 req-97d2e4b7-59d7-4b5b-9cf0-e703fa7cb751 service nova] Acquiring lock "refresh_cache-d4146775-a271-4822-84ec-e723ff09c386" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:25:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d4b0f298-0459-4926-a7d2-df949389ef15 req-97d2e4b7-59d7-4b5b-9cf0-e703fa7cb751 service nova] Acquired lock "refresh_cache-d4146775-a271-4822-84ec-e723ff09c386" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:25:10 user nova-compute[72201]: DEBUG nova.network.neutron [req-d4b0f298-0459-4926-a7d2-df949389ef15 req-97d2e4b7-59d7-4b5b-9cf0-e703fa7cb751 service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Refreshing network info cache for port befcc650-86a7-49a1-b877-7fd179b494e4 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:25:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:11 user nova-compute[72201]: DEBUG nova.network.neutron [req-d4b0f298-0459-4926-a7d2-df949389ef15 req-97d2e4b7-59d7-4b5b-9cf0-e703fa7cb751 service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Updated VIF entry in instance network info cache for port befcc650-86a7-49a1-b877-7fd179b494e4. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:25:11 user nova-compute[72201]: DEBUG nova.network.neutron [req-d4b0f298-0459-4926-a7d2-df949389ef15 req-97d2e4b7-59d7-4b5b-9cf0-e703fa7cb751 service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Updating instance_info_cache with network_info: [{"id": "befcc650-86a7-49a1-b877-7fd179b494e4", "address": "fa:16:3e:25:25:a5", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefcc650-86", "ovs_interfaceid": "befcc650-86a7-49a1-b877-7fd179b494e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:25:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d4b0f298-0459-4926-a7d2-df949389ef15 req-97d2e4b7-59d7-4b5b-9cf0-e703fa7cb751 service nova] Releasing lock "refresh_cache-d4146775-a271-4822-84ec-e723ff09c386" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:25:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:25:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:25:14 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:25:14 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:25:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=7541MB free_disk=25.581443786621094GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:25:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance b64f1cfb-64f2-4493-8721-fc63fcd93bb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:25:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e2ca19ea-868c-40ad-a453-f6e348cfac15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:25:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 0f059ccc-f609-4cf3-a644-c3d1305ae26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:25:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 02d227b0-2b25-467f-a318-ab46aa391a31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:25:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 3e869e37-c921-48e3-b89a-946bbcc1a5ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:25:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance d4146775-a271-4822-84ec-e723ff09c386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:25:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 080b458f-b0e4-4749-bb75-3efefa9dc8cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:25:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f922b46e-baa5-4df4-8ffa-59addad85748 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:25:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:25:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:25:15 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:25:15 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:25:15 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:25:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.655s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "d4146775-a271-4822-84ec-e723ff09c386" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "d4146775-a271-4822-84ec-e723ff09c386" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG nova.objects.instance [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lazy-loading 'flavor' on Instance uuid d4146775-a271-4822-84ec-e723ff09c386 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "d4146775-a271-4822-84ec-e723ff09c386" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "d4146775-a271-4822-84ec-e723ff09c386" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "d4146775-a271-4822-84ec-e723ff09c386" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:16 user nova-compute[72201]: INFO nova.compute.manager [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Attaching volume a7926ddf-5dc3-4ef2-b393-14a3310bd64c to /dev/vdb
Aug 01 15:25:16 user nova-compute[72201]: DEBUG os_brick.utils [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ce2c77-a58e-42b0-af5a-350feaaed495]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c5ae05-e7e1-4594-a0e6-00c79a3cb6e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d185f8-9861-46b7-8a61-b8a3172fa5d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2d129a-45b6-4cfc-a2c1-a32a42098727]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:25:16 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:25:16 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fa9913-e5e5-4791-87a6-f61609eb19a2]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG os_brick.utils [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:25:16 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Updating existing volume attachment record: 4181120e-2334-4ef7-9452-5e4648b07158 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:25:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:20 user nova-compute[72201]: DEBUG nova.compute.manager [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:25:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:25:21 user nova-compute[72201]: INFO nova.compute.claims [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Claim successful on node user
Aug 01 15:25:21 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:25:21 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:25:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:25:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:25:21 user nova-compute[72201]: DEBUG nova.network.neutron [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:25:21 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:25:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:25:21 user nova-compute[72201]: DEBUG nova.policy [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f08e5ef13d74417a8f07e7c82858ac86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b7341ffe06448bb276bdee2d242c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:25:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:25:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:25:21 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Creating image(s)
Aug 01 15:25:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "/opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "/opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.190s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.185s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk 1073741824" returned: 0 in 0.071s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.154s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Cannot resize image /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG nova.objects.instance [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lazy-loading 'migration_context' on Instance uuid 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Ensure instance console log exists: /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:22 user nova-compute[72201]: DEBUG nova.network.neutron [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Successfully created port: af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:25:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.network.neutron [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Successfully updated port: af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquired lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.network.neutron [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.network.neutron [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.compute.manager [req-adecbfbe-079e-455d-bb52-32aacf078789 req-a2c39228-2378-450c-8b03-78e84dacd659 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received event network-changed-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.compute.manager [req-adecbfbe-079e-455d-bb52-32aacf078789 req-a2c39228-2378-450c-8b03-78e84dacd659 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Refreshing instance network info cache due to event network-changed-af512d66-cb4c-4633-ba94-d8b6b3af6e87. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-adecbfbe-079e-455d-bb52-32aacf078789 req-a2c39228-2378-450c-8b03-78e84dacd659 service nova] Acquiring lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.network.neutron [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Updating instance_info_cache with network_info: [{"id": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "address": "fa:16:3e:49:45:f6", "network": {"id": "11d4bdb2-99b5-468c-aeb3-79328fdd2d1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58b7341ffe06448bb276bdee2d242c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf512d66-cb", "ovs_interfaceid": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Releasing lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Instance network_info: |[{"id": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "address": "fa:16:3e:49:45:f6", "network": {"id": "11d4bdb2-99b5-468c-aeb3-79328fdd2d1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58b7341ffe06448bb276bdee2d242c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf512d66-cb", "ovs_interfaceid": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-adecbfbe-079e-455d-bb52-32aacf078789 req-a2c39228-2378-450c-8b03-78e84dacd659 service nova] Acquired lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.network.neutron [req-adecbfbe-079e-455d-bb52-32aacf078789 req-a2c39228-2378-450c-8b03-78e84dacd659 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Refreshing network info cache for port af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Start _get_guest_xml network_info=[{"id": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "address": "fa:16:3e:49:45:f6", "network": {"id": "11d4bdb2-99b5-468c-aeb3-79328fdd2d1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58b7341ffe06448bb276bdee2d242c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf512d66-cb", "ovs_interfaceid": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:25:24 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:25:24 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-616113067',display_name='tempest-ServerStableDeviceRescueTest-server-616113067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-616113067',id=17,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3mv2L6pRwzDlLhsAfZgKjBYSoCSBLrKTMYtnKHzKZtZOFIChaqjgdb/atxzSM7ZpmJlUyit0iamU+T/ZT2+eMI8rXjGQV0wQ6XbxnRS7VabRySFu2LJnSzE7DAZn7bCw==',key_name='tempest-keypair-553162897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58b7341ffe06448bb276bdee2d242c59',ramdisk_id='',reservation_id='r-b64x8tdl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1956540841',owner_user_name='tempest-ServerStableDeviceRescueTest-1956540841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:25:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f08e5ef13d74417a8f07e7c82858ac86',uuid=3a2d865c-6c6c-49b1-a2d3-4afc63b10581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "address": "fa:16:3e:49:45:f6", "network": {"id": "11d4bdb2-99b5-468c-aeb3-79328fdd2d1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58b7341ffe06448bb276bdee2d242c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf512d66-cb", "ovs_interfaceid": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Converting VIF {"id": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "address": "fa:16:3e:49:45:f6", "network": {"id": "11d4bdb2-99b5-468c-aeb3-79328fdd2d1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58b7341ffe06448bb276bdee2d242c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf512d66-cb", "ovs_interfaceid": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:45:f6,bridge_name='br-int',has_traffic_filtering=True,id=af512d66-cb4c-4633-ba94-d8b6b3af6e87,network=Network(11d4bdb2-99b5-468c-aeb3-79328fdd2d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf512d66-cb') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.objects.instance [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:25:24 user nova-compute[72201]:   <uuid>3a2d865c-6c6c-49b1-a2d3-4afc63b10581</uuid>
Aug 01 15:25:24 user nova-compute[72201]:   <name>instance-00000011</name>
Aug 01 15:25:24 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:25:24 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:25:24 user nova-compute[72201]:   <metadata>
Aug 01 15:25:24 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:25:24 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:25:24 user nova-compute[72201]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-616113067</nova:name>
Aug 01 15:25:24 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:25:24</nova:creationTime>
Aug 01 15:25:24 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:25:24 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:25:24 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:25:24 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:25:24 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:25:24 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:25:24 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:25:24 user nova-compute[72201]:       <nova:owner>
Aug 01 15:25:24 user nova-compute[72201]:         <nova:user uuid="f08e5ef13d74417a8f07e7c82858ac86">tempest-ServerStableDeviceRescueTest-1956540841-project-member</nova:user>
Aug 01 15:25:24 user nova-compute[72201]:         <nova:project uuid="58b7341ffe06448bb276bdee2d242c59">tempest-ServerStableDeviceRescueTest-1956540841</nova:project>
Aug 01 15:25:24 user nova-compute[72201]:       </nova:owner>
Aug 01 15:25:24 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:25:24 user nova-compute[72201]:       <nova:ports>
Aug 01 15:25:24 user nova-compute[72201]:         <nova:port uuid="af512d66-cb4c-4633-ba94-d8b6b3af6e87">
Aug 01 15:25:24 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 15:25:24 user nova-compute[72201]:         </nova:port>
Aug 01 15:25:24 user nova-compute[72201]:       </nova:ports>
Aug 01 15:25:24 user nova-compute[72201]:     </nova:instance>
Aug 01 15:25:24 user nova-compute[72201]:   </metadata>
Aug 01 15:25:24 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:25:24 user nova-compute[72201]:     <system>
Aug 01 15:25:24 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:25:24 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:25:24 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:25:24 user nova-compute[72201]:       <entry name="serial">3a2d865c-6c6c-49b1-a2d3-4afc63b10581</entry>
Aug 01 15:25:24 user nova-compute[72201]:       <entry name="uuid">3a2d865c-6c6c-49b1-a2d3-4afc63b10581</entry>
Aug 01 15:25:24 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:25:24 user nova-compute[72201]:     </system>
Aug 01 15:25:24 user nova-compute[72201]:   </sysinfo>
Aug 01 15:25:24 user nova-compute[72201]:   <os>
Aug 01 15:25:24 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:25:24 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:25:24 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:25:24 user nova-compute[72201]:   </os>
Aug 01 15:25:24 user nova-compute[72201]:   <features>
Aug 01 15:25:24 user nova-compute[72201]:     <acpi/>
Aug 01 15:25:24 user nova-compute[72201]:     <apic/>
Aug 01 15:25:24 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:25:24 user nova-compute[72201]:   </features>
Aug 01 15:25:24 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:25:24 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:25:24 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:25:24 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:25:24 user nova-compute[72201]:   </clock>
Aug 01 15:25:24 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:25:24 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:25:24 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:25:24 user nova-compute[72201]:   </cpu>
Aug 01 15:25:24 user nova-compute[72201]:   <devices>
Aug 01 15:25:24 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:25:24 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:25:24 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk"/>
Aug 01 15:25:24 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:25:24 user nova-compute[72201]:     </disk>
Aug 01 15:25:24 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:25:24 user nova-compute[72201]:       <mac address="fa:16:3e:49:45:f6"/>
Aug 01 15:25:24 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:25:24 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:25:24 user nova-compute[72201]:       <target dev="tapaf512d66-cb"/>
Aug 01 15:25:24 user nova-compute[72201]:     </interface>
Aug 01 15:25:24 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:25:24 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/console.log" append="off"/>
Aug 01 15:25:24 user nova-compute[72201]:     </serial>
Aug 01 15:25:24 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:25:24 user nova-compute[72201]:     <video>
Aug 01 15:25:24 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:25:24 user nova-compute[72201]:     </video>
Aug 01 15:25:24 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:25:24 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:25:24 user nova-compute[72201]:     </rng>
Aug 01 15:25:24 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:25:24 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:25:24 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:25:24 user nova-compute[72201]:     </memballoon>
Aug 01 15:25:24 user nova-compute[72201]:   </devices>
Aug 01 15:25:24 user nova-compute[72201]: </domain>
Aug 01 15:25:24 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-616113067',display_name='tempest-ServerStableDeviceRescueTest-server-616113067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-616113067',id=17,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3mv2L6pRwzDlLhsAfZgKjBYSoCSBLrKTMYtnKHzKZtZOFIChaqjgdb/atxzSM7ZpmJlUyit0iamU+T/ZT2+eMI8rXjGQV0wQ6XbxnRS7VabRySFu2LJnSzE7DAZn7bCw==',key_name='tempest-keypair-553162897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58b7341ffe06448bb276bdee2d242c59',ramdisk_id='',reservation_id='r-b64x8tdl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1956540841',owner_user_name='tempest-ServerStableDeviceRescueTest-1956540841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:25:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f08e5ef13d74417a8f07e7c82858ac86',uuid=3a2d865c-6c6c-49b1-a2d3-4afc63b10581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "address": "fa:16:3e:49:45:f6", "network": {"id": "11d4bdb2-99b5-468c-aeb3-79328fdd2d1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58b7341ffe06448bb276bdee2d242c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf512d66-cb", "ovs_interfaceid": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Converting VIF {"id": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "address": "fa:16:3e:49:45:f6", "network": {"id": "11d4bdb2-99b5-468c-aeb3-79328fdd2d1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58b7341ffe06448bb276bdee2d242c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf512d66-cb", "ovs_interfaceid": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:45:f6,bridge_name='br-int',has_traffic_filtering=True,id=af512d66-cb4c-4633-ba94-d8b6b3af6e87,network=Network(11d4bdb2-99b5-468c-aeb3-79328fdd2d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf512d66-cb') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG os_vif [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:45:f6,bridge_name='br-int',has_traffic_filtering=True,id=af512d66-cb4c-4633-ba94-d8b6b3af6e87,network=Network(11d4bdb2-99b5-468c-aeb3-79328fdd2d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf512d66-cb') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf512d66-cb, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf512d66-cb, col_values=(('external_ids', {'iface-id': 'af512d66-cb4c-4633-ba94-d8b6b3af6e87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:45:f6', 'vm-uuid': '3a2d865c-6c6c-49b1-a2d3-4afc63b10581'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:24 user nova-compute[72201]: INFO os_vif [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:45:f6,bridge_name='br-int',has_traffic_filtering=True,id=af512d66-cb4c-4633-ba94-d8b6b3af6e87,network=Network(11d4bdb2-99b5-468c-aeb3-79328fdd2d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf512d66-cb')
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:25:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] No VIF found with MAC fa:16:3e:49:45:f6, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:25:25 user nova-compute[72201]: DEBUG nova.network.neutron [req-adecbfbe-079e-455d-bb52-32aacf078789 req-a2c39228-2378-450c-8b03-78e84dacd659 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Updated VIF entry in instance network info cache for port af512d66-cb4c-4633-ba94-d8b6b3af6e87. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:25:25 user nova-compute[72201]: DEBUG nova.network.neutron [req-adecbfbe-079e-455d-bb52-32aacf078789 req-a2c39228-2378-450c-8b03-78e84dacd659 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Updating instance_info_cache with network_info: [{"id": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "address": "fa:16:3e:49:45:f6", "network": {"id": "11d4bdb2-99b5-468c-aeb3-79328fdd2d1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58b7341ffe06448bb276bdee2d242c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf512d66-cb", "ovs_interfaceid": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:25:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-adecbfbe-079e-455d-bb52-32aacf078789 req-a2c39228-2378-450c-8b03-78e84dacd659 service nova] Releasing lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:25:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:26 user nova-compute[72201]: DEBUG nova.compute.manager [req-0f7a1abf-1982-48e3-8a55-daf528fb668e req-9e6fa09a-aa37-4455-9785-007d22fd90fb service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received event network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:25:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0f7a1abf-1982-48e3-8a55-daf528fb668e req-9e6fa09a-aa37-4455-9785-007d22fd90fb service nova] Acquiring lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0f7a1abf-1982-48e3-8a55-daf528fb668e req-9e6fa09a-aa37-4455-9785-007d22fd90fb service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0f7a1abf-1982-48e3-8a55-daf528fb668e req-9e6fa09a-aa37-4455-9785-007d22fd90fb service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:26 user nova-compute[72201]: DEBUG nova.compute.manager [req-0f7a1abf-1982-48e3-8a55-daf528fb668e req-9e6fa09a-aa37-4455-9785-007d22fd90fb service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] No waiting events found dispatching network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:25:26 user nova-compute[72201]: WARNING nova.compute.manager [req-0f7a1abf-1982-48e3-8a55-daf528fb668e req-9e6fa09a-aa37-4455-9785-007d22fd90fb service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received unexpected event network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 for instance with vm_state building and task_state spawning.
Aug 01 15:25:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:28 user nova-compute[72201]: DEBUG nova.compute.manager [req-bd1fd16c-0e8a-459b-9203-cb5089ae4d5d req-ee6b642c-1d2e-4542-bcfe-a5164931df60 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received event network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:25:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bd1fd16c-0e8a-459b-9203-cb5089ae4d5d req-ee6b642c-1d2e-4542-bcfe-a5164931df60 service nova] Acquiring lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bd1fd16c-0e8a-459b-9203-cb5089ae4d5d req-ee6b642c-1d2e-4542-bcfe-a5164931df60 service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bd1fd16c-0e8a-459b-9203-cb5089ae4d5d req-ee6b642c-1d2e-4542-bcfe-a5164931df60 service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:28 user nova-compute[72201]: DEBUG nova.compute.manager [req-bd1fd16c-0e8a-459b-9203-cb5089ae4d5d req-ee6b642c-1d2e-4542-bcfe-a5164931df60 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] No waiting events found dispatching network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:25:28 user nova-compute[72201]: WARNING nova.compute.manager [req-bd1fd16c-0e8a-459b-9203-cb5089ae4d5d req-ee6b642c-1d2e-4542-bcfe-a5164931df60 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received unexpected event network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 for instance with vm_state building and task_state spawning.
Aug 01 15:25:28 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903528.5615988, 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:25:28 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] VM Resumed (Lifecycle Event)
Aug 01 15:25:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:25:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:25:28 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Instance spawned successfully.
Aug 01 15:25:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:25:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:25:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:25:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:25:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:25:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:25:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:25:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:25:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:25:28 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:25:28 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903528.5634804, 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:25:28 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] VM Started (Lifecycle Event)
Aug 01 15:25:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:25:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:25:28 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:25:28 user nova-compute[72201]: INFO nova.compute.manager [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Took 6.78 seconds to spawn the instance on the hypervisor.
Aug 01 15:25:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:25:28 user nova-compute[72201]: INFO nova.compute.manager [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Took 7.82 seconds to build instance.
Aug 01 15:25:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aca89a88-87a2-4530-a242-63ff3accca96 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.951s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGOkvyPc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:25:32 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:25:32 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:25:32 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c404d64-638c-436c-878a-d6b1f4f59aec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:25:32 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[96aa5985-6b0c-4b57-b61c-a8090f56f6cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c] added
Aug 01 15:25:32 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5ae893-241a-4613-84e8-f97d28e3c8e9]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed24fad-9e0f-400e-9e62-e68ea72ff50b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pGOkvyPc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pGOkvyPc" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebedf53-4fef-4278-b29f-8a3a707c1b8f]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pGOkvyPc'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b0a493-c49e-4712-b8d7-bf1b940676fc]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bddf03-254a-4030-87cc-c86028fb5591]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:25:32 user nova-compute[72201]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 (non-flash)
Aug 01 15:25:32 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:25:32 user nova-compute[72201]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 (non-flash)
Aug 01 15:25:32 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[027a6089-a3f6-4ad2-b455-2f81e19ad3bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c, portal: 172.16.0.220,3260]
Aug 01 15:25:32 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c, portal: 172.16.0.220,3260] successful.
Aug 01 15:25:32 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2ee778-832d-4ffc-bda8-7971a708c5cd]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb441cc-f028-43c7-acef-c353963e263b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:25:32 user nova-compute[72201]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 (non-flash)
Aug 01 15:25:32 user nova-compute[72201]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)
Aug 01 15:25:32 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:25:32 user nova-compute[72201]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 (non-flash)
Aug 01 15:25:32 user nova-compute[72201]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)
Aug 01 15:25:32 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[812699f6-f104-4161-a74c-bf50e1428fc7]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:25:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGOkvyPc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:25:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.467s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:25:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] <== connect_volume: return (1469ms) {'type': 'block', 'scsi_wwn': '23630383465383361', 'path': '/dev/sdd'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:25:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630383465383361', 'path': '/dev/sdd'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:25:33 user nova-compute[72201]: DEBUG nova.objects.instance [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lazy-loading 'flavor' on Instance uuid d4146775-a271-4822-84ec-e723ff09c386 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:25:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:25:33 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:25:33 user nova-compute[72201]:   <source dev="/dev/sdd"/>
Aug 01 15:25:33 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:25:33 user nova-compute[72201]:   <serial>a7926ddf-5dc3-4ef2-b393-14a3310bd64c</serial>
Aug 01 15:25:33 user nova-compute[72201]: </disk>
Aug 01 15:25:33 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:25:34 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:25:34 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:25:34 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] No VIF found with MAC fa:16:3e:25:25:a5, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:25:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0818068c-d29f-4c67-aef0-e0786ccd929c tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "d4146775-a271-4822-84ec-e723ff09c386" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.844s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:40 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:25:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "865b371c-59c5-4004-8469-cdc1e9327ecb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "865b371c-59c5-4004-8469-cdc1e9327ecb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:40 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:25:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:25:40 user nova-compute[72201]: INFO nova.compute.claims [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Claim successful on node user
Aug 01 15:25:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:40 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:25:40 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.531s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:25:41 user nova-compute[72201]: INFO nova.compute.claims [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Claim successful on node user
Aug 01 15:25:41 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG nova.network.neutron [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:25:41 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:25:41 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG nova.policy [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fd505dbb02e4d3d8e8f97839b25ed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548641aee9954aa48c567e798b4be247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:25:41 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Creating image(s)
Aug 01 15:25:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "/opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "/opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "/opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.166s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.153s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf/disk 1073741824" returned: 0 in 0.080s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.821s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.181s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:25:41 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG nova.network.neutron [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:25:42 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:25:42 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Cannot resize image /opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG nova.objects.instance [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lazy-loading 'migration_context' on Instance uuid 34d08de5-479b-4e90-aa8d-aefe3d8876bf {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "080b458f-b0e4-4749-bb75-3efefa9dc8cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "080b458f-b0e4-4749-bb75-3efefa9dc8cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "080b458f-b0e4-4749-bb75-3efefa9dc8cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "080b458f-b0e4-4749-bb75-3efefa9dc8cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "080b458f-b0e4-4749-bb75-3efefa9dc8cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:42 user nova-compute[72201]: INFO nova.compute.manager [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Terminating instance
Aug 01 15:25:42 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Ensure instance console log exists: /opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.005s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:25:42 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Creating image(s)
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "/opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "/opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "/opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG nova.policy [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32967fa82739495685f336d7ace68000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a434898181465ea2df89c7b1e42597', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG nova.network.neutron [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Successfully created port: 077c9bc0-0430-488d-b9fb-33d6c4d57a55 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.166s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.171s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG nova.compute.manager [req-e8271f9f-77ce-47f4-94f0-518ae2e499ca req-737f7d9d-8f8d-4822-ae78-d31c01af35af service nova] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Received event network-vif-unplugged-0783c0b9-9575-4498-9e45-11c7a3fb8b16 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e8271f9f-77ce-47f4-94f0-518ae2e499ca req-737f7d9d-8f8d-4822-ae78-d31c01af35af service nova] Acquiring lock "080b458f-b0e4-4749-bb75-3efefa9dc8cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e8271f9f-77ce-47f4-94f0-518ae2e499ca req-737f7d9d-8f8d-4822-ae78-d31c01af35af service nova] Lock "080b458f-b0e4-4749-bb75-3efefa9dc8cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e8271f9f-77ce-47f4-94f0-518ae2e499ca req-737f7d9d-8f8d-4822-ae78-d31c01af35af service nova] Lock "080b458f-b0e4-4749-bb75-3efefa9dc8cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG nova.compute.manager [req-e8271f9f-77ce-47f4-94f0-518ae2e499ca req-737f7d9d-8f8d-4822-ae78-d31c01af35af service nova] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] No waiting events found dispatching network-vif-unplugged-0783c0b9-9575-4498-9e45-11c7a3fb8b16 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG nova.compute.manager [req-e8271f9f-77ce-47f4-94f0-518ae2e499ca req-737f7d9d-8f8d-4822-ae78-d31c01af35af service nova] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Received event network-vif-unplugged-0783c0b9-9575-4498-9e45-11c7a3fb8b16 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk 1073741824" returned: 0 in 0.064s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.155s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Checking if we can resize image /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:25:42 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Instance destroyed successfully.
Aug 01 15:25:42 user nova-compute[72201]: DEBUG nova.objects.instance [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lazy-loading 'resources' on Instance uuid 080b458f-b0e4-4749-bb75-3efefa9dc8cc {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1031468623',display_name='tempest-VolumesAdminNegativeTest-server-1031468623',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1031468623',id=15,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:23:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1cae4f1529be4369af543b05169568cc',ramdisk_id='',reservation_id='r-4ta0ro1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1786819113',owner_user_name='tempest-VolumesAdminNegativeTest-1786819113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:23:45Z,user_data=None,user_id='8c3e96bf4fb645898f1fc7987f4f0ccc',uuid=080b458f-b0e4-4749-bb75-3efefa9dc8cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0783c0b9-9575-4498-9e45-11c7a3fb8b16", "address": "fa:16:3e:ec:ee:1e", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783c0b9-95", "ovs_interfaceid": "0783c0b9-9575-4498-9e45-11c7a3fb8b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Converting VIF {"id": "0783c0b9-9575-4498-9e45-11c7a3fb8b16", "address": "fa:16:3e:ec:ee:1e", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0783c0b9-95", "ovs_interfaceid": "0783c0b9-9575-4498-9e45-11c7a3fb8b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ee:1e,bridge_name='br-int',has_traffic_filtering=True,id=0783c0b9-9575-4498-9e45-11c7a3fb8b16,network=Network(a3eccf4e-95d7-49ef-a540-4ce7e9a490b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0783c0b9-95') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG os_vif [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ee:1e,bridge_name='br-int',has_traffic_filtering=True,id=0783c0b9-9575-4498-9e45-11c7a3fb8b16,network=Network(a3eccf4e-95d7-49ef-a540-4ce7e9a490b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0783c0b9-95') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0783c0b9-95, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:25:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:25:43 user nova-compute[72201]: INFO os_vif [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ee:1e,bridge_name='br-int',has_traffic_filtering=True,id=0783c0b9-9575-4498-9e45-11c7a3fb8b16,network=Network(a3eccf4e-95d7-49ef-a540-4ce7e9a490b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0783c0b9-95')
Aug 01 15:25:43 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Deleting instance files /opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc_del
Aug 01 15:25:43 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Deletion of /opt/stack/data/nova/instances/080b458f-b0e4-4749-bb75-3efefa9dc8cc_del complete
Aug 01 15:25:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:25:43 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Cannot resize image /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:25:43 user nova-compute[72201]: DEBUG nova.objects.instance [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lazy-loading 'migration_context' on Instance uuid 865b371c-59c5-4004-8469-cdc1e9327ecb {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:25:43 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:25:43 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Ensure instance console log exists: /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:25:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:43 user nova-compute[72201]: INFO nova.compute.manager [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 01 15:25:43 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:25:43 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:25:43 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:25:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:43 user nova-compute[72201]: DEBUG nova.network.neutron [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Successfully updated port: 077c9bc0-0430-488d-b9fb-33d6c4d57a55 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:25:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "refresh_cache-34d08de5-479b-4e90-aa8d-aefe3d8876bf" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:25:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquired lock "refresh_cache-34d08de5-479b-4e90-aa8d-aefe3d8876bf" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:25:43 user nova-compute[72201]: DEBUG nova.network.neutron [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:25:43 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:25:43 user nova-compute[72201]: DEBUG nova.network.neutron [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:25:43 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Took 0.73 seconds to deallocate network for instance.
Aug 01 15:25:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-845df620-ee06-4cf3-a5d3-5259f8614eb6 req-2a1df2db-5254-4c79-acbe-95c1c3a927d4 service nova] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Received event network-vif-deleted-0783c0b9-9575-4498-9e45-11c7a3fb8b16 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.network.neutron [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Updating instance_info_cache with network_info: [{"id": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "address": "fa:16:3e:07:13:01", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077c9bc0-04", "ovs_interfaceid": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Releasing lock "refresh_cache-34d08de5-479b-4e90-aa8d-aefe3d8876bf" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Instance network_info: |[{"id": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "address": "fa:16:3e:07:13:01", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077c9bc0-04", "ovs_interfaceid": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Start _get_guest_xml network_info=[{"id": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "address": "fa:16:3e:07:13:01", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077c9bc0-04", "ovs_interfaceid": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:25:44 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:25:44 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1995873968',display_name='tempest-AttachVolumeNegativeTest-server-1995873968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1995873968',id=18,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKc3SXqSj5e4ca0ElrFyzAJ+ayYhokrdeRcIntW8w9Rc//WVbfpfwepQ1Ew/0G2CZc1FxuhUXuwdwz1qeXby9ypKd9g+7s8JgpilVpv/g2N8fdUaSLcvaa95IPWPzmv7JQ==',key_name='tempest-keypair-1602767497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548641aee9954aa48c567e798b4be247',ramdisk_id='',reservation_id='r-ykhc1tic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2028543234',owner_user_name='tempest-AttachVolumeNegativeTest-2028543234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:25:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd505dbb02e4d3d8e8f97839b25ed22',uuid=34d08de5-479b-4e90-aa8d-aefe3d8876bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "address": "fa:16:3e:07:13:01", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077c9bc0-04", "ovs_interfaceid": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converting VIF {"id": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "address": "fa:16:3e:07:13:01", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077c9bc0-04", "ovs_interfaceid": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:13:01,bridge_name='br-int',has_traffic_filtering=True,id=077c9bc0-0430-488d-b9fb-33d6c4d57a55,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077c9bc0-04') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.objects.instance [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lazy-loading 'pci_devices' on Instance uuid 34d08de5-479b-4e90-aa8d-aefe3d8876bf {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:25:44 user nova-compute[72201]:   <uuid>34d08de5-479b-4e90-aa8d-aefe3d8876bf</uuid>
Aug 01 15:25:44 user nova-compute[72201]:   <name>instance-00000012</name>
Aug 01 15:25:44 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:25:44 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:25:44 user nova-compute[72201]:   <metadata>
Aug 01 15:25:44 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:25:44 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:25:44 user nova-compute[72201]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1995873968</nova:name>
Aug 01 15:25:44 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:25:44</nova:creationTime>
Aug 01 15:25:44 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:25:44 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:25:44 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:25:44 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:25:44 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:25:44 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:25:44 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:25:44 user nova-compute[72201]:       <nova:owner>
Aug 01 15:25:44 user nova-compute[72201]:         <nova:user uuid="6fd505dbb02e4d3d8e8f97839b25ed22">tempest-AttachVolumeNegativeTest-2028543234-project-member</nova:user>
Aug 01 15:25:44 user nova-compute[72201]:         <nova:project uuid="548641aee9954aa48c567e798b4be247">tempest-AttachVolumeNegativeTest-2028543234</nova:project>
Aug 01 15:25:44 user nova-compute[72201]:       </nova:owner>
Aug 01 15:25:44 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:25:44 user nova-compute[72201]:       <nova:ports>
Aug 01 15:25:44 user nova-compute[72201]:         <nova:port uuid="077c9bc0-0430-488d-b9fb-33d6c4d57a55">
Aug 01 15:25:44 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 15:25:44 user nova-compute[72201]:         </nova:port>
Aug 01 15:25:44 user nova-compute[72201]:       </nova:ports>
Aug 01 15:25:44 user nova-compute[72201]:     </nova:instance>
Aug 01 15:25:44 user nova-compute[72201]:   </metadata>
Aug 01 15:25:44 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:25:44 user nova-compute[72201]:     <system>
Aug 01 15:25:44 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:25:44 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:25:44 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:25:44 user nova-compute[72201]:       <entry name="serial">34d08de5-479b-4e90-aa8d-aefe3d8876bf</entry>
Aug 01 15:25:44 user nova-compute[72201]:       <entry name="uuid">34d08de5-479b-4e90-aa8d-aefe3d8876bf</entry>
Aug 01 15:25:44 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:25:44 user nova-compute[72201]:     </system>
Aug 01 15:25:44 user nova-compute[72201]:   </sysinfo>
Aug 01 15:25:44 user nova-compute[72201]:   <os>
Aug 01 15:25:44 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:25:44 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:25:44 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:25:44 user nova-compute[72201]:   </os>
Aug 01 15:25:44 user nova-compute[72201]:   <features>
Aug 01 15:25:44 user nova-compute[72201]:     <acpi/>
Aug 01 15:25:44 user nova-compute[72201]:     <apic/>
Aug 01 15:25:44 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:25:44 user nova-compute[72201]:   </features>
Aug 01 15:25:44 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:25:44 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:25:44 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:25:44 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:25:44 user nova-compute[72201]:   </clock>
Aug 01 15:25:44 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:25:44 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:25:44 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:25:44 user nova-compute[72201]:   </cpu>
Aug 01 15:25:44 user nova-compute[72201]:   <devices>
Aug 01 15:25:44 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:25:44 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:25:44 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf/disk"/>
Aug 01 15:25:44 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:25:44 user nova-compute[72201]:     </disk>
Aug 01 15:25:44 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:25:44 user nova-compute[72201]:       <mac address="fa:16:3e:07:13:01"/>
Aug 01 15:25:44 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:25:44 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:25:44 user nova-compute[72201]:       <target dev="tap077c9bc0-04"/>
Aug 01 15:25:44 user nova-compute[72201]:     </interface>
Aug 01 15:25:44 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:25:44 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf/console.log" append="off"/>
Aug 01 15:25:44 user nova-compute[72201]:     </serial>
Aug 01 15:25:44 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:25:44 user nova-compute[72201]:     <video>
Aug 01 15:25:44 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:25:44 user nova-compute[72201]:     </video>
Aug 01 15:25:44 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:25:44 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:25:44 user nova-compute[72201]:     </rng>
Aug 01 15:25:44 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:25:44 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:25:44 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:25:44 user nova-compute[72201]:     </memballoon>
Aug 01 15:25:44 user nova-compute[72201]:   </devices>
Aug 01 15:25:44 user nova-compute[72201]: </domain>
Aug 01 15:25:44 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1995873968',display_name='tempest-AttachVolumeNegativeTest-server-1995873968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1995873968',id=18,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKc3SXqSj5e4ca0ElrFyzAJ+ayYhokrdeRcIntW8w9Rc//WVbfpfwepQ1Ew/0G2CZc1FxuhUXuwdwz1qeXby9ypKd9g+7s8JgpilVpv/g2N8fdUaSLcvaa95IPWPzmv7JQ==',key_name='tempest-keypair-1602767497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548641aee9954aa48c567e798b4be247',ramdisk_id='',reservation_id='r-ykhc1tic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2028543234',owner_user_name='tempest-AttachVolumeNegativeTest-2028543234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:25:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd505dbb02e4d3d8e8f97839b25ed22',uuid=34d08de5-479b-4e90-aa8d-aefe3d8876bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "address": "fa:16:3e:07:13:01", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077c9bc0-04", "ovs_interfaceid": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converting VIF {"id": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "address": "fa:16:3e:07:13:01", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077c9bc0-04", "ovs_interfaceid": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:13:01,bridge_name='br-int',has_traffic_filtering=True,id=077c9bc0-0430-488d-b9fb-33d6c4d57a55,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077c9bc0-04') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG os_vif [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:13:01,bridge_name='br-int',has_traffic_filtering=True,id=077c9bc0-0430-488d-b9fb-33d6c4d57a55,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077c9bc0-04') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap077c9bc0-04, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap077c9bc0-04, col_values=(('external_ids', {'iface-id': '077c9bc0-0430-488d-b9fb-33d6c4d57a55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:13:01', 'vm-uuid': '34d08de5-479b-4e90-aa8d-aefe3d8876bf'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:44 user nova-compute[72201]: INFO os_vif [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:13:01,bridge_name='br-int',has_traffic_filtering=True,id=077c9bc0-0430-488d-b9fb-33d6c4d57a55,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077c9bc0-04')
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.705s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] No VIF found with MAC fa:16:3e:07:13:01, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:25:44 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Deleted allocations for instance 080b458f-b0e4-4749-bb75-3efefa9dc8cc
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-9f1990bc-c76f-4ca9-90e4-c8a429e3fe35 req-9b278792-b732-4572-b076-d9c613d18dbf service nova] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Received event network-vif-plugged-0783c0b9-9575-4498-9e45-11c7a3fb8b16 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9f1990bc-c76f-4ca9-90e4-c8a429e3fe35 req-9b278792-b732-4572-b076-d9c613d18dbf service nova] Acquiring lock "080b458f-b0e4-4749-bb75-3efefa9dc8cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9f1990bc-c76f-4ca9-90e4-c8a429e3fe35 req-9b278792-b732-4572-b076-d9c613d18dbf service nova] Lock "080b458f-b0e4-4749-bb75-3efefa9dc8cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9f1990bc-c76f-4ca9-90e4-c8a429e3fe35 req-9b278792-b732-4572-b076-d9c613d18dbf service nova] Lock "080b458f-b0e4-4749-bb75-3efefa9dc8cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-9f1990bc-c76f-4ca9-90e4-c8a429e3fe35 req-9b278792-b732-4572-b076-d9c613d18dbf service nova] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] No waiting events found dispatching network-vif-plugged-0783c0b9-9575-4498-9e45-11c7a3fb8b16 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:25:44 user nova-compute[72201]: WARNING nova.compute.manager [req-9f1990bc-c76f-4ca9-90e4-c8a429e3fe35 req-9b278792-b732-4572-b076-d9c613d18dbf service nova] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Received unexpected event network-vif-plugged-0783c0b9-9575-4498-9e45-11c7a3fb8b16 for instance with vm_state deleted and task_state None.
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-9f1990bc-c76f-4ca9-90e4-c8a429e3fe35 req-9b278792-b732-4572-b076-d9c613d18dbf service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Received event network-changed-077c9bc0-0430-488d-b9fb-33d6c4d57a55 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-9f1990bc-c76f-4ca9-90e4-c8a429e3fe35 req-9b278792-b732-4572-b076-d9c613d18dbf service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Refreshing instance network info cache due to event network-changed-077c9bc0-0430-488d-b9fb-33d6c4d57a55. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9f1990bc-c76f-4ca9-90e4-c8a429e3fe35 req-9b278792-b732-4572-b076-d9c613d18dbf service nova] Acquiring lock "refresh_cache-34d08de5-479b-4e90-aa8d-aefe3d8876bf" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9f1990bc-c76f-4ca9-90e4-c8a429e3fe35 req-9b278792-b732-4572-b076-d9c613d18dbf service nova] Acquired lock "refresh_cache-34d08de5-479b-4e90-aa8d-aefe3d8876bf" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.network.neutron [req-9f1990bc-c76f-4ca9-90e4-c8a429e3fe35 req-9b278792-b732-4572-b076-d9c613d18dbf service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Refreshing network info cache for port 077c9bc0-0430-488d-b9fb-33d6c4d57a55 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d092685e-adee-43bc-9cf0-2f0c474a88f3 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "080b458f-b0e4-4749-bb75-3efefa9dc8cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.733s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:44 user nova-compute[72201]: DEBUG nova.network.neutron [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Successfully created port: d3f16763-8835-4330-945f-ab8dc7045426 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:25:45 user nova-compute[72201]: DEBUG nova.network.neutron [req-9f1990bc-c76f-4ca9-90e4-c8a429e3fe35 req-9b278792-b732-4572-b076-d9c613d18dbf service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Updated VIF entry in instance network info cache for port 077c9bc0-0430-488d-b9fb-33d6c4d57a55. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:25:45 user nova-compute[72201]: DEBUG nova.network.neutron [req-9f1990bc-c76f-4ca9-90e4-c8a429e3fe35 req-9b278792-b732-4572-b076-d9c613d18dbf service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Updating instance_info_cache with network_info: [{"id": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "address": "fa:16:3e:07:13:01", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077c9bc0-04", "ovs_interfaceid": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:25:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9f1990bc-c76f-4ca9-90e4-c8a429e3fe35 req-9b278792-b732-4572-b076-d9c613d18dbf service nova] Releasing lock "refresh_cache-34d08de5-479b-4e90-aa8d-aefe3d8876bf" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:25:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:47 user nova-compute[72201]: DEBUG nova.compute.manager [req-4b118f3d-994c-431e-be3d-83307b739383 req-6c4f88cc-91c7-4e55-88c6-2c6e41700c7d service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Received event network-vif-plugged-077c9bc0-0430-488d-b9fb-33d6c4d57a55 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:25:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4b118f3d-994c-431e-be3d-83307b739383 req-6c4f88cc-91c7-4e55-88c6-2c6e41700c7d service nova] Acquiring lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4b118f3d-994c-431e-be3d-83307b739383 req-6c4f88cc-91c7-4e55-88c6-2c6e41700c7d service nova] Lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4b118f3d-994c-431e-be3d-83307b739383 req-6c4f88cc-91c7-4e55-88c6-2c6e41700c7d service nova] Lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:47 user nova-compute[72201]: DEBUG nova.compute.manager [req-4b118f3d-994c-431e-be3d-83307b739383 req-6c4f88cc-91c7-4e55-88c6-2c6e41700c7d service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] No waiting events found dispatching network-vif-plugged-077c9bc0-0430-488d-b9fb-33d6c4d57a55 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:25:47 user nova-compute[72201]: WARNING nova.compute.manager [req-4b118f3d-994c-431e-be3d-83307b739383 req-6c4f88cc-91c7-4e55-88c6-2c6e41700c7d service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Received unexpected event network-vif-plugged-077c9bc0-0430-488d-b9fb-33d6c4d57a55 for instance with vm_state building and task_state spawning.
Aug 01 15:25:47 user nova-compute[72201]: DEBUG nova.network.neutron [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Successfully updated port: d3f16763-8835-4330-945f-ab8dc7045426 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:25:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "refresh_cache-865b371c-59c5-4004-8469-cdc1e9327ecb" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:25:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquired lock "refresh_cache-865b371c-59c5-4004-8469-cdc1e9327ecb" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:25:47 user nova-compute[72201]: DEBUG nova.network.neutron [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.network.neutron [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903548.4584913, 34d08de5-479b-4e90-aa8d-aefe3d8876bf => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:25:48 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] VM Resumed (Lifecycle Event)
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:25:48 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Instance spawned successfully.
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:25:48 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903548.4635992, 34d08de5-479b-4e90-aa8d-aefe3d8876bf => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:25:48 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] VM Started (Lifecycle Event)
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:25:48 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:25:48 user nova-compute[72201]: INFO nova.compute.manager [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Took 7.31 seconds to spawn the instance on the hypervisor.
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.network.neutron [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Updating instance_info_cache with network_info: [{"id": "d3f16763-8835-4330-945f-ab8dc7045426", "address": "fa:16:3e:f0:07:0d", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f16763-88", "ovs_interfaceid": "d3f16763-8835-4330-945f-ab8dc7045426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:25:48 user nova-compute[72201]: INFO nova.compute.manager [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Took 8.39 seconds to build instance.
Aug 01 15:25:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Releasing lock "refresh_cache-865b371c-59c5-4004-8469-cdc1e9327ecb" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Instance network_info: |[{"id": "d3f16763-8835-4330-945f-ab8dc7045426", "address": "fa:16:3e:f0:07:0d", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f16763-88", "ovs_interfaceid": "d3f16763-8835-4330-945f-ab8dc7045426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Start _get_guest_xml network_info=[{"id": "d3f16763-8835-4330-945f-ab8dc7045426", "address": "fa:16:3e:f0:07:0d", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f16763-88", "ovs_interfaceid": "d3f16763-8835-4330-945f-ab8dc7045426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4ec970eb-fa48-4821-b01b-ff301c39b747 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.527s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:48 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:25:48 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1276795495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1276795495',id=19,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDZ0j58I8/Te9XqUZQ/tJwDoebmtJ26MOYivVZDlyyJzobMeRC060C4moZAKcQ6viSYdrrgwD1vNtgBhV/e5jOSRdeVi1igPFX/kAHDugSRCnghEn66FoQOaRhSmUbLHQ==',key_name='tempest-keypair-794991541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0a434898181465ea2df89c7b1e42597',ramdisk_id='',reservation_id='r-ps12rmk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1609612653',owner_user_name='tempest-ServerActionsV293TestJSON-1609612653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:25:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32967fa82739495685f336d7ace68000',uuid=865b371c-59c5-4004-8469-cdc1e9327ecb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3f16763-8835-4330-945f-ab8dc7045426", "address": "fa:16:3e:f0:07:0d", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f16763-88", "ovs_interfaceid": "d3f16763-8835-4330-945f-ab8dc7045426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Converting VIF {"id": "d3f16763-8835-4330-945f-ab8dc7045426", "address": "fa:16:3e:f0:07:0d", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f16763-88", "ovs_interfaceid": "d3f16763-8835-4330-945f-ab8dc7045426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=d3f16763-8835-4330-945f-ab8dc7045426,network=Network(968d4faa-613e-4954-86cc-3df6b86a2491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3f16763-88') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.objects.instance [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lazy-loading 'pci_devices' on Instance uuid 865b371c-59c5-4004-8469-cdc1e9327ecb {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:25:48 user nova-compute[72201]:   <uuid>865b371c-59c5-4004-8469-cdc1e9327ecb</uuid>
Aug 01 15:25:48 user nova-compute[72201]:   <name>instance-00000013</name>
Aug 01 15:25:48 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:25:48 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:25:48 user nova-compute[72201]:   <metadata>
Aug 01 15:25:48 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:25:48 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:25:48 user nova-compute[72201]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1276795495</nova:name>
Aug 01 15:25:48 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:25:48</nova:creationTime>
Aug 01 15:25:48 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:25:48 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:25:48 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:25:48 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:25:48 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:25:48 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:25:48 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:25:48 user nova-compute[72201]:       <nova:owner>
Aug 01 15:25:48 user nova-compute[72201]:         <nova:user uuid="32967fa82739495685f336d7ace68000">tempest-ServerActionsV293TestJSON-1609612653-project-member</nova:user>
Aug 01 15:25:48 user nova-compute[72201]:         <nova:project uuid="b0a434898181465ea2df89c7b1e42597">tempest-ServerActionsV293TestJSON-1609612653</nova:project>
Aug 01 15:25:48 user nova-compute[72201]:       </nova:owner>
Aug 01 15:25:48 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:25:48 user nova-compute[72201]:       <nova:ports>
Aug 01 15:25:48 user nova-compute[72201]:         <nova:port uuid="d3f16763-8835-4330-945f-ab8dc7045426">
Aug 01 15:25:48 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 15:25:48 user nova-compute[72201]:         </nova:port>
Aug 01 15:25:48 user nova-compute[72201]:       </nova:ports>
Aug 01 15:25:48 user nova-compute[72201]:     </nova:instance>
Aug 01 15:25:48 user nova-compute[72201]:   </metadata>
Aug 01 15:25:48 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:25:48 user nova-compute[72201]:     <system>
Aug 01 15:25:48 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:25:48 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:25:48 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:25:48 user nova-compute[72201]:       <entry name="serial">865b371c-59c5-4004-8469-cdc1e9327ecb</entry>
Aug 01 15:25:48 user nova-compute[72201]:       <entry name="uuid">865b371c-59c5-4004-8469-cdc1e9327ecb</entry>
Aug 01 15:25:48 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:25:48 user nova-compute[72201]:     </system>
Aug 01 15:25:48 user nova-compute[72201]:   </sysinfo>
Aug 01 15:25:48 user nova-compute[72201]:   <os>
Aug 01 15:25:48 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:25:48 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:25:48 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:25:48 user nova-compute[72201]:   </os>
Aug 01 15:25:48 user nova-compute[72201]:   <features>
Aug 01 15:25:48 user nova-compute[72201]:     <acpi/>
Aug 01 15:25:48 user nova-compute[72201]:     <apic/>
Aug 01 15:25:48 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:25:48 user nova-compute[72201]:   </features>
Aug 01 15:25:48 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:25:48 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:25:48 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:25:48 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:25:48 user nova-compute[72201]:   </clock>
Aug 01 15:25:48 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:25:48 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:25:48 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:25:48 user nova-compute[72201]:   </cpu>
Aug 01 15:25:48 user nova-compute[72201]:   <devices>
Aug 01 15:25:48 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:25:48 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:25:48 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk"/>
Aug 01 15:25:48 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:25:48 user nova-compute[72201]:     </disk>
Aug 01 15:25:48 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:25:48 user nova-compute[72201]:       <mac address="fa:16:3e:f0:07:0d"/>
Aug 01 15:25:48 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:25:48 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:25:48 user nova-compute[72201]:       <target dev="tapd3f16763-88"/>
Aug 01 15:25:48 user nova-compute[72201]:     </interface>
Aug 01 15:25:48 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:25:48 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/console.log" append="off"/>
Aug 01 15:25:48 user nova-compute[72201]:     </serial>
Aug 01 15:25:48 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:25:48 user nova-compute[72201]:     <video>
Aug 01 15:25:48 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:25:48 user nova-compute[72201]:     </video>
Aug 01 15:25:48 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:25:48 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:25:48 user nova-compute[72201]:     </rng>
Aug 01 15:25:48 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:25:48 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:25:48 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:25:48 user nova-compute[72201]:     </memballoon>
Aug 01 15:25:48 user nova-compute[72201]:   </devices>
Aug 01 15:25:48 user nova-compute[72201]: </domain>
Aug 01 15:25:48 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1276795495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1276795495',id=19,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDZ0j58I8/Te9XqUZQ/tJwDoebmtJ26MOYivVZDlyyJzobMeRC060C4moZAKcQ6viSYdrrgwD1vNtgBhV/e5jOSRdeVi1igPFX/kAHDugSRCnghEn66FoQOaRhSmUbLHQ==',key_name='tempest-keypair-794991541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0a434898181465ea2df89c7b1e42597',ramdisk_id='',reservation_id='r-ps12rmk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1609612653',owner_user_name='tempest-ServerActionsV293TestJSON-1609612653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:25:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32967fa82739495685f336d7ace68000',uuid=865b371c-59c5-4004-8469-cdc1e9327ecb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3f16763-8835-4330-945f-ab8dc7045426", "address": "fa:16:3e:f0:07:0d", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f16763-88", "ovs_interfaceid": "d3f16763-8835-4330-945f-ab8dc7045426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Converting VIF {"id": "d3f16763-8835-4330-945f-ab8dc7045426", "address": "fa:16:3e:f0:07:0d", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f16763-88", "ovs_interfaceid": "d3f16763-8835-4330-945f-ab8dc7045426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=d3f16763-8835-4330-945f-ab8dc7045426,network=Network(968d4faa-613e-4954-86cc-3df6b86a2491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3f16763-88') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG os_vif [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=d3f16763-8835-4330-945f-ab8dc7045426,network=Network(968d4faa-613e-4954-86cc-3df6b86a2491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3f16763-88') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3f16763-88, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd3f16763-88, col_values=(('external_ids', {'iface-id': 'd3f16763-8835-4330-945f-ab8dc7045426', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:07:0d', 'vm-uuid': '865b371c-59c5-4004-8469-cdc1e9327ecb'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:48 user nova-compute[72201]: INFO os_vif [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=d3f16763-8835-4330-945f-ab8dc7045426,network=Network(968d4faa-613e-4954-86cc-3df6b86a2491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3f16763-88')
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:25:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] No VIF found with MAC fa:16:3e:f0:07:0d, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:25:49 user nova-compute[72201]: DEBUG nova.compute.manager [req-102a23f5-defa-4c58-aac7-b55f243f7413 req-6556f4f5-8132-4c05-9cb0-c034a25a9ef2 service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Received event network-changed-d3f16763-8835-4330-945f-ab8dc7045426 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:25:49 user nova-compute[72201]: DEBUG nova.compute.manager [req-102a23f5-defa-4c58-aac7-b55f243f7413 req-6556f4f5-8132-4c05-9cb0-c034a25a9ef2 service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Refreshing instance network info cache due to event network-changed-d3f16763-8835-4330-945f-ab8dc7045426. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:25:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-102a23f5-defa-4c58-aac7-b55f243f7413 req-6556f4f5-8132-4c05-9cb0-c034a25a9ef2 service nova] Acquiring lock "refresh_cache-865b371c-59c5-4004-8469-cdc1e9327ecb" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:25:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-102a23f5-defa-4c58-aac7-b55f243f7413 req-6556f4f5-8132-4c05-9cb0-c034a25a9ef2 service nova] Acquired lock "refresh_cache-865b371c-59c5-4004-8469-cdc1e9327ecb" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:25:49 user nova-compute[72201]: DEBUG nova.network.neutron [req-102a23f5-defa-4c58-aac7-b55f243f7413 req-6556f4f5-8132-4c05-9cb0-c034a25a9ef2 service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Refreshing network info cache for port d3f16763-8835-4330-945f-ab8dc7045426 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:25:50 user nova-compute[72201]: DEBUG nova.network.neutron [req-102a23f5-defa-4c58-aac7-b55f243f7413 req-6556f4f5-8132-4c05-9cb0-c034a25a9ef2 service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Updated VIF entry in instance network info cache for port d3f16763-8835-4330-945f-ab8dc7045426. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:25:50 user nova-compute[72201]: DEBUG nova.network.neutron [req-102a23f5-defa-4c58-aac7-b55f243f7413 req-6556f4f5-8132-4c05-9cb0-c034a25a9ef2 service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Updating instance_info_cache with network_info: [{"id": "d3f16763-8835-4330-945f-ab8dc7045426", "address": "fa:16:3e:f0:07:0d", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f16763-88", "ovs_interfaceid": "d3f16763-8835-4330-945f-ab8dc7045426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:25:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-102a23f5-defa-4c58-aac7-b55f243f7413 req-6556f4f5-8132-4c05-9cb0-c034a25a9ef2 service nova] Releasing lock "refresh_cache-865b371c-59c5-4004-8469-cdc1e9327ecb" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:25:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-102a23f5-defa-4c58-aac7-b55f243f7413 req-6556f4f5-8132-4c05-9cb0-c034a25a9ef2 service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Received event network-vif-plugged-077c9bc0-0430-488d-b9fb-33d6c4d57a55 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:25:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-102a23f5-defa-4c58-aac7-b55f243f7413 req-6556f4f5-8132-4c05-9cb0-c034a25a9ef2 service nova] Acquiring lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-102a23f5-defa-4c58-aac7-b55f243f7413 req-6556f4f5-8132-4c05-9cb0-c034a25a9ef2 service nova] Lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-102a23f5-defa-4c58-aac7-b55f243f7413 req-6556f4f5-8132-4c05-9cb0-c034a25a9ef2 service nova] Lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-102a23f5-defa-4c58-aac7-b55f243f7413 req-6556f4f5-8132-4c05-9cb0-c034a25a9ef2 service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] No waiting events found dispatching network-vif-plugged-077c9bc0-0430-488d-b9fb-33d6c4d57a55 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:25:50 user nova-compute[72201]: WARNING nova.compute.manager [req-102a23f5-defa-4c58-aac7-b55f243f7413 req-6556f4f5-8132-4c05-9cb0-c034a25a9ef2 service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Received unexpected event network-vif-plugged-077c9bc0-0430-488d-b9fb-33d6c4d57a55 for instance with vm_state active and task_state None.
Aug 01 15:25:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:51 user nova-compute[72201]: DEBUG nova.compute.manager [req-4c578bfa-fee2-4399-bfb9-c67918d87e79 req-15aba293-7ee9-48e0-a8b7-899abc2ae0ad service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Received event network-vif-plugged-d3f16763-8835-4330-945f-ab8dc7045426 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:25:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4c578bfa-fee2-4399-bfb9-c67918d87e79 req-15aba293-7ee9-48e0-a8b7-899abc2ae0ad service nova] Acquiring lock "865b371c-59c5-4004-8469-cdc1e9327ecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4c578bfa-fee2-4399-bfb9-c67918d87e79 req-15aba293-7ee9-48e0-a8b7-899abc2ae0ad service nova] Lock "865b371c-59c5-4004-8469-cdc1e9327ecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4c578bfa-fee2-4399-bfb9-c67918d87e79 req-15aba293-7ee9-48e0-a8b7-899abc2ae0ad service nova] Lock "865b371c-59c5-4004-8469-cdc1e9327ecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:51 user nova-compute[72201]: DEBUG nova.compute.manager [req-4c578bfa-fee2-4399-bfb9-c67918d87e79 req-15aba293-7ee9-48e0-a8b7-899abc2ae0ad service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] No waiting events found dispatching network-vif-plugged-d3f16763-8835-4330-945f-ab8dc7045426 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:25:51 user nova-compute[72201]: WARNING nova.compute.manager [req-4c578bfa-fee2-4399-bfb9-c67918d87e79 req-15aba293-7ee9-48e0-a8b7-899abc2ae0ad service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Received unexpected event network-vif-plugged-d3f16763-8835-4330-945f-ab8dc7045426 for instance with vm_state building and task_state spawning.
Aug 01 15:25:51 user nova-compute[72201]: DEBUG nova.compute.manager [req-4c578bfa-fee2-4399-bfb9-c67918d87e79 req-15aba293-7ee9-48e0-a8b7-899abc2ae0ad service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Received event network-vif-plugged-d3f16763-8835-4330-945f-ab8dc7045426 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:25:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4c578bfa-fee2-4399-bfb9-c67918d87e79 req-15aba293-7ee9-48e0-a8b7-899abc2ae0ad service nova] Acquiring lock "865b371c-59c5-4004-8469-cdc1e9327ecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:25:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4c578bfa-fee2-4399-bfb9-c67918d87e79 req-15aba293-7ee9-48e0-a8b7-899abc2ae0ad service nova] Lock "865b371c-59c5-4004-8469-cdc1e9327ecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:25:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4c578bfa-fee2-4399-bfb9-c67918d87e79 req-15aba293-7ee9-48e0-a8b7-899abc2ae0ad service nova] Lock "865b371c-59c5-4004-8469-cdc1e9327ecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:51 user nova-compute[72201]: DEBUG nova.compute.manager [req-4c578bfa-fee2-4399-bfb9-c67918d87e79 req-15aba293-7ee9-48e0-a8b7-899abc2ae0ad service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] No waiting events found dispatching network-vif-plugged-d3f16763-8835-4330-945f-ab8dc7045426 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:25:51 user nova-compute[72201]: WARNING nova.compute.manager [req-4c578bfa-fee2-4399-bfb9-c67918d87e79 req-15aba293-7ee9-48e0-a8b7-899abc2ae0ad service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Received unexpected event network-vif-plugged-d3f16763-8835-4330-945f-ab8dc7045426 for instance with vm_state building and task_state spawning.
Aug 01 15:25:53 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903553.0126677, 865b371c-59c5-4004-8469-cdc1e9327ecb => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:25:53 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] VM Resumed (Lifecycle Event)
Aug 01 15:25:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:25:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:25:53 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Instance spawned successfully.
Aug 01 15:25:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:25:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:25:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:25:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:25:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:25:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:25:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:25:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:25:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:25:53 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:25:53 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903553.0158846, 865b371c-59c5-4004-8469-cdc1e9327ecb => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:25:53 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] VM Started (Lifecycle Event)
Aug 01 15:25:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:25:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:25:53 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:25:53 user nova-compute[72201]: INFO nova.compute.manager [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Took 10.88 seconds to spawn the instance on the hypervisor.
Aug 01 15:25:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:25:53 user nova-compute[72201]: INFO nova.compute.manager [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Took 12.78 seconds to build instance.
Aug 01 15:25:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d285bb0e-7699-473a-9523-c2c9e9903e18 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "865b371c-59c5-4004-8469-cdc1e9327ecb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.913s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:25:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:56 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:25:56 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:25:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72201) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 15:25:57 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:25:57 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903542.924695, 080b458f-b0e4-4749-bb75-3efefa9dc8cc => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:25:57 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] VM Stopped (Lifecycle Event)
Aug 01 15:25:57 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75a9eb2d-c20f-431e-8e82-c6f606ec4f36 None None] [instance: 080b458f-b0e4-4749-bb75-3efefa9dc8cc] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:25:58 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:25:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:25:59 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:25:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:25:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Didn't find any instances for network info cache update. {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 15:26:00 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:26:02 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:26:03 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:26:03 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:26:03 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:26:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-fecb46de-c1ea-4837-8caa-391be75565ac req-073b2fbd-a0f7-4298-ab59-2e25c82548fd service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received event network-changed-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:26:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-fecb46de-c1ea-4837-8caa-391be75565ac req-073b2fbd-a0f7-4298-ab59-2e25c82548fd service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Refreshing instance network info cache due to event network-changed-a2128465-b362-4945-945b-c02795ea1705. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:26:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-fecb46de-c1ea-4837-8caa-391be75565ac req-073b2fbd-a0f7-4298-ab59-2e25c82548fd service nova] Acquiring lock "refresh_cache-3e869e37-c921-48e3-b89a-946bbcc1a5ed" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:26:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-fecb46de-c1ea-4837-8caa-391be75565ac req-073b2fbd-a0f7-4298-ab59-2e25c82548fd service nova] Acquired lock "refresh_cache-3e869e37-c921-48e3-b89a-946bbcc1a5ed" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:26:04 user nova-compute[72201]: DEBUG nova.network.neutron [req-fecb46de-c1ea-4837-8caa-391be75565ac req-073b2fbd-a0f7-4298-ab59-2e25c82548fd service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Refreshing network info cache for port a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:26:05 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:26:05 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:26:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:05 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:26:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:05 user nova-compute[72201]: DEBUG nova.network.neutron [req-fecb46de-c1ea-4837-8caa-391be75565ac req-073b2fbd-a0f7-4298-ab59-2e25c82548fd service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Updated VIF entry in instance network info cache for port a2128465-b362-4945-945b-c02795ea1705. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:26:05 user nova-compute[72201]: DEBUG nova.network.neutron [req-fecb46de-c1ea-4837-8caa-391be75565ac req-073b2fbd-a0f7-4298-ab59-2e25c82548fd service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Updating instance_info_cache with network_info: [{"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:26:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-fecb46de-c1ea-4837-8caa-391be75565ac req-073b2fbd-a0f7-4298-ab59-2e25c82548fd service nova] Releasing lock "refresh_cache-3e869e37-c921-48e3-b89a-946bbcc1a5ed" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:26:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-70e51bd3-9e05-4203-a7cc-cd0d33dcde86 req-adfb76d4-4176-4c2a-9902-a52eda33bb52 service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received event network-changed-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:26:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-70e51bd3-9e05-4203-a7cc-cd0d33dcde86 req-adfb76d4-4176-4c2a-9902-a52eda33bb52 service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Refreshing instance network info cache due to event network-changed-a2128465-b362-4945-945b-c02795ea1705. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:26:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-70e51bd3-9e05-4203-a7cc-cd0d33dcde86 req-adfb76d4-4176-4c2a-9902-a52eda33bb52 service nova] Acquiring lock "refresh_cache-3e869e37-c921-48e3-b89a-946bbcc1a5ed" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:26:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-70e51bd3-9e05-4203-a7cc-cd0d33dcde86 req-adfb76d4-4176-4c2a-9902-a52eda33bb52 service nova] Acquired lock "refresh_cache-3e869e37-c921-48e3-b89a-946bbcc1a5ed" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:26:06 user nova-compute[72201]: DEBUG nova.network.neutron [req-70e51bd3-9e05-4203-a7cc-cd0d33dcde86 req-adfb76d4-4176-4c2a-9902-a52eda33bb52 service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Refreshing network info cache for port a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:26:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:26:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:06 user nova-compute[72201]: INFO nova.compute.manager [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Detaching volume 3d7258d0-79fd-4a0d-a041-1805193377fb
Aug 01 15:26:07 user nova-compute[72201]: INFO nova.virt.block_device [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Attempting to driver detach volume 3d7258d0-79fd-4a0d-a041-1805193377fb from mountpoint /dev/vdb
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Attempting to detach device vdb from instance 3e869e37-c921-48e3-b89a-946bbcc1a5ed from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:26:07 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:26:07 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 15:26:07 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:26:07 user nova-compute[72201]:   <serial>3d7258d0-79fd-4a0d-a041-1805193377fb</serial>
Aug 01 15:26:07 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 15:26:07 user nova-compute[72201]: </disk>
Aug 01 15:26:07 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:26:07 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Successfully detached device vdb from instance 3e869e37-c921-48e3-b89a-946bbcc1a5ed from the persistent domain config.
Aug 01 15:26:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3e869e37-c921-48e3-b89a-946bbcc1a5ed from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:26:07 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:26:07 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 15:26:07 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:26:07 user nova-compute[72201]:   <serial>3d7258d0-79fd-4a0d-a041-1805193377fb</serial>
Aug 01 15:26:07 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 15:26:07 user nova-compute[72201]: </disk>
Aug 01 15:26:07 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG nova.network.neutron [req-70e51bd3-9e05-4203-a7cc-cd0d33dcde86 req-adfb76d4-4176-4c2a-9902-a52eda33bb52 service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Updated VIF entry in instance network info cache for port a2128465-b362-4945-945b-c02795ea1705. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG nova.network.neutron [req-70e51bd3-9e05-4203-a7cc-cd0d33dcde86 req-adfb76d4-4176-4c2a-9902-a52eda33bb52 service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Updating instance_info_cache with network_info: [{"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-70e51bd3-9e05-4203-a7cc-cd0d33dcde86 req-adfb76d4-4176-4c2a-9902-a52eda33bb52 service nova] Releasing lock "refresh_cache-3e869e37-c921-48e3-b89a-946bbcc1a5ed" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690903567.6964388, 3e869e37-c921-48e3-b89a-946bbcc1a5ed => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3e869e37-c921-48e3-b89a-946bbcc1a5ed {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:26:07 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Successfully detached device vdb from instance 3e869e37-c921-48e3-b89a-946bbcc1a5ed from the live domain config.
Aug 01 15:26:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBjwYhqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:26:07 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:26:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3982b2ac-76d3-4e06-9633-6997bcf15303]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e53160c-3bee-421b-9b22-1d235a2e6286]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:26:07 user nova-compute[72201]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 (non-flash)
Aug 01 15:26:07 user nova-compute[72201]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)
Aug 01 15:26:07 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb (non-flash)
Aug 01 15:26:07 user nova-compute[72201]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 (non-flash)
Aug 01 15:26:07 user nova-compute[72201]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)
Aug 01 15:26:07 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc544305480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb'): ({'sdb'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Removing single pathed devices sdb {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d58832f-bf9d-4e57-95b1-b96fee8ba8e8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be65860-9e92-48d3-85b8-bcbd11025a1d]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Flushing IO for device /dev/sdb {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[25754ba7-d0aa-41b7-9618-b30b022db00e]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa3f486-1292-435c-b682-285ac186588d]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:26:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffa241c-992c-4052-8733-2c3235f572e3]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d510c19-f7ed-4c7d-9db2-6a08a24e54f9]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb, portal: 172.16.0.220,3260]
Aug 01 15:26:08 user nova-compute[72201]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb, portal: 172.16.0.220,3260] successful.
Aug 01 15:26:08 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7258d0-79fd-4a0d-a041-1805193377fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2cac5c-6e6d-42d0-967f-ed2476c75b86]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] <== disconnect_volume: return (425ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:08 user nova-compute[72201]: DEBUG nova.objects.instance [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lazy-loading 'flavor' on Instance uuid 3e869e37-c921-48e3-b89a-946bbcc1a5ed {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:26:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0b50db2b-18bd-4ab1-a237-cd0d9966fff0 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.192s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:10 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:26:10 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:26:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=7080MB free_disk=25.519943237304688GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance b64f1cfb-64f2-4493-8721-fc63fcd93bb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e2ca19ea-868c-40ad-a453-f6e348cfac15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 0f059ccc-f609-4cf3-a644-c3d1305ae26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 02d227b0-2b25-467f-a318-ab46aa391a31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 3e869e37-c921-48e3-b89a-946bbcc1a5ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance d4146775-a271-4822-84ec-e723ff09c386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f922b46e-baa5-4df4-8ffa-59addad85748 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 34d08de5-479b-4e90-aa8d-aefe3d8876bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 865b371c-59c5-4004-8469-cdc1e9327ecb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing inventories for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Acquiring lock "f922b46e-baa5-4df4-8ffa-59addad85748" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "f922b46e-baa5-4df4-8ffa-59addad85748" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Acquiring lock "f922b46e-baa5-4df4-8ffa-59addad85748-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "f922b46e-baa5-4df4-8ffa-59addad85748-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "f922b46e-baa5-4df4-8ffa-59addad85748-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating ProviderTree inventory for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 15:26:10 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating inventory in ProviderTree for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 15:26:10 user nova-compute[72201]: INFO nova.compute.manager [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Terminating instance
Aug 01 15:26:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing aggregate associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, aggregates: None {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing trait associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.267s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] There are 0 instances to clean {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG nova.compute.manager [req-a1ebc80c-eea4-46db-9d5d-8245e1d5b95b req-9125844c-1bd5-4704-878b-293ff57df49b service nova] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Received event network-vif-unplugged-ac4d508a-46a5-49ed-850f-5f43eb62ce45 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a1ebc80c-eea4-46db-9d5d-8245e1d5b95b req-9125844c-1bd5-4704-878b-293ff57df49b service nova] Acquiring lock "f922b46e-baa5-4df4-8ffa-59addad85748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a1ebc80c-eea4-46db-9d5d-8245e1d5b95b req-9125844c-1bd5-4704-878b-293ff57df49b service nova] Lock "f922b46e-baa5-4df4-8ffa-59addad85748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a1ebc80c-eea4-46db-9d5d-8245e1d5b95b req-9125844c-1bd5-4704-878b-293ff57df49b service nova] Lock "f922b46e-baa5-4df4-8ffa-59addad85748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG nova.compute.manager [req-a1ebc80c-eea4-46db-9d5d-8245e1d5b95b req-9125844c-1bd5-4704-878b-293ff57df49b service nova] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] No waiting events found dispatching network-vif-unplugged-ac4d508a-46a5-49ed-850f-5f43eb62ce45 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG nova.compute.manager [req-a1ebc80c-eea4-46db-9d5d-8245e1d5b95b req-9125844c-1bd5-4704-878b-293ff57df49b service nova] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Received event network-vif-unplugged-ac4d508a-46a5-49ed-850f-5f43eb62ce45 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:26:11 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Instance destroyed successfully.
Aug 01 15:26:11 user nova-compute[72201]: DEBUG nova.objects.instance [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lazy-loading 'resources' on Instance uuid f922b46e-baa5-4df4-8ffa-59addad85748 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-478710310',display_name='tempest-VolumesActionsTest-instance-478710310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-478710310',id=16,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19a697b16b874115aedf4e49d7b042b7',ramdisk_id='',reservation_id='r-j5456x8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-343582602',owner_user_name='tempest-VolumesActionsTest-343582602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:24:26Z,user_data=None,user_id='59ec55bc93f54ef6ad59d5624c19d26d',uuid=f922b46e-baa5-4df4-8ffa-59addad85748,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac4d508a-46a5-49ed-850f-5f43eb62ce45", "address": "fa:16:3e:07:11:70", "network": {"id": "95f92796-92dc-4732-a567-57b506b0d89b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403146244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a697b16b874115aedf4e49d7b042b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4d508a-46", "ovs_interfaceid": "ac4d508a-46a5-49ed-850f-5f43eb62ce45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Converting VIF {"id": "ac4d508a-46a5-49ed-850f-5f43eb62ce45", "address": "fa:16:3e:07:11:70", "network": {"id": "95f92796-92dc-4732-a567-57b506b0d89b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403146244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a697b16b874115aedf4e49d7b042b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4d508a-46", "ovs_interfaceid": "ac4d508a-46a5-49ed-850f-5f43eb62ce45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:11:70,bridge_name='br-int',has_traffic_filtering=True,id=ac4d508a-46a5-49ed-850f-5f43eb62ce45,network=Network(95f92796-92dc-4732-a567-57b506b0d89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4d508a-46') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG os_vif [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:11:70,bridge_name='br-int',has_traffic_filtering=True,id=ac4d508a-46a5-49ed-850f-5f43eb62ce45,network=Network(95f92796-92dc-4732-a567-57b506b0d89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4d508a-46') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac4d508a-46, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:11 user nova-compute[72201]: INFO os_vif [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:11:70,bridge_name='br-int',has_traffic_filtering=True,id=ac4d508a-46a5-49ed-850f-5f43eb62ce45,network=Network(95f92796-92dc-4732-a567-57b506b0d89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4d508a-46')
Aug 01 15:26:11 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Deleting instance files /opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748_del
Aug 01 15:26:11 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Deletion of /opt/stack/data/nova/instances/f922b46e-baa5-4df4-8ffa-59addad85748_del complete
Aug 01 15:26:11 user nova-compute[72201]: INFO nova.compute.manager [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 01 15:26:11 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:26:11 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:26:12 user nova-compute[72201]: WARNING nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Aug 01 15:26:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid b64f1cfb-64f2-4493-8721-fc63fcd93bb6 {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid e2ca19ea-868c-40ad-a453-f6e348cfac15 {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid 0f059ccc-f609-4cf3-a644-c3d1305ae26e {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid 02d227b0-2b25-467f-a318-ab46aa391a31 {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid 3e869e37-c921-48e3-b89a-946bbcc1a5ed {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid d4146775-a271-4822-84ec-e723ff09c386 {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid f922b46e-baa5-4df4-8ffa-59addad85748 {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid 34d08de5-479b-4e90-aa8d-aefe3d8876bf {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid 865b371c-59c5-4004-8469-cdc1e9327ecb {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "e2ca19ea-868c-40ad-a453-f6e348cfac15" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "02d227b0-2b25-467f-a318-ab46aa391a31" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "02d227b0-2b25-467f-a318-ab46aa391a31" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "d4146775-a271-4822-84ec-e723ff09c386" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "d4146775-a271-4822-84ec-e723ff09c386" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "f922b46e-baa5-4df4-8ffa-59addad85748" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "865b371c-59c5-4004-8469-cdc1e9327ecb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "865b371c-59c5-4004-8469-cdc1e9327ecb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-3d57e572-66d8-4a61-8e1e-06b5f12d1328 req-78acfce2-5030-4516-8e3c-7b38d14d3540 service nova] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Received event network-vif-deleted-ac4d508a-46a5-49ed-850f-5f43eb62ce45 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:26:12 user nova-compute[72201]: INFO nova.compute.manager [req-3d57e572-66d8-4a61-8e1e-06b5f12d1328 req-78acfce2-5030-4516-8e3c-7b38d14d3540 service nova] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Neutron deleted interface ac4d508a-46a5-49ed-850f-5f43eb62ce45; detaching it from the instance and deleting it from the info cache
Aug 01 15:26:12 user nova-compute[72201]: DEBUG nova.network.neutron [req-3d57e572-66d8-4a61-8e1e-06b5f12d1328 req-78acfce2-5030-4516-8e3c-7b38d14d3540 service nova] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "865b371c-59c5-4004-8469-cdc1e9327ecb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.137s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "d4146775-a271-4822-84ec-e723ff09c386" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.148s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "02d227b0-2b25-467f-a318-ab46aa391a31" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.151s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-3d57e572-66d8-4a61-8e1e-06b5f12d1328 req-78acfce2-5030-4516-8e3c-7b38d14d3540 service nova] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Detach interface failed, port_id=ac4d508a-46a5-49ed-850f-5f43eb62ce45, reason: Instance f922b46e-baa5-4df4-8ffa-59addad85748 could not be found. {{(pid=72201) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.162s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:12 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Took 0.79 seconds to deallocate network for instance.
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:13 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:26:13 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:26:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:13 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Deleted allocations for instance f922b46e-baa5-4df4-8ffa-59addad85748
Aug 01 15:26:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-057cad00-fbf2-4f01-b8f4-999c18fb1eed tempest-VolumesActionsTest-343582602 tempest-VolumesActionsTest-343582602-project-member] Lock "f922b46e-baa5-4df4-8ffa-59addad85748" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.465s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "f922b46e-baa5-4df4-8ffa-59addad85748" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.874s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:13 user nova-compute[72201]: INFO nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] During sync_power_state the instance has a pending task (deleting). Skip.
Aug 01 15:26:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "f922b46e-baa5-4df4-8ffa-59addad85748" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:13 user nova-compute[72201]: DEBUG nova.compute.manager [req-8b0283f8-6c3f-4dbe-b9a9-0a0e33080cbe req-a7b45877-cb3c-4c57-8f42-0a1fcc7b13d3 service nova] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Received event network-vif-plugged-ac4d508a-46a5-49ed-850f-5f43eb62ce45 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:26:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8b0283f8-6c3f-4dbe-b9a9-0a0e33080cbe req-a7b45877-cb3c-4c57-8f42-0a1fcc7b13d3 service nova] Acquiring lock "f922b46e-baa5-4df4-8ffa-59addad85748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8b0283f8-6c3f-4dbe-b9a9-0a0e33080cbe req-a7b45877-cb3c-4c57-8f42-0a1fcc7b13d3 service nova] Lock "f922b46e-baa5-4df4-8ffa-59addad85748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8b0283f8-6c3f-4dbe-b9a9-0a0e33080cbe req-a7b45877-cb3c-4c57-8f42-0a1fcc7b13d3 service nova] Lock "f922b46e-baa5-4df4-8ffa-59addad85748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:13 user nova-compute[72201]: DEBUG nova.compute.manager [req-8b0283f8-6c3f-4dbe-b9a9-0a0e33080cbe req-a7b45877-cb3c-4c57-8f42-0a1fcc7b13d3 service nova] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] No waiting events found dispatching network-vif-plugged-ac4d508a-46a5-49ed-850f-5f43eb62ce45 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:26:13 user nova-compute[72201]: WARNING nova.compute.manager [req-8b0283f8-6c3f-4dbe-b9a9-0a0e33080cbe req-a7b45877-cb3c-4c57-8f42-0a1fcc7b13d3 service nova] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Received unexpected event network-vif-plugged-ac4d508a-46a5-49ed-850f-5f43eb62ce45 for instance with vm_state deleted and task_state None.
Aug 01 15:26:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "14e890ca-dc2a-4d89-a497-d55805d0c42e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "14e890ca-dc2a-4d89-a497-d55805d0c42e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:26:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:26:21 user nova-compute[72201]: INFO nova.compute.claims [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Claim successful on node user
Aug 01 15:26:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:21 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:26:21 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:26:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:26:22 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:26:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG nova.policy [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c69154feccc402f9f0d2c0aafdbdea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8289b01d09f4cf4a35affa9e22fa7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:26:22 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Creating image(s)
Aug 01 15:26:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "/opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "/opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "/opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk 1073741824" returned: 0 in 0.050s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.131s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Cannot resize image /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lazy-loading 'migration_context' on Instance uuid 14e890ca-dc2a-4d89-a497-d55805d0c42e {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Ensure instance console log exists: /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:23 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Successfully created port: 9067d464-7696-450e-bc4e-6ac29aec6c8f {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:26:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:23 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Successfully updated port: 9067d464-7696-450e-bc4e-6ac29aec6c8f {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:26:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "refresh_cache-14e890ca-dc2a-4d89-a497-d55805d0c42e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:26:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquired lock "refresh_cache-14e890ca-dc2a-4d89-a497-d55805d0c42e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:26:23 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:26:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-15588c71-5f64-40e1-acfb-fa1d1e2d9e7a req-47d401bf-22ec-47d4-8f2f-296cc1097900 service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Received event network-changed-9067d464-7696-450e-bc4e-6ac29aec6c8f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:26:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-15588c71-5f64-40e1-acfb-fa1d1e2d9e7a req-47d401bf-22ec-47d4-8f2f-296cc1097900 service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Refreshing instance network info cache due to event network-changed-9067d464-7696-450e-bc4e-6ac29aec6c8f. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:26:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-15588c71-5f64-40e1-acfb-fa1d1e2d9e7a req-47d401bf-22ec-47d4-8f2f-296cc1097900 service nova] Acquiring lock "refresh_cache-14e890ca-dc2a-4d89-a497-d55805d0c42e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Updating instance_info_cache with network_info: [{"id": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "address": "fa:16:3e:af:9c:2f", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9067d464-76", "ovs_interfaceid": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Releasing lock "refresh_cache-14e890ca-dc2a-4d89-a497-d55805d0c42e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Instance network_info: |[{"id": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "address": "fa:16:3e:af:9c:2f", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9067d464-76", "ovs_interfaceid": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-15588c71-5f64-40e1-acfb-fa1d1e2d9e7a req-47d401bf-22ec-47d4-8f2f-296cc1097900 service nova] Acquired lock "refresh_cache-14e890ca-dc2a-4d89-a497-d55805d0c42e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.network.neutron [req-15588c71-5f64-40e1-acfb-fa1d1e2d9e7a req-47d401bf-22ec-47d4-8f2f-296cc1097900 service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Refreshing network info cache for port 9067d464-7696-450e-bc4e-6ac29aec6c8f {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Start _get_guest_xml network_info=[{"id": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "address": "fa:16:3e:af:9c:2f", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9067d464-76", "ovs_interfaceid": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:26:24 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:26:24 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:26:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1177886463',display_name='tempest-TestStampPattern-server-1177886463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1177886463',id=20,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4cjcpIrCgWJ8HeEyRLEl6J/NtkzbCoKCzwQr+AGaVQkH5fVBdRsWj/5tVNxW6Q1XUhgysYXiPaBl9ORZIAWs2VQxGxCYnIlCoMMGp8aO9DwuzAUIuYOHmCwk/FaqacxQ==',key_name='tempest-TestStampPattern-853407470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8289b01d09f4cf4a35affa9e22fa7fd',ramdisk_id='',reservation_id='r-lezk0efj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2066377363',owner_user_name='tempest-TestStampPattern-2066377363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:26:22Z,user_data=None,user_id='7c69154feccc402f9f0d2c0aafdbdea7',uuid=14e890ca-dc2a-4d89-a497-d55805d0c42e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "address": "fa:16:3e:af:9c:2f", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9067d464-76", "ovs_interfaceid": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Converting VIF {"id": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "address": "fa:16:3e:af:9c:2f", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9067d464-76", "ovs_interfaceid": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:9c:2f,bridge_name='br-int',has_traffic_filtering=True,id=9067d464-7696-450e-bc4e-6ac29aec6c8f,network=Network(302af7b4-2054-4148-870e-a04f75c18a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9067d464-76') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lazy-loading 'pci_devices' on Instance uuid 14e890ca-dc2a-4d89-a497-d55805d0c42e {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:26:24 user nova-compute[72201]:   <uuid>14e890ca-dc2a-4d89-a497-d55805d0c42e</uuid>
Aug 01 15:26:24 user nova-compute[72201]:   <name>instance-00000014</name>
Aug 01 15:26:24 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:26:24 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:26:24 user nova-compute[72201]:   <metadata>
Aug 01 15:26:24 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:26:24 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:26:24 user nova-compute[72201]:       <nova:name>tempest-TestStampPattern-server-1177886463</nova:name>
Aug 01 15:26:24 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:26:24</nova:creationTime>
Aug 01 15:26:24 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:26:24 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:26:24 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:26:24 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:26:24 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:26:24 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:26:24 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:26:24 user nova-compute[72201]:       <nova:owner>
Aug 01 15:26:24 user nova-compute[72201]:         <nova:user uuid="7c69154feccc402f9f0d2c0aafdbdea7">tempest-TestStampPattern-2066377363-project-member</nova:user>
Aug 01 15:26:24 user nova-compute[72201]:         <nova:project uuid="d8289b01d09f4cf4a35affa9e22fa7fd">tempest-TestStampPattern-2066377363</nova:project>
Aug 01 15:26:24 user nova-compute[72201]:       </nova:owner>
Aug 01 15:26:24 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:26:24 user nova-compute[72201]:       <nova:ports>
Aug 01 15:26:24 user nova-compute[72201]:         <nova:port uuid="9067d464-7696-450e-bc4e-6ac29aec6c8f">
Aug 01 15:26:24 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 15:26:24 user nova-compute[72201]:         </nova:port>
Aug 01 15:26:24 user nova-compute[72201]:       </nova:ports>
Aug 01 15:26:24 user nova-compute[72201]:     </nova:instance>
Aug 01 15:26:24 user nova-compute[72201]:   </metadata>
Aug 01 15:26:24 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:26:24 user nova-compute[72201]:     <system>
Aug 01 15:26:24 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:26:24 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:26:24 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:26:24 user nova-compute[72201]:       <entry name="serial">14e890ca-dc2a-4d89-a497-d55805d0c42e</entry>
Aug 01 15:26:24 user nova-compute[72201]:       <entry name="uuid">14e890ca-dc2a-4d89-a497-d55805d0c42e</entry>
Aug 01 15:26:24 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:26:24 user nova-compute[72201]:     </system>
Aug 01 15:26:24 user nova-compute[72201]:   </sysinfo>
Aug 01 15:26:24 user nova-compute[72201]:   <os>
Aug 01 15:26:24 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:26:24 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:26:24 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:26:24 user nova-compute[72201]:   </os>
Aug 01 15:26:24 user nova-compute[72201]:   <features>
Aug 01 15:26:24 user nova-compute[72201]:     <acpi/>
Aug 01 15:26:24 user nova-compute[72201]:     <apic/>
Aug 01 15:26:24 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:26:24 user nova-compute[72201]:   </features>
Aug 01 15:26:24 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:26:24 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:26:24 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:26:24 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:26:24 user nova-compute[72201]:   </clock>
Aug 01 15:26:24 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:26:24 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:26:24 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:26:24 user nova-compute[72201]:   </cpu>
Aug 01 15:26:24 user nova-compute[72201]:   <devices>
Aug 01 15:26:24 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:26:24 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:26:24 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk"/>
Aug 01 15:26:24 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:26:24 user nova-compute[72201]:     </disk>
Aug 01 15:26:24 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:26:24 user nova-compute[72201]:       <mac address="fa:16:3e:af:9c:2f"/>
Aug 01 15:26:24 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:26:24 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:26:24 user nova-compute[72201]:       <target dev="tap9067d464-76"/>
Aug 01 15:26:24 user nova-compute[72201]:     </interface>
Aug 01 15:26:24 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:26:24 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/console.log" append="off"/>
Aug 01 15:26:24 user nova-compute[72201]:     </serial>
Aug 01 15:26:24 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:26:24 user nova-compute[72201]:     <video>
Aug 01 15:26:24 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:26:24 user nova-compute[72201]:     </video>
Aug 01 15:26:24 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:26:24 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:26:24 user nova-compute[72201]:     </rng>
Aug 01 15:26:24 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:26:24 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:26:24 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:26:24 user nova-compute[72201]:     </memballoon>
Aug 01 15:26:24 user nova-compute[72201]:   </devices>
Aug 01 15:26:24 user nova-compute[72201]: </domain>
Aug 01 15:26:24 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:26:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1177886463',display_name='tempest-TestStampPattern-server-1177886463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1177886463',id=20,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4cjcpIrCgWJ8HeEyRLEl6J/NtkzbCoKCzwQr+AGaVQkH5fVBdRsWj/5tVNxW6Q1XUhgysYXiPaBl9ORZIAWs2VQxGxCYnIlCoMMGp8aO9DwuzAUIuYOHmCwk/FaqacxQ==',key_name='tempest-TestStampPattern-853407470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8289b01d09f4cf4a35affa9e22fa7fd',ramdisk_id='',reservation_id='r-lezk0efj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2066377363',owner_user_name='tempest-TestStampPattern-2066377363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:26:22Z,user_data=None,user_id='7c69154feccc402f9f0d2c0aafdbdea7',uuid=14e890ca-dc2a-4d89-a497-d55805d0c42e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "address": "fa:16:3e:af:9c:2f", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9067d464-76", "ovs_interfaceid": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Converting VIF {"id": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "address": "fa:16:3e:af:9c:2f", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9067d464-76", "ovs_interfaceid": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:9c:2f,bridge_name='br-int',has_traffic_filtering=True,id=9067d464-7696-450e-bc4e-6ac29aec6c8f,network=Network(302af7b4-2054-4148-870e-a04f75c18a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9067d464-76') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG os_vif [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:9c:2f,bridge_name='br-int',has_traffic_filtering=True,id=9067d464-7696-450e-bc4e-6ac29aec6c8f,network=Network(302af7b4-2054-4148-870e-a04f75c18a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9067d464-76') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9067d464-76, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9067d464-76, col_values=(('external_ids', {'iface-id': '9067d464-7696-450e-bc4e-6ac29aec6c8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:9c:2f', 'vm-uuid': '14e890ca-dc2a-4d89-a497-d55805d0c42e'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:24 user nova-compute[72201]: INFO os_vif [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:9c:2f,bridge_name='br-int',has_traffic_filtering=True,id=9067d464-7696-450e-bc4e-6ac29aec6c8f,network=Network(302af7b4-2054-4148-870e-a04f75c18a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9067d464-76')
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] No VIF found with MAC fa:16:3e:af:9c:2f, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.network.neutron [req-15588c71-5f64-40e1-acfb-fa1d1e2d9e7a req-47d401bf-22ec-47d4-8f2f-296cc1097900 service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Updated VIF entry in instance network info cache for port 9067d464-7696-450e-bc4e-6ac29aec6c8f. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG nova.network.neutron [req-15588c71-5f64-40e1-acfb-fa1d1e2d9e7a req-47d401bf-22ec-47d4-8f2f-296cc1097900 service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Updating instance_info_cache with network_info: [{"id": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "address": "fa:16:3e:af:9c:2f", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9067d464-76", "ovs_interfaceid": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:26:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-15588c71-5f64-40e1-acfb-fa1d1e2d9e7a req-47d401bf-22ec-47d4-8f2f-296cc1097900 service nova] Releasing lock "refresh_cache-14e890ca-dc2a-4d89-a497-d55805d0c42e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:26:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:26 user nova-compute[72201]: DEBUG nova.compute.manager [req-312c886d-a16b-40d2-b4ba-9bdb700c0ec7 req-57d74621-8567-4129-b8c5-3e93655e3201 service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Received event network-vif-plugged-9067d464-7696-450e-bc4e-6ac29aec6c8f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:26:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-312c886d-a16b-40d2-b4ba-9bdb700c0ec7 req-57d74621-8567-4129-b8c5-3e93655e3201 service nova] Acquiring lock "14e890ca-dc2a-4d89-a497-d55805d0c42e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-312c886d-a16b-40d2-b4ba-9bdb700c0ec7 req-57d74621-8567-4129-b8c5-3e93655e3201 service nova] Lock "14e890ca-dc2a-4d89-a497-d55805d0c42e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-312c886d-a16b-40d2-b4ba-9bdb700c0ec7 req-57d74621-8567-4129-b8c5-3e93655e3201 service nova] Lock "14e890ca-dc2a-4d89-a497-d55805d0c42e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:26 user nova-compute[72201]: DEBUG nova.compute.manager [req-312c886d-a16b-40d2-b4ba-9bdb700c0ec7 req-57d74621-8567-4129-b8c5-3e93655e3201 service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] No waiting events found dispatching network-vif-plugged-9067d464-7696-450e-bc4e-6ac29aec6c8f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:26:26 user nova-compute[72201]: WARNING nova.compute.manager [req-312c886d-a16b-40d2-b4ba-9bdb700c0ec7 req-57d74621-8567-4129-b8c5-3e93655e3201 service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Received unexpected event network-vif-plugged-9067d464-7696-450e-bc4e-6ac29aec6c8f for instance with vm_state building and task_state spawning.
Aug 01 15:26:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:26 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903571.8132994, f922b46e-baa5-4df4-8ffa-59addad85748 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:26:26 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] VM Stopped (Lifecycle Event)
Aug 01 15:26:26 user nova-compute[72201]: DEBUG nova.compute.manager [None req-356925fb-ed69-42df-a207-afcb8f31f45f None None] [instance: f922b46e-baa5-4df4-8ffa-59addad85748] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:26:28 user nova-compute[72201]: DEBUG nova.compute.manager [req-1759b8c4-b1a0-48b6-91a5-c62f9eb2cfca req-542e34a1-53a8-4d2d-9f85-bfe6d405368a service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Received event network-vif-plugged-9067d464-7696-450e-bc4e-6ac29aec6c8f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:26:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1759b8c4-b1a0-48b6-91a5-c62f9eb2cfca req-542e34a1-53a8-4d2d-9f85-bfe6d405368a service nova] Acquiring lock "14e890ca-dc2a-4d89-a497-d55805d0c42e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1759b8c4-b1a0-48b6-91a5-c62f9eb2cfca req-542e34a1-53a8-4d2d-9f85-bfe6d405368a service nova] Lock "14e890ca-dc2a-4d89-a497-d55805d0c42e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1759b8c4-b1a0-48b6-91a5-c62f9eb2cfca req-542e34a1-53a8-4d2d-9f85-bfe6d405368a service nova] Lock "14e890ca-dc2a-4d89-a497-d55805d0c42e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:28 user nova-compute[72201]: DEBUG nova.compute.manager [req-1759b8c4-b1a0-48b6-91a5-c62f9eb2cfca req-542e34a1-53a8-4d2d-9f85-bfe6d405368a service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] No waiting events found dispatching network-vif-plugged-9067d464-7696-450e-bc4e-6ac29aec6c8f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:26:28 user nova-compute[72201]: WARNING nova.compute.manager [req-1759b8c4-b1a0-48b6-91a5-c62f9eb2cfca req-542e34a1-53a8-4d2d-9f85-bfe6d405368a service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Received unexpected event network-vif-plugged-9067d464-7696-450e-bc4e-6ac29aec6c8f for instance with vm_state building and task_state spawning.
Aug 01 15:26:28 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903588.2161326, 14e890ca-dc2a-4d89-a497-d55805d0c42e => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:26:28 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] VM Resumed (Lifecycle Event)
Aug 01 15:26:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:26:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:26:28 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Instance spawned successfully.
Aug 01 15:26:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:26:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:26:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:26:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:26:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:26:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:26:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:26:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:26:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:26:28 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:26:28 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903588.2177188, 14e890ca-dc2a-4d89-a497-d55805d0c42e => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:26:28 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] VM Started (Lifecycle Event)
Aug 01 15:26:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:26:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:26:28 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:26:28 user nova-compute[72201]: INFO nova.compute.manager [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Took 6.14 seconds to spawn the instance on the hypervisor.
Aug 01 15:26:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:26:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:28 user nova-compute[72201]: INFO nova.compute.manager [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Took 6.89 seconds to build instance.
Aug 01 15:26:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8c78db5-80de-4ef8-bc42-9a34818e9a24 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "14e890ca-dc2a-4d89-a497-d55805d0c42e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.991s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "02d227b0-2b25-467f-a318-ab46aa391a31" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "02d227b0-2b25-467f-a318-ab46aa391a31" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "02d227b0-2b25-467f-a318-ab46aa391a31-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "02d227b0-2b25-467f-a318-ab46aa391a31-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "02d227b0-2b25-467f-a318-ab46aa391a31-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:38 user nova-compute[72201]: INFO nova.compute.manager [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Terminating instance
Aug 01 15:26:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:26:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-1fe0d054-8cc3-4e26-bad4-4ae74766c288 req-d2350ead-551e-4f13-9764-ac49a497bf47 service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Received event network-vif-unplugged-4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:26:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1fe0d054-8cc3-4e26-bad4-4ae74766c288 req-d2350ead-551e-4f13-9764-ac49a497bf47 service nova] Acquiring lock "02d227b0-2b25-467f-a318-ab46aa391a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1fe0d054-8cc3-4e26-bad4-4ae74766c288 req-d2350ead-551e-4f13-9764-ac49a497bf47 service nova] Lock "02d227b0-2b25-467f-a318-ab46aa391a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1fe0d054-8cc3-4e26-bad4-4ae74766c288 req-d2350ead-551e-4f13-9764-ac49a497bf47 service nova] Lock "02d227b0-2b25-467f-a318-ab46aa391a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-1fe0d054-8cc3-4e26-bad4-4ae74766c288 req-d2350ead-551e-4f13-9764-ac49a497bf47 service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] No waiting events found dispatching network-vif-unplugged-4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:26:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-1fe0d054-8cc3-4e26-bad4-4ae74766c288 req-d2350ead-551e-4f13-9764-ac49a497bf47 service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Received event network-vif-unplugged-4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:26:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:39 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Instance destroyed successfully.
Aug 01 15:26:39 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lazy-loading 'resources' on Instance uuid 02d227b0-2b25-467f-a318-ab46aa391a31 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:26:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:20:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-158991302',display_name='tempest-VolumesAdminNegativeTest-server-158991302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-158991302',id=6,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAZ1nQBQA6WVs89gLbsde1Wvri3fBIr1QgbpNmYheEze2DzNk/okxjbjhBR1UiYTsR1KXKyp9qEI1pUSaphVsxea7ITU2HdAT7gdbKf47T22gt1n5pqEMjoAc8z4SQtXg==',key_name='tempest-keypair-809009234',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:20:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1cae4f1529be4369af543b05169568cc',ramdisk_id='',reservation_id='r-mti5puey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1786819113',owner_user_name='tempest-VolumesAdminNegativeTest-1786819113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:20:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c3e96bf4fb645898f1fc7987f4f0ccc',uuid=02d227b0-2b25-467f-a318-ab46aa391a31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "address": "fa:16:3e:dc:2e:04", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd9ef98-ad", "ovs_interfaceid": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:26:39 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Converting VIF {"id": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "address": "fa:16:3e:dc:2e:04", "network": {"id": "a3eccf4e-95d7-49ef-a540-4ce7e9a490b6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1727232010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cae4f1529be4369af543b05169568cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd9ef98-ad", "ovs_interfaceid": "4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:26:39 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:2e:04,bridge_name='br-int',has_traffic_filtering=True,id=4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9,network=Network(a3eccf4e-95d7-49ef-a540-4ce7e9a490b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bd9ef98-ad') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:26:39 user nova-compute[72201]: DEBUG os_vif [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:2e:04,bridge_name='br-int',has_traffic_filtering=True,id=4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9,network=Network(a3eccf4e-95d7-49ef-a540-4ce7e9a490b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bd9ef98-ad') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:26:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4bd9ef98-ad, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:26:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:39 user nova-compute[72201]: INFO os_vif [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:2e:04,bridge_name='br-int',has_traffic_filtering=True,id=4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9,network=Network(a3eccf4e-95d7-49ef-a540-4ce7e9a490b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bd9ef98-ad')
Aug 01 15:26:39 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Deleting instance files /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31_del
Aug 01 15:26:39 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Deletion of /opt/stack/data/nova/instances/02d227b0-2b25-467f-a318-ab46aa391a31_del complete
Aug 01 15:26:39 user nova-compute[72201]: INFO nova.compute.manager [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 01 15:26:39 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:26:39 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:26:39 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:26:40 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:26:40 user nova-compute[72201]: DEBUG nova.compute.manager [req-9a08ff7e-bb80-4731-b7a0-1d7e7766d2b1 req-68f3f2cf-ee02-4b43-9784-42943ee24583 service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Received event network-vif-deleted-4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:26:40 user nova-compute[72201]: INFO nova.compute.manager [req-9a08ff7e-bb80-4731-b7a0-1d7e7766d2b1 req-68f3f2cf-ee02-4b43-9784-42943ee24583 service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Neutron deleted interface 4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9; detaching it from the instance and deleting it from the info cache
Aug 01 15:26:40 user nova-compute[72201]: DEBUG nova.network.neutron [req-9a08ff7e-bb80-4731-b7a0-1d7e7766d2b1 req-68f3f2cf-ee02-4b43-9784-42943ee24583 service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:26:40 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Took 1.05 seconds to deallocate network for instance.
Aug 01 15:26:40 user nova-compute[72201]: DEBUG nova.compute.manager [req-9a08ff7e-bb80-4731-b7a0-1d7e7766d2b1 req-68f3f2cf-ee02-4b43-9784-42943ee24583 service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Detach interface failed, port_id=4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9, reason: Instance 02d227b0-2b25-467f-a318-ab46aa391a31 could not be found. {{(pid=72201) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 15:26:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-0423ffe7-ad49-4988-98c6-db8758b753af req-5cb92484-9446-43d0-b2f7-f85108199f82 service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Received event network-vif-plugged-4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:26:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0423ffe7-ad49-4988-98c6-db8758b753af req-5cb92484-9446-43d0-b2f7-f85108199f82 service nova] Acquiring lock "02d227b0-2b25-467f-a318-ab46aa391a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0423ffe7-ad49-4988-98c6-db8758b753af req-5cb92484-9446-43d0-b2f7-f85108199f82 service nova] Lock "02d227b0-2b25-467f-a318-ab46aa391a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0423ffe7-ad49-4988-98c6-db8758b753af req-5cb92484-9446-43d0-b2f7-f85108199f82 service nova] Lock "02d227b0-2b25-467f-a318-ab46aa391a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-0423ffe7-ad49-4988-98c6-db8758b753af req-5cb92484-9446-43d0-b2f7-f85108199f82 service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] No waiting events found dispatching network-vif-plugged-4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:26:41 user nova-compute[72201]: WARNING nova.compute.manager [req-0423ffe7-ad49-4988-98c6-db8758b753af req-5cb92484-9446-43d0-b2f7-f85108199f82 service nova] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Received unexpected event network-vif-plugged-4bd9ef98-ad10-4534-ac0c-aa6fbf3701b9 for instance with vm_state deleted and task_state None.
Aug 01 15:26:41 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:26:41 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:26:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:41 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Deleted allocations for instance 02d227b0-2b25-467f-a318-ab46aa391a31
Aug 01 15:26:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a66655e7-10a9-491a-9bf2-7a5d69de2764 tempest-VolumesAdminNegativeTest-1786819113 tempest-VolumesAdminNegativeTest-1786819113-project-member] Lock "02d227b0-2b25-467f-a318-ab46aa391a31" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.913s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:50 user nova-compute[72201]: INFO nova.compute.manager [None req-c8790bc8-36d7-4561-bbf4-fc6dda3d41fe tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Unrescuing
Aug 01 15:26:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c8790bc8-36d7-4561-bbf4-fc6dda3d41fe tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "refresh_cache-b64f1cfb-64f2-4493-8721-fc63fcd93bb6" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:26:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c8790bc8-36d7-4561-bbf4-fc6dda3d41fe tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquired lock "refresh_cache-b64f1cfb-64f2-4493-8721-fc63fcd93bb6" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:26:50 user nova-compute[72201]: DEBUG nova.network.neutron [None req-c8790bc8-36d7-4561-bbf4-fc6dda3d41fe tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:26:51 user nova-compute[72201]: DEBUG nova.network.neutron [None req-c8790bc8-36d7-4561-bbf4-fc6dda3d41fe tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Updating instance_info_cache with network_info: [{"id": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "address": "fa:16:3e:5d:24:e6", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8b84b-6b", "ovs_interfaceid": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:26:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c8790bc8-36d7-4561-bbf4-fc6dda3d41fe tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Releasing lock "refresh_cache-b64f1cfb-64f2-4493-8721-fc63fcd93bb6" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:26:51 user nova-compute[72201]: DEBUG nova.objects.instance [None req-c8790bc8-36d7-4561-bbf4-fc6dda3d41fe tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'flavor' on Instance uuid b64f1cfb-64f2-4493-8721-fc63fcd93bb6 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:26:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:51 user nova-compute[72201]: DEBUG nova.compute.manager [req-6cecac58-d1f6-4414-80e4-abc8d3cf0c12 req-152b1bdd-efb7-4689-8245-4000cf8b843e service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received event network-vif-unplugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:26:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6cecac58-d1f6-4414-80e4-abc8d3cf0c12 req-152b1bdd-efb7-4689-8245-4000cf8b843e service nova] Acquiring lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6cecac58-d1f6-4414-80e4-abc8d3cf0c12 req-152b1bdd-efb7-4689-8245-4000cf8b843e service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6cecac58-d1f6-4414-80e4-abc8d3cf0c12 req-152b1bdd-efb7-4689-8245-4000cf8b843e service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:51 user nova-compute[72201]: DEBUG nova.compute.manager [req-6cecac58-d1f6-4414-80e4-abc8d3cf0c12 req-152b1bdd-efb7-4689-8245-4000cf8b843e service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] No waiting events found dispatching network-vif-unplugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:26:51 user nova-compute[72201]: WARNING nova.compute.manager [req-6cecac58-d1f6-4414-80e4-abc8d3cf0c12 req-152b1bdd-efb7-4689-8245-4000cf8b843e service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received unexpected event network-vif-unplugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 for instance with vm_state rescued and task_state unrescuing.
Aug 01 15:26:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:52 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Instance destroyed successfully.
Aug 01 15:26:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:53 user nova-compute[72201]: DEBUG nova.compute.manager [req-fd511ef9-6bae-42b5-89c0-9c5374d4231c req-c01adb02-881e-42a4-8ff9-5c30e8a12bc5 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received event network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:26:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-fd511ef9-6bae-42b5-89c0-9c5374d4231c req-c01adb02-881e-42a4-8ff9-5c30e8a12bc5 service nova] Acquiring lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-fd511ef9-6bae-42b5-89c0-9c5374d4231c req-c01adb02-881e-42a4-8ff9-5c30e8a12bc5 service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-fd511ef9-6bae-42b5-89c0-9c5374d4231c req-c01adb02-881e-42a4-8ff9-5c30e8a12bc5 service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:53 user nova-compute[72201]: DEBUG nova.compute.manager [req-fd511ef9-6bae-42b5-89c0-9c5374d4231c req-c01adb02-881e-42a4-8ff9-5c30e8a12bc5 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] No waiting events found dispatching network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:26:53 user nova-compute[72201]: WARNING nova.compute.manager [req-fd511ef9-6bae-42b5-89c0-9c5374d4231c req-c01adb02-881e-42a4-8ff9-5c30e8a12bc5 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received unexpected event network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 for instance with vm_state rescued and task_state unrescuing.
Aug 01 15:26:53 user nova-compute[72201]: DEBUG nova.compute.manager [req-fd511ef9-6bae-42b5-89c0-9c5374d4231c req-c01adb02-881e-42a4-8ff9-5c30e8a12bc5 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received event network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:26:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-fd511ef9-6bae-42b5-89c0-9c5374d4231c req-c01adb02-881e-42a4-8ff9-5c30e8a12bc5 service nova] Acquiring lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-fd511ef9-6bae-42b5-89c0-9c5374d4231c req-c01adb02-881e-42a4-8ff9-5c30e8a12bc5 service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-fd511ef9-6bae-42b5-89c0-9c5374d4231c req-c01adb02-881e-42a4-8ff9-5c30e8a12bc5 service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:53 user nova-compute[72201]: DEBUG nova.compute.manager [req-fd511ef9-6bae-42b5-89c0-9c5374d4231c req-c01adb02-881e-42a4-8ff9-5c30e8a12bc5 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] No waiting events found dispatching network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:26:53 user nova-compute[72201]: WARNING nova.compute.manager [req-fd511ef9-6bae-42b5-89c0-9c5374d4231c req-c01adb02-881e-42a4-8ff9-5c30e8a12bc5 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received unexpected event network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 for instance with vm_state rescued and task_state unrescuing.
Aug 01 15:26:54 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903599.5714824, 02d227b0-2b25-467f-a318-ab46aa391a31 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:26:54 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] VM Stopped (Lifecycle Event)
Aug 01 15:26:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6828111f-a2af-4451-a40f-7cc874b9d32d None None] [instance: 02d227b0-2b25-467f-a318-ab46aa391a31] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:26:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:55 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Removed pending event for b64f1cfb-64f2-4493-8721-fc63fcd93bb6 due to event {{(pid=72201) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 15:26:55 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903615.7933369, b64f1cfb-64f2-4493-8721-fc63fcd93bb6 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:26:55 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] VM Resumed (Lifecycle Event)
Aug 01 15:26:55 user nova-compute[72201]: DEBUG nova.compute.manager [None req-c8790bc8-36d7-4561-bbf4-fc6dda3d41fe tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:26:55 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:26:55 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:26:55 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 15:26:55 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903615.795987, b64f1cfb-64f2-4493-8721-fc63fcd93bb6 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:26:55 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] VM Started (Lifecycle Event)
Aug 01 15:26:55 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:26:55 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:26:55 user nova-compute[72201]: DEBUG nova.compute.manager [req-7a4e5804-2878-425e-ba09-8dab06f4f886 req-00631edf-679a-40be-bc67-2c5ae26ba238 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received event network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:26:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7a4e5804-2878-425e-ba09-8dab06f4f886 req-00631edf-679a-40be-bc67-2c5ae26ba238 service nova] Acquiring lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:26:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7a4e5804-2878-425e-ba09-8dab06f4f886 req-00631edf-679a-40be-bc67-2c5ae26ba238 service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:26:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7a4e5804-2878-425e-ba09-8dab06f4f886 req-00631edf-679a-40be-bc67-2c5ae26ba238 service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:26:55 user nova-compute[72201]: DEBUG nova.compute.manager [req-7a4e5804-2878-425e-ba09-8dab06f4f886 req-00631edf-679a-40be-bc67-2c5ae26ba238 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] No waiting events found dispatching network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:26:55 user nova-compute[72201]: WARNING nova.compute.manager [req-7a4e5804-2878-425e-ba09-8dab06f4f886 req-00631edf-679a-40be-bc67-2c5ae26ba238 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received unexpected event network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 for instance with vm_state active and task_state None.
Aug 01 15:26:56 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:26:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:26:59 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:26:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:00 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:27:00 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:27:00 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 15:27:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-b64f1cfb-64f2-4493-8721-fc63fcd93bb6" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:27:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-b64f1cfb-64f2-4493-8721-fc63fcd93bb6" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:27:00 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:27:00 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid b64f1cfb-64f2-4493-8721-fc63fcd93bb6 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:27:01 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Updating instance_info_cache with network_info: [{"id": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "address": "fa:16:3e:5d:24:e6", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8b84b-6b", "ovs_interfaceid": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:27:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-b64f1cfb-64f2-4493-8721-fc63fcd93bb6" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:27:01 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:27:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:04 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:27:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:05 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:27:05 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:27:05 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:27:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "e2ca19ea-868c-40ad-a453-f6e348cfac15" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:05 user nova-compute[72201]: INFO nova.compute.manager [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Detaching volume 1d89fc35-7179-4837-9234-74e82df62143
Aug 01 15:27:05 user nova-compute[72201]: INFO nova.virt.block_device [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Attempting to driver detach volume 1d89fc35-7179-4837-9234-74e82df62143 from mountpoint /dev/vdb
Aug 01 15:27:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Attempting to detach device vdb from instance e2ca19ea-868c-40ad-a453-f6e348cfac15 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:27:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:27:05 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:27:05 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 15:27:05 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:27:05 user nova-compute[72201]:   <serial>1d89fc35-7179-4837-9234-74e82df62143</serial>
Aug 01 15:27:05 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 15:27:05 user nova-compute[72201]: </disk>
Aug 01 15:27:05 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:27:05 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Successfully detached device vdb from instance e2ca19ea-868c-40ad-a453-f6e348cfac15 from the persistent domain config.
Aug 01 15:27:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e2ca19ea-868c-40ad-a453-f6e348cfac15 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:27:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:27:05 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:27:05 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 15:27:05 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:27:05 user nova-compute[72201]:   <serial>1d89fc35-7179-4837-9234-74e82df62143</serial>
Aug 01 15:27:05 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 15:27:05 user nova-compute[72201]: </disk>
Aug 01 15:27:05 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:06 user nova-compute[72201]: INFO nova.compute.manager [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Terminating instance
Aug 01 15:27:06 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690903626.4602757, e2ca19ea-868c-40ad-a453-f6e348cfac15 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e2ca19ea-868c-40ad-a453-f6e348cfac15 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:27:06 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Successfully detached device vdb from instance e2ca19ea-868c-40ad-a453-f6e348cfac15 from the live domain config.
Aug 01 15:27:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDAPtnGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:27:06 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:27:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d48ecb-b009-4e99-bc10-a2ffc4d6f7d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[858a7c4a-8994-4887-b32e-993fe76b6d44]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 (non-flash)
Aug 01 15:27:06 user nova-compute[72201]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)
Aug 01 15:27:06 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 (non-flash)
Aug 01 15:27:06 user nova-compute[72201]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)
Aug 01 15:27:06 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc549d51630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143'): ({'sdc'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Removing single pathed devices sdc {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba1537e-6247-4929-a398-fba2026f968d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6442eafe-0546-4e2e-9193-c776c1ddcf52]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Flushing IO for device /dev/sdc {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-8b446a9a-04ce-4d36-8d63-b9c7de5d67ef req-c11906d7-3501-4999-b974-49606afef89c service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received event network-vif-unplugged-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8b446a9a-04ce-4d36-8d63-b9c7de5d67ef req-c11906d7-3501-4999-b974-49606afef89c service nova] Acquiring lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8b446a9a-04ce-4d36-8d63-b9c7de5d67ef req-c11906d7-3501-4999-b974-49606afef89c service nova] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8b446a9a-04ce-4d36-8d63-b9c7de5d67ef req-c11906d7-3501-4999-b974-49606afef89c service nova] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-8b446a9a-04ce-4d36-8d63-b9c7de5d67ef req-c11906d7-3501-4999-b974-49606afef89c service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] No waiting events found dispatching network-vif-unplugged-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-8b446a9a-04ce-4d36-8d63-b9c7de5d67ef req-c11906d7-3501-4999-b974-49606afef89c service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received event network-vif-unplugged-a2128465-b362-4945-945b-c02795ea1705 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5711d1ad-6534-4ac6-be8a-52974b4ca127]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[31202175-0d4a-4107-91db-2dae1a3d378c]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[16850345-4a40-4190-a705-7b62a587ba36]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fd5914-9d81-47dd-be5b-1e27cf5f5231]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143, portal: 172.16.0.220,3260]
Aug 01 15:27:06 user nova-compute[72201]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143, portal: 172.16.0.220,3260] successful.
Aug 01 15:27:06 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d89fc35-7179-4837-9234-74e82df62143 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaccb71-53ef-40ac-9645-983e12b72820]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] <== disconnect_volume: return (345ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:27:06 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Instance destroyed successfully.
Aug 01 15:27:06 user nova-compute[72201]: DEBUG nova.objects.instance [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lazy-loading 'resources' on Instance uuid 3e869e37-c921-48e3-b89a-946bbcc1a5ed {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1436254959',display_name='tempest-TestMinimumBasicScenario-server-1436254959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1436254959',id=13,image_ref='01e1b9e2-1afb-49c6-88ca-e8c8a2144418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXoI7zVJBdB0lr76+ibKx3rQTpkh4ZH+yifRw2rO8nKGcImkfspfIluEMinD7nXk08i9/YN+XHFBkn4ywU/yP/bAjF2s6xHFjvo2R0jo8pEhg87HKQHG3uQq9h9kIwiKA==',key_name='tempest-TestMinimumBasicScenario-2124161389',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:21:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5e1f59585b44545ae3ec0cdfa480fab',ramdisk_id='',reservation_id='r-5r163mpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='01e1b9e2-1afb-49c6-88ca-e8c8a2144418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1524896067',owner_user_name='tempest-TestMinimumBasicScenario-1524896067-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:24:21Z,user_data=None,user_id='2c5267b768cf46958384d9ad4c585f82',uuid=3e869e37-c921-48e3-b89a-946bbcc1a5ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Converting VIF {"id": "a2128465-b362-4945-945b-c02795ea1705", "address": "fa:16:3e:c4:7c:00", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2128465-b3", "ovs_interfaceid": "a2128465-b362-4945-945b-c02795ea1705", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=a2128465-b362-4945-945b-c02795ea1705,network=Network(d1dbf82c-df93-48ae-b118-278943635ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2128465-b3') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG os_vif [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=a2128465-b362-4945-945b-c02795ea1705,network=Network(d1dbf82c-df93-48ae-b118-278943635ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2128465-b3') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2128465-b3, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:27:06 user nova-compute[72201]: INFO os_vif [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=a2128465-b362-4945-945b-c02795ea1705,network=Network(d1dbf82c-df93-48ae-b118-278943635ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2128465-b3')
Aug 01 15:27:06 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Deleting instance files /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed_del
Aug 01 15:27:07 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Deletion of /opt/stack/data/nova/instances/3e869e37-c921-48e3-b89a-946bbcc1a5ed_del complete
Aug 01 15:27:07 user nova-compute[72201]: INFO nova.compute.manager [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 01 15:27:07 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG nova.objects.instance [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lazy-loading 'flavor' on Instance uuid e2ca19ea-868c-40ad-a453-f6e348cfac15 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:27:07 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Took 0.68 seconds to deallocate network for instance.
Aug 01 15:27:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-a729ab4e-3566-4674-9907-9b46841aac92 req-9a9d8936-0695-4a48-b8c0-c45e321b7684 service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received event network-vif-deleted-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:27:07 user nova-compute[72201]: INFO nova.compute.manager [req-a729ab4e-3566-4674-9907-9b46841aac92 req-9a9d8936-0695-4a48-b8c0-c45e321b7684 service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Neutron deleted interface a2128465-b362-4945-945b-c02795ea1705; detaching it from the instance and deleting it from the info cache
Aug 01 15:27:07 user nova-compute[72201]: DEBUG nova.network.neutron [req-a729ab4e-3566-4674-9907-9b46841aac92 req-9a9d8936-0695-4a48-b8c0-c45e321b7684 service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0f3c96dd-94e4-44ce-87ad-588116473615 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.078s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-a729ab4e-3566-4674-9907-9b46841aac92 req-9a9d8936-0695-4a48-b8c0-c45e321b7684 service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Detach interface failed, port_id=a2128465-b362-4945-945b-c02795ea1705, reason: Instance 3e869e37-c921-48e3-b89a-946bbcc1a5ed could not be found. {{(pid=72201) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:08 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:27:08 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:27:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.463s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:08 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Deleted allocations for instance 3e869e37-c921-48e3-b89a-946bbcc1a5ed
Aug 01 15:27:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4014f991-b8fa-457d-b11a-0316559e17b4 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.343s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:08 user nova-compute[72201]: DEBUG nova.compute.manager [req-46047792-4b67-46ff-aa60-f2e42853ad85 req-efa3563b-fc09-4ab6-a5bf-e394c6ab74bc service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received event network-vif-plugged-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:27:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-46047792-4b67-46ff-aa60-f2e42853ad85 req-efa3563b-fc09-4ab6-a5bf-e394c6ab74bc service nova] Acquiring lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-46047792-4b67-46ff-aa60-f2e42853ad85 req-efa3563b-fc09-4ab6-a5bf-e394c6ab74bc service nova] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-46047792-4b67-46ff-aa60-f2e42853ad85 req-efa3563b-fc09-4ab6-a5bf-e394c6ab74bc service nova] Lock "3e869e37-c921-48e3-b89a-946bbcc1a5ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:08 user nova-compute[72201]: DEBUG nova.compute.manager [req-46047792-4b67-46ff-aa60-f2e42853ad85 req-efa3563b-fc09-4ab6-a5bf-e394c6ab74bc service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] No waiting events found dispatching network-vif-plugged-a2128465-b362-4945-945b-c02795ea1705 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:27:08 user nova-compute[72201]: WARNING nova.compute.manager [req-46047792-4b67-46ff-aa60-f2e42853ad85 req-efa3563b-fc09-4ab6-a5bf-e394c6ab74bc service nova] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Received unexpected event network-vif-plugged-a2128465-b362-4945-945b-c02795ea1705 for instance with vm_state deleted and task_state None.
Aug 01 15:27:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:27:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:10 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:27:10 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:27:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=7273MB free_disk=25.53133773803711GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:27:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance b64f1cfb-64f2-4493-8721-fc63fcd93bb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:27:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e2ca19ea-868c-40ad-a453-f6e348cfac15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:27:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 0f059ccc-f609-4cf3-a644-c3d1305ae26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:27:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance d4146775-a271-4822-84ec-e723ff09c386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:27:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:27:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 34d08de5-479b-4e90-aa8d-aefe3d8876bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:27:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 865b371c-59c5-4004-8469-cdc1e9327ecb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:27:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 14e890ca-dc2a-4d89-a497-d55805d0c42e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:27:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:27:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:27:11 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:27:11 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:27:11 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:27:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-b8b8ab83-b542-4105-a66d-9faff7c59483 req-d0edb364-7bba-4fa8-96b2-378d50f81d31 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received event network-changed-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:27:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-b8b8ab83-b542-4105-a66d-9faff7c59483 req-d0edb364-7bba-4fa8-96b2-378d50f81d31 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Refreshing instance network info cache due to event network-changed-af512d66-cb4c-4633-ba94-d8b6b3af6e87. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:27:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b8b8ab83-b542-4105-a66d-9faff7c59483 req-d0edb364-7bba-4fa8-96b2-378d50f81d31 service nova] Acquiring lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:27:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b8b8ab83-b542-4105-a66d-9faff7c59483 req-d0edb364-7bba-4fa8-96b2-378d50f81d31 service nova] Acquired lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:27:12 user nova-compute[72201]: DEBUG nova.network.neutron [req-b8b8ab83-b542-4105-a66d-9faff7c59483 req-d0edb364-7bba-4fa8-96b2-378d50f81d31 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Refreshing network info cache for port af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:27:12 user nova-compute[72201]: DEBUG nova.network.neutron [req-b8b8ab83-b542-4105-a66d-9faff7c59483 req-d0edb364-7bba-4fa8-96b2-378d50f81d31 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Updated VIF entry in instance network info cache for port af512d66-cb4c-4633-ba94-d8b6b3af6e87. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:27:12 user nova-compute[72201]: DEBUG nova.network.neutron [req-b8b8ab83-b542-4105-a66d-9faff7c59483 req-d0edb364-7bba-4fa8-96b2-378d50f81d31 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Updating instance_info_cache with network_info: [{"id": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "address": "fa:16:3e:49:45:f6", "network": {"id": "11d4bdb2-99b5-468c-aeb3-79328fdd2d1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58b7341ffe06448bb276bdee2d242c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf512d66-cb", "ovs_interfaceid": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:27:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b8b8ab83-b542-4105-a66d-9faff7c59483 req-d0edb364-7bba-4fa8-96b2-378d50f81d31 service nova] Releasing lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:27:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:13 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9f80271a-7236-4938-9876-6090ba05a9f0 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:27:13 user nova-compute[72201]: INFO nova.compute.manager [None req-9f80271a-7236-4938-9876-6090ba05a9f0 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] instance snapshotting
Aug 01 15:27:13 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-9f80271a-7236-4938-9876-6090ba05a9f0 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Beginning live snapshot process
Aug 01 15:27:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9f80271a-7236-4938-9876-6090ba05a9f0 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json -f qcow2 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9f80271a-7236-4938-9876-6090ba05a9f0 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json -f qcow2" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9f80271a-7236-4938-9876-6090ba05a9f0 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json -f qcow2 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9f80271a-7236-4938-9876-6090ba05a9f0 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json -f qcow2" returned: 0 in 0.131s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9f80271a-7236-4938-9876-6090ba05a9f0 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9f80271a-7236-4938-9876-6090ba05a9f0 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.183s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9f80271a-7236-4938-9876-6090ba05a9f0 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc00elfre/421889d341ab462aad7353c7b45d1467.delta 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9f80271a-7236-4938-9876-6090ba05a9f0 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc00elfre/421889d341ab462aad7353c7b45d1467.delta 1073741824" returned: 0 in 0.056s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:14 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-9f80271a-7236-4938-9876-6090ba05a9f0 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 15:27:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-9f80271a-7236-4938-9876-6090ba05a9f0 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:27:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-9f80271a-7236-4938-9876-6090ba05a9f0 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:27:15 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-9f80271a-7236-4938-9876-6090ba05a9f0 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 15:27:15 user nova-compute[72201]: DEBUG nova.privsep.utils [None req-9f80271a-7236-4938-9876-6090ba05a9f0 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72201) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 15:27:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9f80271a-7236-4938-9876-6090ba05a9f0 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc00elfre/421889d341ab462aad7353c7b45d1467.delta /opt/stack/data/nova/instances/snapshots/tmpc00elfre/421889d341ab462aad7353c7b45d1467 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9f80271a-7236-4938-9876-6090ba05a9f0 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc00elfre/421889d341ab462aad7353c7b45d1467.delta /opt/stack/data/nova/instances/snapshots/tmpc00elfre/421889d341ab462aad7353c7b45d1467" returned: 0 in 0.492s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:16 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-9f80271a-7236-4938-9876-6090ba05a9f0 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Snapshot extracted, beginning image upload
Aug 01 15:27:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:21 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-9f80271a-7236-4938-9876-6090ba05a9f0 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Snapshot image upload complete
Aug 01 15:27:21 user nova-compute[72201]: INFO nova.compute.manager [None req-9f80271a-7236-4938-9876-6090ba05a9f0 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Took 7.30 seconds to snapshot the instance on the hypervisor.
Aug 01 15:27:21 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903626.935713, 3e869e37-c921-48e3-b89a-946bbcc1a5ed => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:27:21 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] VM Stopped (Lifecycle Event)
Aug 01 15:27:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ed2bfafe-bc75-4656-b44e-e5e39fbdc4fe None None] [instance: 3e869e37-c921-48e3-b89a-946bbcc1a5ed] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:27:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Acquiring lock "930bd7a5-5dbb-40a4-a51c-3340f9eb3626" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Lock "930bd7a5-5dbb-40a4-a51c-3340f9eb3626" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:27:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:29 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:27:29 user nova-compute[72201]: INFO nova.compute.claims [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Claim successful on node user
Aug 01 15:27:29 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:27:29 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:27:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:27:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:27:29 user nova-compute[72201]: DEBUG nova.network.neutron [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:27:29 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:27:30 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:27:30 user nova-compute[72201]: DEBUG nova.policy [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c359a4c9166a4110a5830fcb90fb4687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741a552742a845fe8bb0bdc85f4286a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:27:30 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:27:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:27:30 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Creating image(s)
Aug 01 15:27:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Acquiring lock "/opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Lock "/opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Lock "/opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.906s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.151s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626/disk 1073741824" returned: 0 in 0.081s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.202s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:31 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:27:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:32 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Cannot resize image /opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:27:32 user nova-compute[72201]: DEBUG nova.objects.instance [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Lazy-loading 'migration_context' on Instance uuid 930bd7a5-5dbb-40a4-a51c-3340f9eb3626 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:27:32 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:27:32 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Ensure instance console log exists: /opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:27:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:33 user nova-compute[72201]: DEBUG nova.compute.manager [req-024819c7-7acb-4690-a57b-fa5e13597d6f req-0449a6d6-f7a8-4574-a7c3-0315c01a11c5 service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Received event network-changed-d3f16763-8835-4330-945f-ab8dc7045426 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:27:33 user nova-compute[72201]: DEBUG nova.compute.manager [req-024819c7-7acb-4690-a57b-fa5e13597d6f req-0449a6d6-f7a8-4574-a7c3-0315c01a11c5 service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Refreshing instance network info cache due to event network-changed-d3f16763-8835-4330-945f-ab8dc7045426. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:27:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-024819c7-7acb-4690-a57b-fa5e13597d6f req-0449a6d6-f7a8-4574-a7c3-0315c01a11c5 service nova] Acquiring lock "refresh_cache-865b371c-59c5-4004-8469-cdc1e9327ecb" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:27:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-024819c7-7acb-4690-a57b-fa5e13597d6f req-0449a6d6-f7a8-4574-a7c3-0315c01a11c5 service nova] Acquired lock "refresh_cache-865b371c-59c5-4004-8469-cdc1e9327ecb" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:27:33 user nova-compute[72201]: DEBUG nova.network.neutron [req-024819c7-7acb-4690-a57b-fa5e13597d6f req-0449a6d6-f7a8-4574-a7c3-0315c01a11c5 service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Refreshing network info cache for port d3f16763-8835-4330-945f-ab8dc7045426 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:27:33 user nova-compute[72201]: DEBUG nova.network.neutron [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Successfully created port: 7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:27:33 user nova-compute[72201]: DEBUG nova.compute.manager [req-15204173-d706-4870-af01-e043facf8be0 req-0a471101-5606-44dd-99e1-adcae7b870c2 service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Received event network-changed-077c9bc0-0430-488d-b9fb-33d6c4d57a55 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:27:33 user nova-compute[72201]: DEBUG nova.compute.manager [req-15204173-d706-4870-af01-e043facf8be0 req-0a471101-5606-44dd-99e1-adcae7b870c2 service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Refreshing instance network info cache due to event network-changed-077c9bc0-0430-488d-b9fb-33d6c4d57a55. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:27:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-15204173-d706-4870-af01-e043facf8be0 req-0a471101-5606-44dd-99e1-adcae7b870c2 service nova] Acquiring lock "refresh_cache-34d08de5-479b-4e90-aa8d-aefe3d8876bf" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:27:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-15204173-d706-4870-af01-e043facf8be0 req-0a471101-5606-44dd-99e1-adcae7b870c2 service nova] Acquired lock "refresh_cache-34d08de5-479b-4e90-aa8d-aefe3d8876bf" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:27:33 user nova-compute[72201]: DEBUG nova.network.neutron [req-15204173-d706-4870-af01-e043facf8be0 req-0a471101-5606-44dd-99e1-adcae7b870c2 service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Refreshing network info cache for port 077c9bc0-0430-488d-b9fb-33d6c4d57a55 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:27:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:34 user nova-compute[72201]: INFO nova.compute.manager [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Terminating instance
Aug 01 15:27:34 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:27:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:34 user nova-compute[72201]: DEBUG nova.network.neutron [req-024819c7-7acb-4690-a57b-fa5e13597d6f req-0449a6d6-f7a8-4574-a7c3-0315c01a11c5 service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Updated VIF entry in instance network info cache for port d3f16763-8835-4330-945f-ab8dc7045426. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:27:34 user nova-compute[72201]: DEBUG nova.network.neutron [req-024819c7-7acb-4690-a57b-fa5e13597d6f req-0449a6d6-f7a8-4574-a7c3-0315c01a11c5 service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Updating instance_info_cache with network_info: [{"id": "d3f16763-8835-4330-945f-ab8dc7045426", "address": "fa:16:3e:f0:07:0d", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f16763-88", "ovs_interfaceid": "d3f16763-8835-4330-945f-ab8dc7045426", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:27:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-024819c7-7acb-4690-a57b-fa5e13597d6f req-0449a6d6-f7a8-4574-a7c3-0315c01a11c5 service nova] Releasing lock "refresh_cache-865b371c-59c5-4004-8469-cdc1e9327ecb" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:27:34 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Instance destroyed successfully.
Aug 01 15:27:34 user nova-compute[72201]: DEBUG nova.objects.instance [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lazy-loading 'resources' on Instance uuid 34d08de5-479b-4e90-aa8d-aefe3d8876bf {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:27:34 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1995873968',display_name='tempest-AttachVolumeNegativeTest-server-1995873968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1995873968',id=18,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKc3SXqSj5e4ca0ElrFyzAJ+ayYhokrdeRcIntW8w9Rc//WVbfpfwepQ1Ew/0G2CZc1FxuhUXuwdwz1qeXby9ypKd9g+7s8JgpilVpv/g2N8fdUaSLcvaa95IPWPzmv7JQ==',key_name='tempest-keypair-1602767497',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='548641aee9954aa48c567e798b4be247',ramdisk_id='',reservation_id='r-ykhc1tic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2028543234',owner_user_name='tempest-AttachVolumeNegativeTest-2028543234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:25:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd505dbb02e4d3d8e8f97839b25ed22',uuid=34d08de5-479b-4e90-aa8d-aefe3d8876bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "address": "fa:16:3e:07:13:01", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077c9bc0-04", "ovs_interfaceid": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:27:34 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converting VIF {"id": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "address": "fa:16:3e:07:13:01", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077c9bc0-04", "ovs_interfaceid": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:27:34 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:13:01,bridge_name='br-int',has_traffic_filtering=True,id=077c9bc0-0430-488d-b9fb-33d6c4d57a55,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077c9bc0-04') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:27:34 user nova-compute[72201]: DEBUG os_vif [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:13:01,bridge_name='br-int',has_traffic_filtering=True,id=077c9bc0-0430-488d-b9fb-33d6c4d57a55,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077c9bc0-04') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:27:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap077c9bc0-04, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:27:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:34 user nova-compute[72201]: INFO os_vif [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:13:01,bridge_name='br-int',has_traffic_filtering=True,id=077c9bc0-0430-488d-b9fb-33d6c4d57a55,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077c9bc0-04')
Aug 01 15:27:34 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Deleting instance files /opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf_del
Aug 01 15:27:35 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Deletion of /opt/stack/data/nova/instances/34d08de5-479b-4e90-aa8d-aefe3d8876bf_del complete
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.network.neutron [req-15204173-d706-4870-af01-e043facf8be0 req-0a471101-5606-44dd-99e1-adcae7b870c2 service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Updated VIF entry in instance network info cache for port 077c9bc0-0430-488d-b9fb-33d6c4d57a55. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.network.neutron [req-15204173-d706-4870-af01-e043facf8be0 req-0a471101-5606-44dd-99e1-adcae7b870c2 service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Updating instance_info_cache with network_info: [{"id": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "address": "fa:16:3e:07:13:01", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077c9bc0-04", "ovs_interfaceid": "077c9bc0-0430-488d-b9fb-33d6c4d57a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-15204173-d706-4870-af01-e043facf8be0 req-0a471101-5606-44dd-99e1-adcae7b870c2 service nova] Releasing lock "refresh_cache-34d08de5-479b-4e90-aa8d-aefe3d8876bf" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:27:35 user nova-compute[72201]: INFO nova.compute.manager [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 01 15:27:35 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.network.neutron [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Successfully updated port: 7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Acquiring lock "refresh_cache-930bd7a5-5dbb-40a4-a51c-3340f9eb3626" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Acquired lock "refresh_cache-930bd7a5-5dbb-40a4-a51c-3340f9eb3626" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.network.neutron [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.network.neutron [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.compute.manager [req-512e8bb1-0dc7-49c7-9d18-5d570e8ea414 req-863c9dff-cbcb-49d1-b62f-431125740d4e service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Received event network-vif-unplugged-077c9bc0-0430-488d-b9fb-33d6c4d57a55 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-512e8bb1-0dc7-49c7-9d18-5d570e8ea414 req-863c9dff-cbcb-49d1-b62f-431125740d4e service nova] Acquiring lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-512e8bb1-0dc7-49c7-9d18-5d570e8ea414 req-863c9dff-cbcb-49d1-b62f-431125740d4e service nova] Lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-512e8bb1-0dc7-49c7-9d18-5d570e8ea414 req-863c9dff-cbcb-49d1-b62f-431125740d4e service nova] Lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.compute.manager [req-512e8bb1-0dc7-49c7-9d18-5d570e8ea414 req-863c9dff-cbcb-49d1-b62f-431125740d4e service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] No waiting events found dispatching network-vif-unplugged-077c9bc0-0430-488d-b9fb-33d6c4d57a55 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.compute.manager [req-512e8bb1-0dc7-49c7-9d18-5d570e8ea414 req-863c9dff-cbcb-49d1-b62f-431125740d4e service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Received event network-vif-unplugged-077c9bc0-0430-488d-b9fb-33d6c4d57a55 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.compute.manager [req-512e8bb1-0dc7-49c7-9d18-5d570e8ea414 req-863c9dff-cbcb-49d1-b62f-431125740d4e service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Received event network-vif-plugged-077c9bc0-0430-488d-b9fb-33d6c4d57a55 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-512e8bb1-0dc7-49c7-9d18-5d570e8ea414 req-863c9dff-cbcb-49d1-b62f-431125740d4e service nova] Acquiring lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-512e8bb1-0dc7-49c7-9d18-5d570e8ea414 req-863c9dff-cbcb-49d1-b62f-431125740d4e service nova] Lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-512e8bb1-0dc7-49c7-9d18-5d570e8ea414 req-863c9dff-cbcb-49d1-b62f-431125740d4e service nova] Lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.compute.manager [req-512e8bb1-0dc7-49c7-9d18-5d570e8ea414 req-863c9dff-cbcb-49d1-b62f-431125740d4e service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] No waiting events found dispatching network-vif-plugged-077c9bc0-0430-488d-b9fb-33d6c4d57a55 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:27:35 user nova-compute[72201]: WARNING nova.compute.manager [req-512e8bb1-0dc7-49c7-9d18-5d570e8ea414 req-863c9dff-cbcb-49d1-b62f-431125740d4e service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Received unexpected event network-vif-plugged-077c9bc0-0430-488d-b9fb-33d6c4d57a55 for instance with vm_state active and task_state deleting.
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.compute.manager [req-512e8bb1-0dc7-49c7-9d18-5d570e8ea414 req-863c9dff-cbcb-49d1-b62f-431125740d4e service nova] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Received event network-changed-7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.compute.manager [req-512e8bb1-0dc7-49c7-9d18-5d570e8ea414 req-863c9dff-cbcb-49d1-b62f-431125740d4e service nova] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Refreshing instance network info cache due to event network-changed-7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-512e8bb1-0dc7-49c7-9d18-5d570e8ea414 req-863c9dff-cbcb-49d1-b62f-431125740d4e service nova] Acquiring lock "refresh_cache-930bd7a5-5dbb-40a4-a51c-3340f9eb3626" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.network.neutron [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Updating instance_info_cache with network_info: [{"id": "7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b", "address": "fa:16:3e:76:35:38", "network": {"id": "57d99a32-fe6c-4e6f-b9f5-230b8a58c5cc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "61c269efda764109a1920e63e9db119e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3dc6bd-cb", "ovs_interfaceid": "7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Releasing lock "refresh_cache-930bd7a5-5dbb-40a4-a51c-3340f9eb3626" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Instance network_info: |[{"id": "7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b", "address": "fa:16:3e:76:35:38", "network": {"id": "57d99a32-fe6c-4e6f-b9f5-230b8a58c5cc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "61c269efda764109a1920e63e9db119e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3dc6bd-cb", "ovs_interfaceid": "7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-512e8bb1-0dc7-49c7-9d18-5d570e8ea414 req-863c9dff-cbcb-49d1-b62f-431125740d4e service nova] Acquired lock "refresh_cache-930bd7a5-5dbb-40a4-a51c-3340f9eb3626" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.network.neutron [req-512e8bb1-0dc7-49c7-9d18-5d570e8ea414 req-863c9dff-cbcb-49d1-b62f-431125740d4e service nova] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Refreshing network info cache for port 7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Start _get_guest_xml network_info=[{"id": "7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b", "address": "fa:16:3e:76:35:38", "network": {"id": "57d99a32-fe6c-4e6f-b9f5-230b8a58c5cc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "61c269efda764109a1920e63e9db119e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3dc6bd-cb", "ovs_interfaceid": "7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:27:35 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:27:35 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:27:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:27:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-541289900',display_name='tempest-VolumesNegativeTest-instance-541289900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-541289900',id=21,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='741a552742a845fe8bb0bdc85f4286a8',ramdisk_id='',reservation_id='r-i7xuqntd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2144524353',owner_user_name='tempest-VolumesNegativeTest-2144524353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:27:30Z,user_data=None,user_id='c359a4c9166a4110a5830fcb90fb4687',uuid=930bd7a5-5dbb-40a4-a51c-3340f9eb3626,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b", "address": "fa:16:3e:76:35:38", "network": {"id": "57d99a32-fe6c-4e6f-b9f5-230b8a58c5cc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "61c269efda764109a1920e63e9db119e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3dc6bd-cb", "ovs_interfaceid": "7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Converting VIF {"id": "7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b", "address": "fa:16:3e:76:35:38", "network": {"id": "57d99a32-fe6c-4e6f-b9f5-230b8a58c5cc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "61c269efda764109a1920e63e9db119e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3dc6bd-cb", "ovs_interfaceid": "7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:35:38,bridge_name='br-int',has_traffic_filtering=True,id=7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b,network=Network(57d99a32-fe6c-4e6f-b9f5-230b8a58c5cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3dc6bd-cb') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.objects.instance [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Lazy-loading 'pci_devices' on Instance uuid 930bd7a5-5dbb-40a4-a51c-3340f9eb3626 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:27:36 user nova-compute[72201]:   <uuid>930bd7a5-5dbb-40a4-a51c-3340f9eb3626</uuid>
Aug 01 15:27:36 user nova-compute[72201]:   <name>instance-00000015</name>
Aug 01 15:27:36 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:27:36 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:27:36 user nova-compute[72201]:   <metadata>
Aug 01 15:27:36 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:27:36 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:27:36 user nova-compute[72201]:       <nova:name>tempest-VolumesNegativeTest-instance-541289900</nova:name>
Aug 01 15:27:36 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:27:35</nova:creationTime>
Aug 01 15:27:36 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:27:36 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:27:36 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:27:36 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:27:36 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:27:36 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:27:36 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:27:36 user nova-compute[72201]:       <nova:owner>
Aug 01 15:27:36 user nova-compute[72201]:         <nova:user uuid="c359a4c9166a4110a5830fcb90fb4687">tempest-VolumesNegativeTest-2144524353-project-member</nova:user>
Aug 01 15:27:36 user nova-compute[72201]:         <nova:project uuid="741a552742a845fe8bb0bdc85f4286a8">tempest-VolumesNegativeTest-2144524353</nova:project>
Aug 01 15:27:36 user nova-compute[72201]:       </nova:owner>
Aug 01 15:27:36 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:27:36 user nova-compute[72201]:       <nova:ports>
Aug 01 15:27:36 user nova-compute[72201]:         <nova:port uuid="7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b">
Aug 01 15:27:36 user nova-compute[72201]:           <nova:ip type="fixed" address="192.168.233.85" ipVersion="4"/>
Aug 01 15:27:36 user nova-compute[72201]:         </nova:port>
Aug 01 15:27:36 user nova-compute[72201]:       </nova:ports>
Aug 01 15:27:36 user nova-compute[72201]:     </nova:instance>
Aug 01 15:27:36 user nova-compute[72201]:   </metadata>
Aug 01 15:27:36 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:27:36 user nova-compute[72201]:     <system>
Aug 01 15:27:36 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:27:36 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:27:36 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:27:36 user nova-compute[72201]:       <entry name="serial">930bd7a5-5dbb-40a4-a51c-3340f9eb3626</entry>
Aug 01 15:27:36 user nova-compute[72201]:       <entry name="uuid">930bd7a5-5dbb-40a4-a51c-3340f9eb3626</entry>
Aug 01 15:27:36 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:27:36 user nova-compute[72201]:     </system>
Aug 01 15:27:36 user nova-compute[72201]:   </sysinfo>
Aug 01 15:27:36 user nova-compute[72201]:   <os>
Aug 01 15:27:36 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:27:36 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:27:36 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:27:36 user nova-compute[72201]:   </os>
Aug 01 15:27:36 user nova-compute[72201]:   <features>
Aug 01 15:27:36 user nova-compute[72201]:     <acpi/>
Aug 01 15:27:36 user nova-compute[72201]:     <apic/>
Aug 01 15:27:36 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:27:36 user nova-compute[72201]:   </features>
Aug 01 15:27:36 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:27:36 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:27:36 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:27:36 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:27:36 user nova-compute[72201]:   </clock>
Aug 01 15:27:36 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:27:36 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:27:36 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:27:36 user nova-compute[72201]:   </cpu>
Aug 01 15:27:36 user nova-compute[72201]:   <devices>
Aug 01 15:27:36 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:27:36 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:27:36 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626/disk"/>
Aug 01 15:27:36 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:27:36 user nova-compute[72201]:     </disk>
Aug 01 15:27:36 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:27:36 user nova-compute[72201]:       <mac address="fa:16:3e:76:35:38"/>
Aug 01 15:27:36 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:27:36 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:27:36 user nova-compute[72201]:       <target dev="tap7e3dc6bd-cb"/>
Aug 01 15:27:36 user nova-compute[72201]:     </interface>
Aug 01 15:27:36 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:27:36 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626/console.log" append="off"/>
Aug 01 15:27:36 user nova-compute[72201]:     </serial>
Aug 01 15:27:36 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:27:36 user nova-compute[72201]:     <video>
Aug 01 15:27:36 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:27:36 user nova-compute[72201]:     </video>
Aug 01 15:27:36 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:27:36 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:27:36 user nova-compute[72201]:     </rng>
Aug 01 15:27:36 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:27:36 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:27:36 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:27:36 user nova-compute[72201]:     </memballoon>
Aug 01 15:27:36 user nova-compute[72201]:   </devices>
Aug 01 15:27:36 user nova-compute[72201]: </domain>
Aug 01 15:27:36 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:27:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-541289900',display_name='tempest-VolumesNegativeTest-instance-541289900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-541289900',id=21,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='741a552742a845fe8bb0bdc85f4286a8',ramdisk_id='',reservation_id='r-i7xuqntd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2144524353',owner_user_name='tempest-VolumesNegativeTest-2144524353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:27:30Z,user_data=None,user_id='c359a4c9166a4110a5830fcb90fb4687',uuid=930bd7a5-5dbb-40a4-a51c-3340f9eb3626,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b", "address": "fa:16:3e:76:35:38", "network": {"id": "57d99a32-fe6c-4e6f-b9f5-230b8a58c5cc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "61c269efda764109a1920e63e9db119e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3dc6bd-cb", "ovs_interfaceid": "7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Converting VIF {"id": "7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b", "address": "fa:16:3e:76:35:38", "network": {"id": "57d99a32-fe6c-4e6f-b9f5-230b8a58c5cc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "61c269efda764109a1920e63e9db119e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3dc6bd-cb", "ovs_interfaceid": "7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:35:38,bridge_name='br-int',has_traffic_filtering=True,id=7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b,network=Network(57d99a32-fe6c-4e6f-b9f5-230b8a58c5cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3dc6bd-cb') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG os_vif [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:35:38,bridge_name='br-int',has_traffic_filtering=True,id=7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b,network=Network(57d99a32-fe6c-4e6f-b9f5-230b8a58c5cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3dc6bd-cb') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e3dc6bd-cb, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e3dc6bd-cb, col_values=(('external_ids', {'iface-id': '7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:35:38', 'vm-uuid': '930bd7a5-5dbb-40a4-a51c-3340f9eb3626'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.compute.manager [req-d996c236-5d42-4ee4-8f7d-9304222f8a93 req-d66b4221-c7cd-41b3-b666-166d62dc629b service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Received event network-vif-deleted-077c9bc0-0430-488d-b9fb-33d6c4d57a55 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:27:36 user nova-compute[72201]: INFO nova.compute.manager [req-d996c236-5d42-4ee4-8f7d-9304222f8a93 req-d66b4221-c7cd-41b3-b666-166d62dc629b service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Neutron deleted interface 077c9bc0-0430-488d-b9fb-33d6c4d57a55; detaching it from the instance and deleting it from the info cache
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.network.neutron [req-d996c236-5d42-4ee4-8f7d-9304222f8a93 req-d66b4221-c7cd-41b3-b666-166d62dc629b service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:27:36 user nova-compute[72201]: INFO os_vif [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:35:38,bridge_name='br-int',has_traffic_filtering=True,id=7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b,network=Network(57d99a32-fe6c-4e6f-b9f5-230b8a58c5cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3dc6bd-cb')
Aug 01 15:27:36 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Took 1.03 seconds to deallocate network for instance.
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.compute.manager [req-d996c236-5d42-4ee4-8f7d-9304222f8a93 req-d66b4221-c7cd-41b3-b666-166d62dc629b service nova] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Detach interface failed, port_id=077c9bc0-0430-488d-b9fb-33d6c4d57a55, reason: Instance 34d08de5-479b-4e90-aa8d-aefe3d8876bf could not be found. {{(pid=72201) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] No VIF found with MAC fa:16:3e:76:35:38, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:36 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Deleted allocations for instance 34d08de5-479b-4e90-aa8d-aefe3d8876bf
Aug 01 15:27:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9466db27-b2a4-4cef-9ee3-8ea6f8f926a1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "34d08de5-479b-4e90-aa8d-aefe3d8876bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.480s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.network.neutron [req-512e8bb1-0dc7-49c7-9d18-5d570e8ea414 req-863c9dff-cbcb-49d1-b62f-431125740d4e service nova] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Updated VIF entry in instance network info cache for port 7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:27:36 user nova-compute[72201]: DEBUG nova.network.neutron [req-512e8bb1-0dc7-49c7-9d18-5d570e8ea414 req-863c9dff-cbcb-49d1-b62f-431125740d4e service nova] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Updating instance_info_cache with network_info: [{"id": "7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b", "address": "fa:16:3e:76:35:38", "network": {"id": "57d99a32-fe6c-4e6f-b9f5-230b8a58c5cc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "61c269efda764109a1920e63e9db119e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3dc6bd-cb", "ovs_interfaceid": "7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:27:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-512e8bb1-0dc7-49c7-9d18-5d570e8ea414 req-863c9dff-cbcb-49d1-b62f-431125740d4e service nova] Releasing lock "refresh_cache-930bd7a5-5dbb-40a4-a51c-3340f9eb3626" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:27:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-8cfdef9a-489d-4c77-aef6-31717f1cd15b req-94e4c251-bb9d-4249-89fa-6add3425806a service nova] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Received event network-vif-plugged-7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:27:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8cfdef9a-489d-4c77-aef6-31717f1cd15b req-94e4c251-bb9d-4249-89fa-6add3425806a service nova] Acquiring lock "930bd7a5-5dbb-40a4-a51c-3340f9eb3626-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8cfdef9a-489d-4c77-aef6-31717f1cd15b req-94e4c251-bb9d-4249-89fa-6add3425806a service nova] Lock "930bd7a5-5dbb-40a4-a51c-3340f9eb3626-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8cfdef9a-489d-4c77-aef6-31717f1cd15b req-94e4c251-bb9d-4249-89fa-6add3425806a service nova] Lock "930bd7a5-5dbb-40a4-a51c-3340f9eb3626-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-8cfdef9a-489d-4c77-aef6-31717f1cd15b req-94e4c251-bb9d-4249-89fa-6add3425806a service nova] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] No waiting events found dispatching network-vif-plugged-7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:27:38 user nova-compute[72201]: WARNING nova.compute.manager [req-8cfdef9a-489d-4c77-aef6-31717f1cd15b req-94e4c251-bb9d-4249-89fa-6add3425806a service nova] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Received unexpected event network-vif-plugged-7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b for instance with vm_state building and task_state spawning.
Aug 01 15:27:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:39 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903659.8339295, 930bd7a5-5dbb-40a4-a51c-3340f9eb3626 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:27:39 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] VM Resumed (Lifecycle Event)
Aug 01 15:27:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:27:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:27:39 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Instance spawned successfully.
Aug 01 15:27:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:27:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:27:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:27:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:27:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:27:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:27:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:27:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:27:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:27:39 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:27:39 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903659.836526, 930bd7a5-5dbb-40a4-a51c-3340f9eb3626 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:27:39 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] VM Started (Lifecycle Event)
Aug 01 15:27:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:27:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:27:39 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:27:39 user nova-compute[72201]: INFO nova.compute.manager [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Took 9.57 seconds to spawn the instance on the hypervisor.
Aug 01 15:27:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:27:40 user nova-compute[72201]: INFO nova.compute.manager [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Took 10.68 seconds to build instance.
Aug 01 15:27:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4000b71c-6201-4308-89c8-b2057041c444 tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Lock "930bd7a5-5dbb-40a4-a51c-3340f9eb3626" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.786s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:40 user nova-compute[72201]: DEBUG nova.compute.manager [req-97863e9f-a279-4bea-ac5b-858887079cd1 req-c3d8ca21-ee1b-4af2-b7a2-44986a40aac2 service nova] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Received event network-vif-plugged-7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:27:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-97863e9f-a279-4bea-ac5b-858887079cd1 req-c3d8ca21-ee1b-4af2-b7a2-44986a40aac2 service nova] Acquiring lock "930bd7a5-5dbb-40a4-a51c-3340f9eb3626-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-97863e9f-a279-4bea-ac5b-858887079cd1 req-c3d8ca21-ee1b-4af2-b7a2-44986a40aac2 service nova] Lock "930bd7a5-5dbb-40a4-a51c-3340f9eb3626-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-97863e9f-a279-4bea-ac5b-858887079cd1 req-c3d8ca21-ee1b-4af2-b7a2-44986a40aac2 service nova] Lock "930bd7a5-5dbb-40a4-a51c-3340f9eb3626-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:40 user nova-compute[72201]: DEBUG nova.compute.manager [req-97863e9f-a279-4bea-ac5b-858887079cd1 req-c3d8ca21-ee1b-4af2-b7a2-44986a40aac2 service nova] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] No waiting events found dispatching network-vif-plugged-7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:27:40 user nova-compute[72201]: WARNING nova.compute.manager [req-97863e9f-a279-4bea-ac5b-858887079cd1 req-c3d8ca21-ee1b-4af2-b7a2-44986a40aac2 service nova] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Received unexpected event network-vif-plugged-7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b for instance with vm_state active and task_state None.
Aug 01 15:27:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "4d307a58-226b-40dd-a548-e854cf761f57" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "4d307a58-226b-40dd-a548-e854cf761f57" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:44 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:27:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:44 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:27:44 user nova-compute[72201]: INFO nova.compute.claims [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Claim successful on node user
Aug 01 15:27:45 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG nova.network.neutron [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:27:45 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:27:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:27:45 user nova-compute[72201]: INFO nova.virt.block_device [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Booting with volume 002775d0-efbb-42ab-aa46-9e065adaa926 at /dev/vda
Aug 01 15:27:45 user nova-compute[72201]: DEBUG nova.policy [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32967fa82739495685f336d7ace68000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a434898181465ea2df89c7b1e42597', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG os_brick.utils [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a8a371-dc2a-40c2-b700-c50ad22fccfe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.034s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f22816a-e6e4-4dce-b918-18c538f43f86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c2e707-da3a-4842-af7e-7d17a61e91a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3291ea-266b-4a92-8e84-d85cfb05a61d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:27:45 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:27:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9909323-7b2a-4ad2-b205-4a657ac420fe]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG os_brick.utils [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:27:45 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Updating existing volume attachment record: 1d847833-dab7-40c0-b50e-44099bba1387 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:27:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:47 user nova-compute[72201]: DEBUG nova.network.neutron [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Successfully created port: 1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:27:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:49 user nova-compute[72201]: DEBUG nova.network.neutron [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Successfully updated port: 1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:27:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "refresh_cache-4d307a58-226b-40dd-a548-e854cf761f57" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:27:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquired lock "refresh_cache-4d307a58-226b-40dd-a548-e854cf761f57" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:27:49 user nova-compute[72201]: DEBUG nova.network.neutron [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:27:49 user nova-compute[72201]: DEBUG nova.compute.manager [req-86f6acba-b0a0-4a96-be9f-c08a61366f15 req-3a09dff8-4288-4e90-a7a2-181846473a02 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received event network-changed-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:27:49 user nova-compute[72201]: DEBUG nova.compute.manager [req-86f6acba-b0a0-4a96-be9f-c08a61366f15 req-3a09dff8-4288-4e90-a7a2-181846473a02 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Refreshing instance network info cache due to event network-changed-1eb5fe53-2534-45e8-a39b-1eebaa30159a. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:27:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-86f6acba-b0a0-4a96-be9f-c08a61366f15 req-3a09dff8-4288-4e90-a7a2-181846473a02 service nova] Acquiring lock "refresh_cache-4d307a58-226b-40dd-a548-e854cf761f57" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:27:49 user nova-compute[72201]: DEBUG nova.network.neutron [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:27:49 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903654.9191463, 34d08de5-479b-4e90-aa8d-aefe3d8876bf => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:27:49 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] VM Stopped (Lifecycle Event)
Aug 01 15:27:49 user nova-compute[72201]: DEBUG nova.compute.manager [None req-187c5927-c0e1-4c76-b666-43cb3b72995a None None] [instance: 34d08de5-479b-4e90-aa8d-aefe3d8876bf] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:27:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:50 user nova-compute[72201]: DEBUG nova.network.neutron [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Updating instance_info_cache with network_info: [{"id": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "address": "fa:16:3e:ad:58:90", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb5fe53-25", "ovs_interfaceid": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:27:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Releasing lock "refresh_cache-4d307a58-226b-40dd-a548-e854cf761f57" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:27:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Instance network_info: |[{"id": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "address": "fa:16:3e:ad:58:90", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb5fe53-25", "ovs_interfaceid": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:27:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-86f6acba-b0a0-4a96-be9f-c08a61366f15 req-3a09dff8-4288-4e90-a7a2-181846473a02 service nova] Acquired lock "refresh_cache-4d307a58-226b-40dd-a548-e854cf761f57" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:27:50 user nova-compute[72201]: DEBUG nova.network.neutron [req-86f6acba-b0a0-4a96-be9f-c08a61366f15 req-3a09dff8-4288-4e90-a7a2-181846473a02 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Refreshing network info cache for port 1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:27:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:51 user nova-compute[72201]: DEBUG nova.network.neutron [req-86f6acba-b0a0-4a96-be9f-c08a61366f15 req-3a09dff8-4288-4e90-a7a2-181846473a02 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Updated VIF entry in instance network info cache for port 1eb5fe53-2534-45e8-a39b-1eebaa30159a. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:27:51 user nova-compute[72201]: DEBUG nova.network.neutron [req-86f6acba-b0a0-4a96-be9f-c08a61366f15 req-3a09dff8-4288-4e90-a7a2-181846473a02 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Updating instance_info_cache with network_info: [{"id": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "address": "fa:16:3e:ad:58:90", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb5fe53-25", "ovs_interfaceid": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:27:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-86f6acba-b0a0-4a96-be9f-c08a61366f15 req-3a09dff8-4288-4e90-a7a2-181846473a02 service nova] Releasing lock "refresh_cache-4d307a58-226b-40dd-a548-e854cf761f57" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:27:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:27:54 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Creating image(s)
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Did not create local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Ensure instance console log exists: /opt/stack/data/nova/instances/4d307a58-226b-40dd-a548-e854cf761f57/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Start _get_guest_xml network_info=[{"id": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "address": "fa:16:3e:ad:58:90", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb5fe53-25", "ovs_interfaceid": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkrBcZdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4d307a58-226b-40dd-a548-e854cf761f57', 'attached_at': '', 'detached_at': '', 'volume_id': '002775d0-efbb-42ab-aa46-9e065adaa926', 'serial': '002775d0-efbb-42ab-aa46-9e065adaa926'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '1d847833-dab7-40c0-b50e-44099bba1387', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:27:54 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:27:54 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkrBcZdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:27:54 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:27:54 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:27:54 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c687070b-9542-4805-bd41-49b3ae9ad916]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:27:54 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9f6dda-96fa-480f-9ca2-e5cf8a7a6ddd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926] added
Aug 01 15:27:54 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f992068-eb77-4fb7-9afb-5a39137c0d08]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6707cd-5960-4a96-a630-ca6bf9aef2eb]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hkrBcZdt {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hkrBcZdt" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d7d7b3-c907-4c25-9405-ce079e689588]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hkrBcZdt'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9e9a49-4e48-4f0d-a5ad-477644fb09e0]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e315692-1801-48f7-849e-328b554beeeb]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)
Aug 01 15:27:54 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)
Aug 01 15:27:54 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc95b7d-7637-4236-b146-6bc23a7fd9bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926, portal: 172.16.0.220,3260]
Aug 01 15:27:54 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926, portal: 172.16.0.220,3260] successful.
Aug 01 15:27:54 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a819a1b0-b79b-4b4a-9f80-a3b261c33839]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[39532025-f740-4cf3-99e4-7d71f6257950]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)
Aug 01 15:27:54 user nova-compute[72201]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:27:54 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)
Aug 01 15:27:54 user nova-compute[72201]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:27:54 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03c08ba-27fc-4827-a587-c93928ba0543]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:27:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkrBcZdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23030386464363935', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030386464363935', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:27:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1833175817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1833175817',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqQ3JyX5grzt34vgysHqxBFLfCGjR43NVcbWJ9AgvjUJAkeBHgFdLOk4UNppE+XbYa1pHxYkJwB0eE/x04yybsP4ZAiP/yhpagpnjq+IWr2x3Qlg+8KzJgt+RkxU443Og==',key_name='tempest-keypair-714015429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0a434898181465ea2df89c7b1e42597',ramdisk_id='',reservation_id='r-0et8cou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1609612653',owner_user_name='tempest-ServerActionsV293TestJSON-1609612653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:27:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32967fa82739495685f336d7ace68000',uuid=4d307a58-226b-40dd-a548-e854cf761f57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "address": "fa:16:3e:ad:58:90", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb5fe53-25", "ovs_interfaceid": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Converting VIF {"id": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "address": "fa:16:3e:ad:58:90", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb5fe53-25", "ovs_interfaceid": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:58:90,bridge_name='br-int',has_traffic_filtering=True,id=1eb5fe53-2534-45e8-a39b-1eebaa30159a,network=Network(968d4faa-613e-4954-86cc-3df6b86a2491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb5fe53-25') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG nova.objects.instance [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d307a58-226b-40dd-a548-e854cf761f57 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:27:55 user nova-compute[72201]:   <uuid>4d307a58-226b-40dd-a548-e854cf761f57</uuid>
Aug 01 15:27:55 user nova-compute[72201]:   <name>instance-00000016</name>
Aug 01 15:27:55 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:27:55 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:27:55 user nova-compute[72201]:   <metadata>
Aug 01 15:27:55 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:27:55 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:27:55 user nova-compute[72201]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1833175817</nova:name>
Aug 01 15:27:55 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:27:54</nova:creationTime>
Aug 01 15:27:55 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:27:55 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:27:55 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:27:55 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:27:55 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:27:55 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:27:55 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:27:55 user nova-compute[72201]:       <nova:owner>
Aug 01 15:27:55 user nova-compute[72201]:         <nova:user uuid="32967fa82739495685f336d7ace68000">tempest-ServerActionsV293TestJSON-1609612653-project-member</nova:user>
Aug 01 15:27:55 user nova-compute[72201]:         <nova:project uuid="b0a434898181465ea2df89c7b1e42597">tempest-ServerActionsV293TestJSON-1609612653</nova:project>
Aug 01 15:27:55 user nova-compute[72201]:       </nova:owner>
Aug 01 15:27:55 user nova-compute[72201]:       <nova:ports>
Aug 01 15:27:55 user nova-compute[72201]:         <nova:port uuid="1eb5fe53-2534-45e8-a39b-1eebaa30159a">
Aug 01 15:27:55 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 15:27:55 user nova-compute[72201]:         </nova:port>
Aug 01 15:27:55 user nova-compute[72201]:       </nova:ports>
Aug 01 15:27:55 user nova-compute[72201]:     </nova:instance>
Aug 01 15:27:55 user nova-compute[72201]:   </metadata>
Aug 01 15:27:55 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:27:55 user nova-compute[72201]:     <system>
Aug 01 15:27:55 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:27:55 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:27:55 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:27:55 user nova-compute[72201]:       <entry name="serial">4d307a58-226b-40dd-a548-e854cf761f57</entry>
Aug 01 15:27:55 user nova-compute[72201]:       <entry name="uuid">4d307a58-226b-40dd-a548-e854cf761f57</entry>
Aug 01 15:27:55 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:27:55 user nova-compute[72201]:     </system>
Aug 01 15:27:55 user nova-compute[72201]:   </sysinfo>
Aug 01 15:27:55 user nova-compute[72201]:   <os>
Aug 01 15:27:55 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:27:55 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:27:55 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:27:55 user nova-compute[72201]:   </os>
Aug 01 15:27:55 user nova-compute[72201]:   <features>
Aug 01 15:27:55 user nova-compute[72201]:     <acpi/>
Aug 01 15:27:55 user nova-compute[72201]:     <apic/>
Aug 01 15:27:55 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:27:55 user nova-compute[72201]:   </features>
Aug 01 15:27:55 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:27:55 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:27:55 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:27:55 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:27:55 user nova-compute[72201]:   </clock>
Aug 01 15:27:55 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:27:55 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:27:55 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:27:55 user nova-compute[72201]:   </cpu>
Aug 01 15:27:55 user nova-compute[72201]:   <devices>
Aug 01 15:27:55 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:27:55 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:27:55 user nova-compute[72201]:       <source dev="/dev/sdb"/>
Aug 01 15:27:55 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:27:55 user nova-compute[72201]:       <serial>002775d0-efbb-42ab-aa46-9e065adaa926</serial>
Aug 01 15:27:55 user nova-compute[72201]:     </disk>
Aug 01 15:27:55 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:27:55 user nova-compute[72201]:       <mac address="fa:16:3e:ad:58:90"/>
Aug 01 15:27:55 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:27:55 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:27:55 user nova-compute[72201]:       <target dev="tap1eb5fe53-25"/>
Aug 01 15:27:55 user nova-compute[72201]:     </interface>
Aug 01 15:27:55 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:27:55 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/4d307a58-226b-40dd-a548-e854cf761f57/console.log" append="off"/>
Aug 01 15:27:55 user nova-compute[72201]:     </serial>
Aug 01 15:27:55 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:27:55 user nova-compute[72201]:     <video>
Aug 01 15:27:55 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:27:55 user nova-compute[72201]:     </video>
Aug 01 15:27:55 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:27:55 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:27:55 user nova-compute[72201]:     </rng>
Aug 01 15:27:55 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:27:55 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:27:55 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:27:55 user nova-compute[72201]:     </memballoon>
Aug 01 15:27:55 user nova-compute[72201]:   </devices>
Aug 01 15:27:55 user nova-compute[72201]: </domain>
Aug 01 15:27:55 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:27:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1833175817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1833175817',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqQ3JyX5grzt34vgysHqxBFLfCGjR43NVcbWJ9AgvjUJAkeBHgFdLOk4UNppE+XbYa1pHxYkJwB0eE/x04yybsP4ZAiP/yhpagpnjq+IWr2x3Qlg+8KzJgt+RkxU443Og==',key_name='tempest-keypair-714015429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0a434898181465ea2df89c7b1e42597',ramdisk_id='',reservation_id='r-0et8cou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1609612653',owner_user_name='tempest-ServerActionsV293TestJSON-1609612653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:27:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32967fa82739495685f336d7ace68000',uuid=4d307a58-226b-40dd-a548-e854cf761f57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "address": "fa:16:3e:ad:58:90", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb5fe53-25", "ovs_interfaceid": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Converting VIF {"id": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "address": "fa:16:3e:ad:58:90", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb5fe53-25", "ovs_interfaceid": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:58:90,bridge_name='br-int',has_traffic_filtering=True,id=1eb5fe53-2534-45e8-a39b-1eebaa30159a,network=Network(968d4faa-613e-4954-86cc-3df6b86a2491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb5fe53-25') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG os_vif [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:58:90,bridge_name='br-int',has_traffic_filtering=True,id=1eb5fe53-2534-45e8-a39b-1eebaa30159a,network=Network(968d4faa-613e-4954-86cc-3df6b86a2491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb5fe53-25') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1eb5fe53-25, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1eb5fe53-25, col_values=(('external_ids', {'iface-id': '1eb5fe53-2534-45e8-a39b-1eebaa30159a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:58:90', 'vm-uuid': '4d307a58-226b-40dd-a548-e854cf761f57'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:55 user nova-compute[72201]: INFO os_vif [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:58:90,bridge_name='br-int',has_traffic_filtering=True,id=1eb5fe53-2534-45e8-a39b-1eebaa30159a,network=Network(968d4faa-613e-4954-86cc-3df6b86a2491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb5fe53-25')
Aug 01 15:27:55 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:27:55 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] No VIF found with MAC fa:16:3e:ad:58:90, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:27:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "9530577b-69a6-45bc-a33b-1dc60d69a16f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:57 user nova-compute[72201]: DEBUG nova.compute.manager [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:27:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:57 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:27:57 user nova-compute[72201]: INFO nova.compute.claims [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Claim successful on node user
Aug 01 15:27:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:57 user nova-compute[72201]: DEBUG nova.compute.manager [req-910567c9-4118-4f55-b9bc-d1fd738f062c req-17634523-b4ce-4c36-8824-92a3a03c84da service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received event network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:27:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-910567c9-4118-4f55-b9bc-d1fd738f062c req-17634523-b4ce-4c36-8824-92a3a03c84da service nova] Acquiring lock "4d307a58-226b-40dd-a548-e854cf761f57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-910567c9-4118-4f55-b9bc-d1fd738f062c req-17634523-b4ce-4c36-8824-92a3a03c84da service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-910567c9-4118-4f55-b9bc-d1fd738f062c req-17634523-b4ce-4c36-8824-92a3a03c84da service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:57 user nova-compute[72201]: DEBUG nova.compute.manager [req-910567c9-4118-4f55-b9bc-d1fd738f062c req-17634523-b4ce-4c36-8824-92a3a03c84da service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] No waiting events found dispatching network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:27:57 user nova-compute[72201]: WARNING nova.compute.manager [req-910567c9-4118-4f55-b9bc-d1fd738f062c req-17634523-b4ce-4c36-8824-92a3a03c84da service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received unexpected event network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a for instance with vm_state building and task_state spawning.
Aug 01 15:27:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:57 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:27:57 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:27:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.640s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:57 user nova-compute[72201]: DEBUG nova.compute.manager [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:27:57 user nova-compute[72201]: DEBUG nova.compute.manager [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:27:57 user nova-compute[72201]: DEBUG nova.network.neutron [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:27:57 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:27:57 user nova-compute[72201]: DEBUG nova.compute.manager [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG nova.compute.manager [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:27:58 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Creating image(s)
Aug 01 15:27:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "/opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "/opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "/opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG nova.policy [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa902dd334b04d4cbf0ee4eb1eb582ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d07e2a1943449baeb9ca49a3d1326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.181s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.157s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk 1073741824" returned: 0 in 0.057s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.188s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Cannot resize image /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG nova.objects.instance [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lazy-loading 'migration_context' on Instance uuid 9530577b-69a6-45bc-a33b-1dc60d69a16f {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Ensure instance console log exists: /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:27:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:27:59 user nova-compute[72201]: DEBUG nova.network.neutron [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Successfully created port: 2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:27:59 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903679.7018435, 4d307a58-226b-40dd-a548-e854cf761f57 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:27:59 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] VM Resumed (Lifecycle Event)
Aug 01 15:27:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:27:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:27:59 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Instance spawned successfully.
Aug 01 15:27:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:27:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:27:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:27:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:27:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:27:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:27:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:27:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:27:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:27:59 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:27:59 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903679.7080498, 4d307a58-226b-40dd-a548-e854cf761f57 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:27:59 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] VM Started (Lifecycle Event)
Aug 01 15:27:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:27:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:27:59 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:27:59 user nova-compute[72201]: INFO nova.compute.manager [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Took 5.56 seconds to spawn the instance on the hypervisor.
Aug 01 15:27:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:27:59 user nova-compute[72201]: INFO nova.compute.manager [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Took 15.14 seconds to build instance.
Aug 01 15:28:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9aaf0506-7d3b-4623-9565-3c4580117bce tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "4d307a58-226b-40dd-a548-e854cf761f57" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.262s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.compute.manager [req-756d1a00-6436-425b-9e03-9a5d828be139 req-81d2e445-252f-4cbf-8165-93be268f4c28 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received event network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-756d1a00-6436-425b-9e03-9a5d828be139 req-81d2e445-252f-4cbf-8165-93be268f4c28 service nova] Acquiring lock "4d307a58-226b-40dd-a548-e854cf761f57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-756d1a00-6436-425b-9e03-9a5d828be139 req-81d2e445-252f-4cbf-8165-93be268f4c28 service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-756d1a00-6436-425b-9e03-9a5d828be139 req-81d2e445-252f-4cbf-8165-93be268f4c28 service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.compute.manager [req-756d1a00-6436-425b-9e03-9a5d828be139 req-81d2e445-252f-4cbf-8165-93be268f4c28 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] No waiting events found dispatching network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:28:00 user nova-compute[72201]: WARNING nova.compute.manager [req-756d1a00-6436-425b-9e03-9a5d828be139 req-81d2e445-252f-4cbf-8165-93be268f4c28 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received unexpected event network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a for instance with vm_state active and task_state None.
Aug 01 15:28:00 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.network.neutron [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Successfully updated port: 2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquired lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.network.neutron [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-e2ca19ea-868c-40ad-a453-f6e348cfac15" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-e2ca19ea-868c-40ad-a453-f6e348cfac15" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.network.neutron [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.network.neutron [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Updating instance_info_cache with network_info: [{"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Releasing lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.compute.manager [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Instance network_info: |[{"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Start _get_guest_xml network_info=[{"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:00 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:28:00 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:27:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1658925189',display_name='tempest-ServerActionsTestOtherB-server-1658925189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1658925189',id=23,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJArwB9vrejGtK4OyRlF/OPoTmPfhsQE57Hge1qGzDjlRPweDSIgEPC9CjlFjLzOgL7v2M+GdTat2K+6ohuaRgnBN7sGvF/1T+/fwnocb98Oa2hVXX8HgqjMMybuv12ZQ==',key_name='tempest-keypair-162505840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7d07e2a1943449baeb9ca49a3d1326f',ramdisk_id='',reservation_id='r-0d5v5zbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2096061393',owner_user_name='tempest-ServerActionsTestOtherB-2096061393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:27:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa902dd334b04d4cbf0ee4eb1eb582ff',uuid=9530577b-69a6-45bc-a33b-1dc60d69a16f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Converting VIF {"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:0d:a8,bridge_name='br-int',has_traffic_filtering=True,id=2cccc4c0-1ece-49a9-9e19-065c8fe55d9f,network=Network(bbd9214a-e302-4a4a-9395-f3e70e0cc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cccc4c0-1e') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.objects.instance [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lazy-loading 'pci_devices' on Instance uuid 9530577b-69a6-45bc-a33b-1dc60d69a16f {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:28:00 user nova-compute[72201]:   <uuid>9530577b-69a6-45bc-a33b-1dc60d69a16f</uuid>
Aug 01 15:28:00 user nova-compute[72201]:   <name>instance-00000017</name>
Aug 01 15:28:00 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:28:00 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:28:00 user nova-compute[72201]:   <metadata>
Aug 01 15:28:00 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:28:00 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:28:00 user nova-compute[72201]:       <nova:name>tempest-ServerActionsTestOtherB-server-1658925189</nova:name>
Aug 01 15:28:00 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:28:00</nova:creationTime>
Aug 01 15:28:00 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:28:00 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:28:00 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:28:00 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:28:00 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:28:00 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:28:00 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:28:00 user nova-compute[72201]:       <nova:owner>
Aug 01 15:28:00 user nova-compute[72201]:         <nova:user uuid="fa902dd334b04d4cbf0ee4eb1eb582ff">tempest-ServerActionsTestOtherB-2096061393-project-member</nova:user>
Aug 01 15:28:00 user nova-compute[72201]:         <nova:project uuid="a7d07e2a1943449baeb9ca49a3d1326f">tempest-ServerActionsTestOtherB-2096061393</nova:project>
Aug 01 15:28:00 user nova-compute[72201]:       </nova:owner>
Aug 01 15:28:00 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:28:00 user nova-compute[72201]:       <nova:ports>
Aug 01 15:28:00 user nova-compute[72201]:         <nova:port uuid="2cccc4c0-1ece-49a9-9e19-065c8fe55d9f">
Aug 01 15:28:00 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 15:28:00 user nova-compute[72201]:         </nova:port>
Aug 01 15:28:00 user nova-compute[72201]:       </nova:ports>
Aug 01 15:28:00 user nova-compute[72201]:     </nova:instance>
Aug 01 15:28:00 user nova-compute[72201]:   </metadata>
Aug 01 15:28:00 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:28:00 user nova-compute[72201]:     <system>
Aug 01 15:28:00 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:28:00 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:28:00 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:28:00 user nova-compute[72201]:       <entry name="serial">9530577b-69a6-45bc-a33b-1dc60d69a16f</entry>
Aug 01 15:28:00 user nova-compute[72201]:       <entry name="uuid">9530577b-69a6-45bc-a33b-1dc60d69a16f</entry>
Aug 01 15:28:00 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:28:00 user nova-compute[72201]:     </system>
Aug 01 15:28:00 user nova-compute[72201]:   </sysinfo>
Aug 01 15:28:00 user nova-compute[72201]:   <os>
Aug 01 15:28:00 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:28:00 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:28:00 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:28:00 user nova-compute[72201]:   </os>
Aug 01 15:28:00 user nova-compute[72201]:   <features>
Aug 01 15:28:00 user nova-compute[72201]:     <acpi/>
Aug 01 15:28:00 user nova-compute[72201]:     <apic/>
Aug 01 15:28:00 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:28:00 user nova-compute[72201]:   </features>
Aug 01 15:28:00 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:28:00 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:28:00 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:28:00 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:28:00 user nova-compute[72201]:   </clock>
Aug 01 15:28:00 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:28:00 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:28:00 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:28:00 user nova-compute[72201]:   </cpu>
Aug 01 15:28:00 user nova-compute[72201]:   <devices>
Aug 01 15:28:00 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:28:00 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:28:00 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk"/>
Aug 01 15:28:00 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:28:00 user nova-compute[72201]:     </disk>
Aug 01 15:28:00 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:28:00 user nova-compute[72201]:       <mac address="fa:16:3e:78:0d:a8"/>
Aug 01 15:28:00 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:28:00 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:28:00 user nova-compute[72201]:       <target dev="tap2cccc4c0-1e"/>
Aug 01 15:28:00 user nova-compute[72201]:     </interface>
Aug 01 15:28:00 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:28:00 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/console.log" append="off"/>
Aug 01 15:28:00 user nova-compute[72201]:     </serial>
Aug 01 15:28:00 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:28:00 user nova-compute[72201]:     <video>
Aug 01 15:28:00 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:28:00 user nova-compute[72201]:     </video>
Aug 01 15:28:00 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:28:00 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:28:00 user nova-compute[72201]:     </rng>
Aug 01 15:28:00 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:28:00 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:28:00 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:28:00 user nova-compute[72201]:     </memballoon>
Aug 01 15:28:00 user nova-compute[72201]:   </devices>
Aug 01 15:28:00 user nova-compute[72201]: </domain>
Aug 01 15:28:00 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:27:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1658925189',display_name='tempest-ServerActionsTestOtherB-server-1658925189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1658925189',id=23,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJArwB9vrejGtK4OyRlF/OPoTmPfhsQE57Hge1qGzDjlRPweDSIgEPC9CjlFjLzOgL7v2M+GdTat2K+6ohuaRgnBN7sGvF/1T+/fwnocb98Oa2hVXX8HgqjMMybuv12ZQ==',key_name='tempest-keypair-162505840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7d07e2a1943449baeb9ca49a3d1326f',ramdisk_id='',reservation_id='r-0d5v5zbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2096061393',owner_user_name='tempest-ServerActionsTestOtherB-2096061393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:27:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa902dd334b04d4cbf0ee4eb1eb582ff',uuid=9530577b-69a6-45bc-a33b-1dc60d69a16f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Converting VIF {"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:0d:a8,bridge_name='br-int',has_traffic_filtering=True,id=2cccc4c0-1ece-49a9-9e19-065c8fe55d9f,network=Network(bbd9214a-e302-4a4a-9395-f3e70e0cc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cccc4c0-1e') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG os_vif [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:0d:a8,bridge_name='br-int',has_traffic_filtering=True,id=2cccc4c0-1ece-49a9-9e19-065c8fe55d9f,network=Network(bbd9214a-e302-4a4a-9395-f3e70e0cc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cccc4c0-1e') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cccc4c0-1e, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2cccc4c0-1e, col_values=(('external_ids', {'iface-id': '2cccc4c0-1ece-49a9-9e19-065c8fe55d9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:0d:a8', 'vm-uuid': '9530577b-69a6-45bc-a33b-1dc60d69a16f'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:00 user nova-compute[72201]: INFO os_vif [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:0d:a8,bridge_name='br-int',has_traffic_filtering=True,id=2cccc4c0-1ece-49a9-9e19-065c8fe55d9f,network=Network(bbd9214a-e302-4a4a-9395-f3e70e0cc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cccc4c0-1e')
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] No VIF found with MAC fa:16:3e:78:0d:a8, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Updating instance_info_cache with network_info: [{"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-e2ca19ea-868c-40ad-a453-f6e348cfac15" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:28:00 user nova-compute[72201]: DEBUG nova.compute.manager [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:28:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:01 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:28:01 user nova-compute[72201]: INFO nova.compute.claims [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Claim successful on node user
Aug 01 15:28:01 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:28:01 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:28:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.828s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:01 user nova-compute[72201]: DEBUG nova.compute.manager [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:28:02 user nova-compute[72201]: DEBUG nova.compute.manager [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:28:02 user nova-compute[72201]: DEBUG nova.network.neutron [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:28:02 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:28:02 user nova-compute[72201]: DEBUG nova.compute.manager [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:28:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-f6da2e7d-9f69-42d9-8d67-f2a009cddae2 req-65e32e56-037b-44a9-86b3-2b95c23e517c service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received event network-changed-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:28:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-f6da2e7d-9f69-42d9-8d67-f2a009cddae2 req-65e32e56-037b-44a9-86b3-2b95c23e517c service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Refreshing instance network info cache due to event network-changed-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:28:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f6da2e7d-9f69-42d9-8d67-f2a009cddae2 req-65e32e56-037b-44a9-86b3-2b95c23e517c service nova] Acquiring lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:28:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f6da2e7d-9f69-42d9-8d67-f2a009cddae2 req-65e32e56-037b-44a9-86b3-2b95c23e517c service nova] Acquired lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:28:02 user nova-compute[72201]: DEBUG nova.network.neutron [req-f6da2e7d-9f69-42d9-8d67-f2a009cddae2 req-65e32e56-037b-44a9-86b3-2b95c23e517c service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Refreshing network info cache for port 2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:28:02 user nova-compute[72201]: DEBUG nova.policy [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c5267b768cf46958384d9ad4c585f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e1f59585b44545ae3ec0cdfa480fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:28:02 user nova-compute[72201]: DEBUG nova.compute.manager [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:28:02 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:28:02 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Creating image(s)
Aug 01 15:28:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "/opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "/opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87.part --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87.part --force-share --output=json" returned: 0 in 0.217s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:02 user nova-compute[72201]: DEBUG nova.virt.images [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] c0670c94-fd3d-443f-aebb-0738f9376cbd was qcow2, converting to raw {{(pid=72201) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 15:28:02 user nova-compute[72201]: DEBUG nova.privsep.utils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72201) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 15:28:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87.part /opt/stack/data/nova/instances/_base/e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87.converted {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87.part /opt/stack/data/nova/instances/_base/e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87.converted" returned: 0 in 0.272s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87.converted --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.143s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87 --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG nova.network.neutron [req-f6da2e7d-9f69-42d9-8d67-f2a009cddae2 req-65e32e56-037b-44a9-86b3-2b95c23e517c service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Updated VIF entry in instance network info cache for port 2cccc4c0-1ece-49a9-9e19-065c8fe55d9f. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG nova.network.neutron [req-f6da2e7d-9f69-42d9-8d67-f2a009cddae2 req-65e32e56-037b-44a9-86b3-2b95c23e517c service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Updating instance_info_cache with network_info: [{"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f6da2e7d-9f69-42d9-8d67-f2a009cddae2 req-65e32e56-037b-44a9-86b3-2b95c23e517c service nova] Releasing lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87 --force-share --output=json" returned: 0 in 0.227s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87 --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG nova.compute.manager [req-25ba5b56-5cb8-49d3-a821-56fdceae3bf6 req-211b8237-c408-470b-8905-061f0d5b112c service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received event network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-25ba5b56-5cb8-49d3-a821-56fdceae3bf6 req-211b8237-c408-470b-8905-061f0d5b112c service nova] Acquiring lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-25ba5b56-5cb8-49d3-a821-56fdceae3bf6 req-211b8237-c408-470b-8905-061f0d5b112c service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-25ba5b56-5cb8-49d3-a821-56fdceae3bf6 req-211b8237-c408-470b-8905-061f0d5b112c service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG nova.compute.manager [req-25ba5b56-5cb8-49d3-a821-56fdceae3bf6 req-211b8237-c408-470b-8905-061f0d5b112c service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] No waiting events found dispatching network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:28:03 user nova-compute[72201]: WARNING nova.compute.manager [req-25ba5b56-5cb8-49d3-a821-56fdceae3bf6 req-211b8237-c408-470b-8905-061f0d5b112c service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received unexpected event network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f for instance with vm_state building and task_state spawning.
Aug 01 15:28:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87 --force-share --output=json" returned: 0 in 0.192s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87,backing_fmt=raw /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG nova.network.neutron [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Successfully created port: 964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87,backing_fmt=raw /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk 1073741824" returned: 0 in 0.063s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87 --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87 --force-share --output=json" returned: 0 in 0.145s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:04 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:28:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:04 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Cannot resize image /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:28:04 user nova-compute[72201]: DEBUG nova.objects.instance [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lazy-loading 'migration_context' on Instance uuid ed5f91f1-b3fd-4737-8ed6-fca13617bd6e {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:28:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:28:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Ensure instance console log exists: /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:28:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.network.neutron [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Successfully updated port: 964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "refresh_cache-ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquired lock "refresh_cache-ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.network.neutron [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903685.3353515, 9530577b-69a6-45bc-a33b-1dc60d69a16f => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:28:05 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] VM Resumed (Lifecycle Event)
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.compute.manager [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:28:05 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Instance spawned successfully.
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.network.neutron [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:28:05 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903685.335706, 9530577b-69a6-45bc-a33b-1dc60d69a16f => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:28:05 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] VM Started (Lifecycle Event)
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:28:05 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:28:05 user nova-compute[72201]: INFO nova.compute.manager [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Took 7.41 seconds to spawn the instance on the hypervisor.
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.compute.manager [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:28:05 user nova-compute[72201]: INFO nova.compute.manager [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Took 8.48 seconds to build instance.
Aug 01 15:28:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-532973d8-1ede-4f2b-83e2-221af5e6ba0f tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.686s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-68aacdc4-08eb-4c0f-adde-474774c946e4 req-5a316992-fbd4-4bee-879e-d57a4550a71b service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received event network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-68aacdc4-08eb-4c0f-adde-474774c946e4 req-5a316992-fbd4-4bee-879e-d57a4550a71b service nova] Acquiring lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-68aacdc4-08eb-4c0f-adde-474774c946e4 req-5a316992-fbd4-4bee-879e-d57a4550a71b service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-68aacdc4-08eb-4c0f-adde-474774c946e4 req-5a316992-fbd4-4bee-879e-d57a4550a71b service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-68aacdc4-08eb-4c0f-adde-474774c946e4 req-5a316992-fbd4-4bee-879e-d57a4550a71b service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] No waiting events found dispatching network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:28:05 user nova-compute[72201]: WARNING nova.compute.manager [req-68aacdc4-08eb-4c0f-adde-474774c946e4 req-5a316992-fbd4-4bee-879e-d57a4550a71b service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received unexpected event network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f for instance with vm_state active and task_state None.
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-68aacdc4-08eb-4c0f-adde-474774c946e4 req-5a316992-fbd4-4bee-879e-d57a4550a71b service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received event network-changed-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-68aacdc4-08eb-4c0f-adde-474774c946e4 req-5a316992-fbd4-4bee-879e-d57a4550a71b service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Refreshing instance network info cache due to event network-changed-964ce05e-779d-4ccd-a19a-9c6832a9db28. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-68aacdc4-08eb-4c0f-adde-474774c946e4 req-5a316992-fbd4-4bee-879e-d57a4550a71b service nova] Acquiring lock "refresh_cache-ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.network.neutron [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Updating instance_info_cache with network_info: [{"id": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "address": "fa:16:3e:89:dd:94", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964ce05e-77", "ovs_interfaceid": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Releasing lock "refresh_cache-ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.compute.manager [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Instance network_info: |[{"id": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "address": "fa:16:3e:89:dd:94", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964ce05e-77", "ovs_interfaceid": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-68aacdc4-08eb-4c0f-adde-474774c946e4 req-5a316992-fbd4-4bee-879e-d57a4550a71b service nova] Acquired lock "refresh_cache-ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.network.neutron [req-68aacdc4-08eb-4c0f-adde-474774c946e4 req-5a316992-fbd4-4bee-879e-d57a4550a71b service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Refreshing network info cache for port 964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Start _get_guest_xml network_info=[{"id": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "address": "fa:16:3e:89:dd:94", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964ce05e-77", "ovs_interfaceid": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:27:58Z,direct_url=<?>,disk_format='qcow2',id=c0670c94-fd3d-443f-aebb-0738f9376cbd,min_disk=0,min_ram=0,name='tempest-scenario-img--1634167060',owner='b5e1f59585b44545ae3ec0cdfa480fab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:27:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': 'c0670c94-fd3d-443f-aebb-0738f9376cbd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:28:05 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:28:05 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:27:58Z,direct_url=<?>,disk_format='qcow2',id=c0670c94-fd3d-443f-aebb-0738f9376cbd,min_disk=0,min_ram=0,name='tempest-scenario-img--1634167060',owner='b5e1f59585b44545ae3ec0cdfa480fab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:27:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:28:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:28:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-332406940',display_name='tempest-TestMinimumBasicScenario-server-332406940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-332406940',id=24,image_ref='c0670c94-fd3d-443f-aebb-0738f9376cbd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKu5FlU96T/URWJekboP/5eG4GC0WsZVMcgk5ed4tw6gP/YNDChRwoCs90mgM9aN2gDeP6FbbX+sbTNMsNmfUCqRJxGlzieVVBtAcJhgTqQ3WKEz5W5LDJ3fG3+AZ0MRA==',key_name='tempest-TestMinimumBasicScenario-1343136448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5e1f59585b44545ae3ec0cdfa480fab',ramdisk_id='',reservation_id='r-eeuxjpbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c0670c94-fd3d-443f-aebb-0738f9376cbd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1524896067',owner_user_name='tempest-TestMinimumBasicScenario-1524896067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:28:02Z,user_data=None,user_id='2c5267b768cf46958384d9ad4c585f82',uuid=ed5f91f1-b3fd-4737-8ed6-fca13617bd6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "address": "fa:16:3e:89:dd:94", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964ce05e-77", "ovs_interfaceid": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Converting VIF {"id": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "address": "fa:16:3e:89:dd:94", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964ce05e-77", "ovs_interfaceid": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:dd:94,bridge_name='br-int',has_traffic_filtering=True,id=964ce05e-779d-4ccd-a19a-9c6832a9db28,network=Network(d1dbf82c-df93-48ae-b118-278943635ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap964ce05e-77') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG nova.objects.instance [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lazy-loading 'pci_devices' on Instance uuid ed5f91f1-b3fd-4737-8ed6-fca13617bd6e {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:28:06 user nova-compute[72201]:   <uuid>ed5f91f1-b3fd-4737-8ed6-fca13617bd6e</uuid>
Aug 01 15:28:06 user nova-compute[72201]:   <name>instance-00000018</name>
Aug 01 15:28:06 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:28:06 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:28:06 user nova-compute[72201]:   <metadata>
Aug 01 15:28:06 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:28:06 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:28:06 user nova-compute[72201]:       <nova:name>tempest-TestMinimumBasicScenario-server-332406940</nova:name>
Aug 01 15:28:06 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:28:05</nova:creationTime>
Aug 01 15:28:06 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:28:06 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:28:06 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:28:06 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:28:06 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:28:06 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:28:06 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:28:06 user nova-compute[72201]:       <nova:owner>
Aug 01 15:28:06 user nova-compute[72201]:         <nova:user uuid="2c5267b768cf46958384d9ad4c585f82">tempest-TestMinimumBasicScenario-1524896067-project-member</nova:user>
Aug 01 15:28:06 user nova-compute[72201]:         <nova:project uuid="b5e1f59585b44545ae3ec0cdfa480fab">tempest-TestMinimumBasicScenario-1524896067</nova:project>
Aug 01 15:28:06 user nova-compute[72201]:       </nova:owner>
Aug 01 15:28:06 user nova-compute[72201]:       <nova:root type="image" uuid="c0670c94-fd3d-443f-aebb-0738f9376cbd"/>
Aug 01 15:28:06 user nova-compute[72201]:       <nova:ports>
Aug 01 15:28:06 user nova-compute[72201]:         <nova:port uuid="964ce05e-779d-4ccd-a19a-9c6832a9db28">
Aug 01 15:28:06 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 15:28:06 user nova-compute[72201]:         </nova:port>
Aug 01 15:28:06 user nova-compute[72201]:       </nova:ports>
Aug 01 15:28:06 user nova-compute[72201]:     </nova:instance>
Aug 01 15:28:06 user nova-compute[72201]:   </metadata>
Aug 01 15:28:06 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:28:06 user nova-compute[72201]:     <system>
Aug 01 15:28:06 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:28:06 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:28:06 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:28:06 user nova-compute[72201]:       <entry name="serial">ed5f91f1-b3fd-4737-8ed6-fca13617bd6e</entry>
Aug 01 15:28:06 user nova-compute[72201]:       <entry name="uuid">ed5f91f1-b3fd-4737-8ed6-fca13617bd6e</entry>
Aug 01 15:28:06 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:28:06 user nova-compute[72201]:     </system>
Aug 01 15:28:06 user nova-compute[72201]:   </sysinfo>
Aug 01 15:28:06 user nova-compute[72201]:   <os>
Aug 01 15:28:06 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:28:06 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:28:06 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:28:06 user nova-compute[72201]:   </os>
Aug 01 15:28:06 user nova-compute[72201]:   <features>
Aug 01 15:28:06 user nova-compute[72201]:     <acpi/>
Aug 01 15:28:06 user nova-compute[72201]:     <apic/>
Aug 01 15:28:06 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:28:06 user nova-compute[72201]:   </features>
Aug 01 15:28:06 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:28:06 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:28:06 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:28:06 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:28:06 user nova-compute[72201]:   </clock>
Aug 01 15:28:06 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:28:06 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:28:06 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:28:06 user nova-compute[72201]:   </cpu>
Aug 01 15:28:06 user nova-compute[72201]:   <devices>
Aug 01 15:28:06 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:28:06 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:28:06 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk"/>
Aug 01 15:28:06 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:28:06 user nova-compute[72201]:     </disk>
Aug 01 15:28:06 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:28:06 user nova-compute[72201]:       <mac address="fa:16:3e:89:dd:94"/>
Aug 01 15:28:06 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:28:06 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:28:06 user nova-compute[72201]:       <target dev="tap964ce05e-77"/>
Aug 01 15:28:06 user nova-compute[72201]:     </interface>
Aug 01 15:28:06 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:28:06 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/console.log" append="off"/>
Aug 01 15:28:06 user nova-compute[72201]:     </serial>
Aug 01 15:28:06 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:28:06 user nova-compute[72201]:     <video>
Aug 01 15:28:06 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:28:06 user nova-compute[72201]:     </video>
Aug 01 15:28:06 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:28:06 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:28:06 user nova-compute[72201]:     </rng>
Aug 01 15:28:06 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:28:06 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:28:06 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:28:06 user nova-compute[72201]:     </memballoon>
Aug 01 15:28:06 user nova-compute[72201]:   </devices>
Aug 01 15:28:06 user nova-compute[72201]: </domain>
Aug 01 15:28:06 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:28:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-332406940',display_name='tempest-TestMinimumBasicScenario-server-332406940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-332406940',id=24,image_ref='c0670c94-fd3d-443f-aebb-0738f9376cbd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKu5FlU96T/URWJekboP/5eG4GC0WsZVMcgk5ed4tw6gP/YNDChRwoCs90mgM9aN2gDeP6FbbX+sbTNMsNmfUCqRJxGlzieVVBtAcJhgTqQ3WKEz5W5LDJ3fG3+AZ0MRA==',key_name='tempest-TestMinimumBasicScenario-1343136448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5e1f59585b44545ae3ec0cdfa480fab',ramdisk_id='',reservation_id='r-eeuxjpbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c0670c94-fd3d-443f-aebb-0738f9376cbd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1524896067',owner_user_name='tempest-TestMinimumBasicScenario-1524896067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:28:02Z,user_data=None,user_id='2c5267b768cf46958384d9ad4c585f82',uuid=ed5f91f1-b3fd-4737-8ed6-fca13617bd6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "address": "fa:16:3e:89:dd:94", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964ce05e-77", "ovs_interfaceid": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Converting VIF {"id": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "address": "fa:16:3e:89:dd:94", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964ce05e-77", "ovs_interfaceid": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:dd:94,bridge_name='br-int',has_traffic_filtering=True,id=964ce05e-779d-4ccd-a19a-9c6832a9db28,network=Network(d1dbf82c-df93-48ae-b118-278943635ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap964ce05e-77') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG os_vif [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:dd:94,bridge_name='br-int',has_traffic_filtering=True,id=964ce05e-779d-4ccd-a19a-9c6832a9db28,network=Network(d1dbf82c-df93-48ae-b118-278943635ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap964ce05e-77') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap964ce05e-77, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap964ce05e-77, col_values=(('external_ids', {'iface-id': '964ce05e-779d-4ccd-a19a-9c6832a9db28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:dd:94', 'vm-uuid': 'ed5f91f1-b3fd-4737-8ed6-fca13617bd6e'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:06 user nova-compute[72201]: INFO os_vif [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:dd:94,bridge_name='br-int',has_traffic_filtering=True,id=964ce05e-779d-4ccd-a19a-9c6832a9db28,network=Network(d1dbf82c-df93-48ae-b118-278943635ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap964ce05e-77')
Aug 01 15:28:06 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] No VIF found with MAC fa:16:3e:89:dd:94, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG nova.network.neutron [req-68aacdc4-08eb-4c0f-adde-474774c946e4 req-5a316992-fbd4-4bee-879e-d57a4550a71b service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Updated VIF entry in instance network info cache for port 964ce05e-779d-4ccd-a19a-9c6832a9db28. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG nova.network.neutron [req-68aacdc4-08eb-4c0f-adde-474774c946e4 req-5a316992-fbd4-4bee-879e-d57a4550a71b service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Updating instance_info_cache with network_info: [{"id": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "address": "fa:16:3e:89:dd:94", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964ce05e-77", "ovs_interfaceid": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:28:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-68aacdc4-08eb-4c0f-adde-474774c946e4 req-5a316992-fbd4-4bee-879e-d57a4550a71b service nova] Releasing lock "refresh_cache-ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:28:07 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:28:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-df09daaf-ecaa-4337-9c1d-7d919a3a9c50 req-c863a879-69e4-4470-80d7-70b011e54c59 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received event network-vif-plugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:28:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-df09daaf-ecaa-4337-9c1d-7d919a3a9c50 req-c863a879-69e4-4470-80d7-70b011e54c59 service nova] Acquiring lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-df09daaf-ecaa-4337-9c1d-7d919a3a9c50 req-c863a879-69e4-4470-80d7-70b011e54c59 service nova] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-df09daaf-ecaa-4337-9c1d-7d919a3a9c50 req-c863a879-69e4-4470-80d7-70b011e54c59 service nova] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-df09daaf-ecaa-4337-9c1d-7d919a3a9c50 req-c863a879-69e4-4470-80d7-70b011e54c59 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] No waiting events found dispatching network-vif-plugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:28:07 user nova-compute[72201]: WARNING nova.compute.manager [req-df09daaf-ecaa-4337-9c1d-7d919a3a9c50 req-c863a879-69e4-4470-80d7-70b011e54c59 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received unexpected event network-vif-plugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 for instance with vm_state building and task_state spawning.
Aug 01 15:28:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:28:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:28:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:09 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:28:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:09 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:28:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:09 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903689.939876, ed5f91f1-b3fd-4737-8ed6-fca13617bd6e => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:28:09 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] VM Resumed (Lifecycle Event)
Aug 01 15:28:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:28:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:28:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-8e06bbf6-745c-4160-9644-2acd6a15f535 req-b2ccb5ff-dd5f-457c-bf92-acfe21f59379 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received event network-vif-plugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:28:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8e06bbf6-745c-4160-9644-2acd6a15f535 req-b2ccb5ff-dd5f-457c-bf92-acfe21f59379 service nova] Acquiring lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8e06bbf6-745c-4160-9644-2acd6a15f535 req-b2ccb5ff-dd5f-457c-bf92-acfe21f59379 service nova] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8e06bbf6-745c-4160-9644-2acd6a15f535 req-b2ccb5ff-dd5f-457c-bf92-acfe21f59379 service nova] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-8e06bbf6-745c-4160-9644-2acd6a15f535 req-b2ccb5ff-dd5f-457c-bf92-acfe21f59379 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] No waiting events found dispatching network-vif-plugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:28:09 user nova-compute[72201]: WARNING nova.compute.manager [req-8e06bbf6-745c-4160-9644-2acd6a15f535 req-b2ccb5ff-dd5f-457c-bf92-acfe21f59379 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received unexpected event network-vif-plugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 for instance with vm_state building and task_state spawning.
Aug 01 15:28:09 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Instance spawned successfully.
Aug 01 15:28:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:28:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:28:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:28:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:28:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:28:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:28:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:28:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:28:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:28:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:10 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:28:10 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903689.9402795, ed5f91f1-b3fd-4737-8ed6-fca13617bd6e => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:28:10 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] VM Started (Lifecycle Event)
Aug 01 15:28:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:28:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:28:10 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:28:10 user nova-compute[72201]: INFO nova.compute.manager [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Took 7.90 seconds to spawn the instance on the hypervisor.
Aug 01 15:28:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:28:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:10 user nova-compute[72201]: INFO nova.compute.manager [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Took 9.22 seconds to build instance.
Aug 01 15:28:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4e26004-dc02-4d00-aa7c-ba7a77b3693a tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.369s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:28:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:28:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:14 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:28:14 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:28:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=7236MB free_disk=25.436626434326172GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance b64f1cfb-64f2-4493-8721-fc63fcd93bb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e2ca19ea-868c-40ad-a453-f6e348cfac15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 0f059ccc-f609-4cf3-a644-c3d1305ae26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance d4146775-a271-4822-84ec-e723ff09c386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 865b371c-59c5-4004-8469-cdc1e9327ecb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 14e890ca-dc2a-4d89-a497-d55805d0c42e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 930bd7a5-5dbb-40a4-a51c-3340f9eb3626 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 4d307a58-226b-40dd-a548-e854cf761f57 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 9530577b-69a6-45bc-a33b-1dc60d69a16f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance ed5f91f1-b3fd-4737-8ed6-fca13617bd6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG nova.compute.manager [req-553b46cc-f8a9-4cba-b9c2-4ecdba3c2c7e req-c4612301-c948-4150-a08b-e57cf7ff7924 service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Received event network-changed-9067d464-7696-450e-bc4e-6ac29aec6c8f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG nova.compute.manager [req-553b46cc-f8a9-4cba-b9c2-4ecdba3c2c7e req-c4612301-c948-4150-a08b-e57cf7ff7924 service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Refreshing instance network info cache due to event network-changed-9067d464-7696-450e-bc4e-6ac29aec6c8f. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-553b46cc-f8a9-4cba-b9c2-4ecdba3c2c7e req-c4612301-c948-4150-a08b-e57cf7ff7924 service nova] Acquiring lock "refresh_cache-14e890ca-dc2a-4d89-a497-d55805d0c42e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-553b46cc-f8a9-4cba-b9c2-4ecdba3c2c7e req-c4612301-c948-4150-a08b-e57cf7ff7924 service nova] Acquired lock "refresh_cache-14e890ca-dc2a-4d89-a497-d55805d0c42e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG nova.network.neutron [req-553b46cc-f8a9-4cba-b9c2-4ecdba3c2c7e req-c4612301-c948-4150-a08b-e57cf7ff7924 service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Refreshing network info cache for port 9067d464-7696-450e-bc4e-6ac29aec6c8f {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.762s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "14e890ca-dc2a-4d89-a497-d55805d0c42e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "14e890ca-dc2a-4d89-a497-d55805d0c42e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG nova.objects.instance [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lazy-loading 'flavor' on Instance uuid 14e890ca-dc2a-4d89-a497-d55805d0c42e {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:28:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "14e890ca-dc2a-4d89-a497-d55805d0c42e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG nova.network.neutron [req-553b46cc-f8a9-4cba-b9c2-4ecdba3c2c7e req-c4612301-c948-4150-a08b-e57cf7ff7924 service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Updated VIF entry in instance network info cache for port 9067d464-7696-450e-bc4e-6ac29aec6c8f. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG nova.network.neutron [req-553b46cc-f8a9-4cba-b9c2-4ecdba3c2c7e req-c4612301-c948-4150-a08b-e57cf7ff7924 service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Updating instance_info_cache with network_info: [{"id": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "address": "fa:16:3e:af:9c:2f", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9067d464-76", "ovs_interfaceid": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-553b46cc-f8a9-4cba-b9c2-4ecdba3c2c7e req-c4612301-c948-4150-a08b-e57cf7ff7924 service nova] Releasing lock "refresh_cache-14e890ca-dc2a-4d89-a497-d55805d0c42e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "14e890ca-dc2a-4d89-a497-d55805d0c42e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "14e890ca-dc2a-4d89-a497-d55805d0c42e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:15 user nova-compute[72201]: INFO nova.compute.manager [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Attaching volume 97be081f-291d-401d-858e-31d9f257d5cd to /dev/vdb
Aug 01 15:28:15 user nova-compute[72201]: DEBUG os_brick.utils [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cf41f9-6c93-4c03-bae2-1c0e3b1a1980]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba371dd-7009-4630-ad82-f6ce250a7c8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d27bba-a7ce-4931-8920-30d54b16a8d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c342b1d-f7b1-45ec-9058-27ca23aef56c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:28:15 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:28:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1a7b94-6370-477e-bd9d-b94ad19b0fe8]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG os_brick.utils [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:28:15 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Updating existing volume attachment record: 80932a7a-0e84-469d-8ed8-6f4d7f2ad722 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:28:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBtRzFyX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:28:22 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:28:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:28:22 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:28:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:28:22 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:28:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fba3086-cff2-4b02-9fe7-05a3965f679a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:28:22 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd22c16f-0709-4a78-b885-71b66e4bd7ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd] added
Aug 01 15:28:22 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[030fa6db-f678-4213-aef5-c4be67e11431]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddac9d9-adbf-48b2-85ed-2e8a392653ca]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HBtRzFyX {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HBtRzFyX" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e12b71-0c0e-4356-9c4f-c2fd5ec1d92a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HBtRzFyX'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:28:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a22b2e4-90bf-47bf-99ee-737a67ac3f6f]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f061c17f-039d-4980-8232-ecc840ded662]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)
Aug 01 15:28:23 user nova-compute[72201]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:28:23 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)
Aug 01 15:28:23 user nova-compute[72201]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:28:23 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e7743d-3c91-4d75-bffe-3fa4192709c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd, portal: 172.16.0.220,3260]
Aug 01 15:28:23 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd, portal: 172.16.0.220,3260] successful.
Aug 01 15:28:23 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4bb7ff-a0c1-436d-a3ef-45cbde612820]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34259fd-cd60-491c-b6c1-b0d66ff280f0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)
Aug 01 15:28:23 user nova-compute[72201]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:28:23 user nova-compute[72201]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd (non-flash)
Aug 01 15:28:23 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)
Aug 01 15:28:23 user nova-compute[72201]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:28:23 user nova-compute[72201]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd (non-flash)
Aug 01 15:28:23 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37a5a03-f6a0-4b2a-bdb2-629a058baea4]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBtRzFyX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:28:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:28:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26463383236653865', 'path': '/dev/sdc'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:28:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463383236653865', 'path': '/dev/sdc'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:28:24 user nova-compute[72201]: DEBUG nova.objects.instance [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lazy-loading 'flavor' on Instance uuid 14e890ca-dc2a-4d89-a497-d55805d0c42e {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:28:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:28:24 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:28:24 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 15:28:24 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:28:24 user nova-compute[72201]:   <serial>97be081f-291d-401d-858e-31d9f257d5cd</serial>
Aug 01 15:28:24 user nova-compute[72201]: </disk>
Aug 01 15:28:24 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:28:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:28:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:28:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] No VIF found with MAC fa:16:3e:af:9c:2f, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:28:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-18701292-21c2-48ba-a778-7e03da927e20 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "14e890ca-dc2a-4d89-a497-d55805d0c42e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.856s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "d4146775-a271-4822-84ec-e723ff09c386" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "d4146775-a271-4822-84ec-e723ff09c386" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:26 user nova-compute[72201]: INFO nova.compute.manager [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Detaching volume a7926ddf-5dc3-4ef2-b393-14a3310bd64c
Aug 01 15:28:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:26 user nova-compute[72201]: INFO nova.virt.block_device [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Attempting to driver detach volume a7926ddf-5dc3-4ef2-b393-14a3310bd64c from mountpoint /dev/vdb
Aug 01 15:28:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Attempting to detach device vdb from instance d4146775-a271-4822-84ec-e723ff09c386 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:28:26 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:28:26 user nova-compute[72201]:   <source dev="/dev/sdd"/>
Aug 01 15:28:26 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:28:26 user nova-compute[72201]:   <serial>a7926ddf-5dc3-4ef2-b393-14a3310bd64c</serial>
Aug 01 15:28:26 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:28:26 user nova-compute[72201]: </disk>
Aug 01 15:28:26 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:28:26 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Successfully detached device vdb from instance d4146775-a271-4822-84ec-e723ff09c386 from the persistent domain config.
Aug 01 15:28:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d4146775-a271-4822-84ec-e723ff09c386 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:28:26 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:28:26 user nova-compute[72201]:   <source dev="/dev/sdd"/>
Aug 01 15:28:26 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:28:26 user nova-compute[72201]:   <serial>a7926ddf-5dc3-4ef2-b393-14a3310bd64c</serial>
Aug 01 15:28:26 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:28:26 user nova-compute[72201]: </disk>
Aug 01 15:28:26 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690903706.5840907, d4146775-a271-4822-84ec-e723ff09c386 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d4146775-a271-4822-84ec-e723ff09c386 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:28:26 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Successfully detached device vdb from instance d4146775-a271-4822-84ec-e723ff09c386 from the live domain config.
Aug 01 15:28:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGOkvyPc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:28:26 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:28:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea86e15-cec1-4fee-b742-8b227c8e551b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db59053-cacc-4bf1-8197-467f5d0975c8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)
Aug 01 15:28:26 user nova-compute[72201]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:28:26 user nova-compute[72201]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd (non-flash)
Aug 01 15:28:26 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c (non-flash)
Aug 01 15:28:26 user nova-compute[72201]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:28:26 user nova-compute[72201]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd (non-flash)
Aug 01 15:28:26 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc54414c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c'): ({'sdd'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Removing single pathed devices sdd {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[568c46f5-a9dc-48de-8395-456fb5bedbc9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a007ab4-ddeb-4169-83d1-22312590de6a]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Flushing IO for device /dev/sdd {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.076s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd52b0f-0642-4a79-ad04-04e135d3dbbb]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd5fa6b-234d-4e76-be6f-32aacc5ae3f3]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] SCSI volumes sdd have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[44471cb7-80e9-4ed8-ac48-63e7d2dda4be]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[02092e8e-a1f7-45e5-97ba-5f928293ceea]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c, portal: 172.16.0.220,3260]
Aug 01 15:28:26 user nova-compute[72201]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c, portal: 172.16.0.220,3260] successful.
Aug 01 15:28:26 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7926ddf-5dc3-4ef2-b393-14a3310bd64c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df38307-fb41-4e45-9b2e-41130a53eda7]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] <== disconnect_volume: return (377ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:28:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:28:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "14e890ca-dc2a-4d89-a497-d55805d0c42e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "14e890ca-dc2a-4d89-a497-d55805d0c42e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:27 user nova-compute[72201]: INFO nova.compute.manager [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Detaching volume 97be081f-291d-401d-858e-31d9f257d5cd
Aug 01 15:28:27 user nova-compute[72201]: INFO nova.virt.block_device [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Attempting to driver detach volume 97be081f-291d-401d-858e-31d9f257d5cd from mountpoint /dev/vdb
Aug 01 15:28:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Attempting to detach device vdb from instance 14e890ca-dc2a-4d89-a497-d55805d0c42e from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:28:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:28:27 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:28:27 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 15:28:27 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:28:27 user nova-compute[72201]:   <serial>97be081f-291d-401d-858e-31d9f257d5cd</serial>
Aug 01 15:28:27 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:28:27 user nova-compute[72201]: </disk>
Aug 01 15:28:27 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:28:27 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Successfully detached device vdb from instance 14e890ca-dc2a-4d89-a497-d55805d0c42e from the persistent domain config.
Aug 01 15:28:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 14e890ca-dc2a-4d89-a497-d55805d0c42e from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:28:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:28:27 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:28:27 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 15:28:27 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:28:27 user nova-compute[72201]:   <serial>97be081f-291d-401d-858e-31d9f257d5cd</serial>
Aug 01 15:28:27 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:28:27 user nova-compute[72201]: </disk>
Aug 01 15:28:27 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:28:27 user nova-compute[72201]: DEBUG nova.objects.instance [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lazy-loading 'flavor' on Instance uuid d4146775-a271-4822-84ec-e723ff09c386 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:28:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-fbbf7134-3594-4dec-ac4f-c202ef7fd528 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "d4146775-a271-4822-84ec-e723ff09c386" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.869s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690903708.0393066, 14e890ca-dc2a-4d89-a497-d55805d0c42e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 14e890ca-dc2a-4d89-a497-d55805d0c42e {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:28:28 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Successfully detached device vdb from instance 14e890ca-dc2a-4d89-a497-d55805d0c42e from the live domain config.
Aug 01 15:28:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBtRzFyX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:28:28 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:28:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[66624023-1963-4ebd-a16f-5dc3cd776929]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[08380eba-0911-4b25-a41a-63fab0e8b4c8]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:28:28 user nova-compute[72201]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd (non-flash)
Aug 01 15:28:28 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:28:28 user nova-compute[72201]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd (non-flash)
Aug 01 15:28:28 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c346b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd'): ({'sdc'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Removing single pathed devices sdc {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[449059eb-961d-4c33-b0ef-f5968fed6657]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9d96e7-f108-4aa6-8329-6f077e3f2e34]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Flushing IO for device /dev/sdc {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e97e5ee-6afd-4724-88c1-5f614fb802e2]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[827e5ca4-3ed6-4001-ba16-54e76e612ab7]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dff38c5-a333-46e8-90b6-fb186be59d49]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[740f00ab-66c3-413e-b959-08e9d88fd94c]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd, portal: 172.16.0.220,3260]
Aug 01 15:28:28 user nova-compute[72201]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd, portal: 172.16.0.220,3260] successful.
Aug 01 15:28:28 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97be081f-291d-401d-858e-31d9f257d5cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcd65fc-9def-4d07-b6ff-61fcc187e76e]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] <== disconnect_volume: return (276ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:28:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:29 user nova-compute[72201]: DEBUG nova.objects.instance [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lazy-loading 'flavor' on Instance uuid 14e890ca-dc2a-4d89-a497-d55805d0c42e {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:28:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4a8a7063-04da-4f09-9b16-8bed88ddb160 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "14e890ca-dc2a-4d89-a497-d55805d0c42e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.674s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:47 user nova-compute[72201]: DEBUG nova.compute.manager [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:28:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:48 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:28:48 user nova-compute[72201]: INFO nova.compute.claims [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Claim successful on node user
Aug 01 15:28:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:48 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:28:48 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:28:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:48 user nova-compute[72201]: DEBUG nova.compute.manager [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:28:48 user nova-compute[72201]: DEBUG nova.compute.manager [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:28:48 user nova-compute[72201]: DEBUG nova.network.neutron [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:28:48 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:28:48 user nova-compute[72201]: DEBUG nova.compute.manager [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:28:48 user nova-compute[72201]: DEBUG nova.policy [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31a432c1165e4ff4a9a10b4d71ddc513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f130c48f19cf4ab7803c1169b759ccb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:28:48 user nova-compute[72201]: DEBUG nova.compute.manager [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:28:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:28:48 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Creating image(s)
Aug 01 15:28:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "/opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "/opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.131s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk 1073741824" returned: 0 in 0.048s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.132s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:49 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:28:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:28:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:28:49 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Cannot resize image /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:28:49 user nova-compute[72201]: DEBUG nova.objects.instance [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'migration_context' on Instance uuid 9e946b4a-9b93-459f-8e5e-d88612c4ec34 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:28:49 user nova-compute[72201]: DEBUG nova.network.neutron [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Successfully created port: 983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:28:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:28:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Ensure instance console log exists: /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:28:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.network.neutron [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Successfully updated port: 983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "refresh_cache-9e946b4a-9b93-459f-8e5e-d88612c4ec34" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquired lock "refresh_cache-9e946b4a-9b93-459f-8e5e-d88612c4ec34" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.network.neutron [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-7fdca34e-ac96-4213-95fe-5207fc449d6f req-a062e514-5826-4218-ae3a-deb31fe18f32 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received event network-changed-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-7fdca34e-ac96-4213-95fe-5207fc449d6f req-a062e514-5826-4218-ae3a-deb31fe18f32 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Refreshing instance network info cache due to event network-changed-983acc56-f35e-463b-9792-e837ce96710d. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7fdca34e-ac96-4213-95fe-5207fc449d6f req-a062e514-5826-4218-ae3a-deb31fe18f32 service nova] Acquiring lock "refresh_cache-9e946b4a-9b93-459f-8e5e-d88612c4ec34" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.network.neutron [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.network.neutron [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Updating instance_info_cache with network_info: [{"id": "983acc56-f35e-463b-9792-e837ce96710d", "address": "fa:16:3e:28:f5:cf", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983acc56-f3", "ovs_interfaceid": "983acc56-f35e-463b-9792-e837ce96710d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Releasing lock "refresh_cache-9e946b4a-9b93-459f-8e5e-d88612c4ec34" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Instance network_info: |[{"id": "983acc56-f35e-463b-9792-e837ce96710d", "address": "fa:16:3e:28:f5:cf", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983acc56-f3", "ovs_interfaceid": "983acc56-f35e-463b-9792-e837ce96710d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7fdca34e-ac96-4213-95fe-5207fc449d6f req-a062e514-5826-4218-ae3a-deb31fe18f32 service nova] Acquired lock "refresh_cache-9e946b4a-9b93-459f-8e5e-d88612c4ec34" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.network.neutron [req-7fdca34e-ac96-4213-95fe-5207fc449d6f req-a062e514-5826-4218-ae3a-deb31fe18f32 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Refreshing network info cache for port 983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Start _get_guest_xml network_info=[{"id": "983acc56-f35e-463b-9792-e837ce96710d", "address": "fa:16:3e:28:f5:cf", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983acc56-f3", "ovs_interfaceid": "983acc56-f35e-463b-9792-e837ce96710d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:28:50 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:28:50 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1814665883',display_name='tempest-ServerRescueNegativeTestJSON-server-1814665883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1814665883',id=25,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5njYzs7ALDcBWQSpVvDF+8eqtD/Nud28PRDonSHT12d1GA4E+ONV1w236vrdEKCSPLvrSiG9PlbH87hDgkoI2dCf1VNNLJnIgp5Ae3jA2xzUAVN6UK1g1BY7za6MohKg==',key_name='tempest-keypair-1891226028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f130c48f19cf4ab7803c1169b759ccb6',ramdisk_id='',reservation_id='r-d77b8fyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-773079660',owner_user_name='tempest-ServerRescueNegativeTestJSON-773079660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:28:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a432c1165e4ff4a9a10b4d71ddc513',uuid=9e946b4a-9b93-459f-8e5e-d88612c4ec34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "983acc56-f35e-463b-9792-e837ce96710d", "address": "fa:16:3e:28:f5:cf", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983acc56-f3", "ovs_interfaceid": "983acc56-f35e-463b-9792-e837ce96710d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converting VIF {"id": "983acc56-f35e-463b-9792-e837ce96710d", "address": "fa:16:3e:28:f5:cf", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983acc56-f3", "ovs_interfaceid": "983acc56-f35e-463b-9792-e837ce96710d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:f5:cf,bridge_name='br-int',has_traffic_filtering=True,id=983acc56-f35e-463b-9792-e837ce96710d,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983acc56-f3') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.objects.instance [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e946b4a-9b93-459f-8e5e-d88612c4ec34 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:28:50 user nova-compute[72201]:   <uuid>9e946b4a-9b93-459f-8e5e-d88612c4ec34</uuid>
Aug 01 15:28:50 user nova-compute[72201]:   <name>instance-00000019</name>
Aug 01 15:28:50 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:28:50 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:28:50 user nova-compute[72201]:   <metadata>
Aug 01 15:28:50 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:28:50 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:28:50 user nova-compute[72201]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1814665883</nova:name>
Aug 01 15:28:50 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:28:50</nova:creationTime>
Aug 01 15:28:50 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:28:50 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:28:50 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:28:50 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:28:50 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:28:50 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:28:50 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:28:50 user nova-compute[72201]:       <nova:owner>
Aug 01 15:28:50 user nova-compute[72201]:         <nova:user uuid="31a432c1165e4ff4a9a10b4d71ddc513">tempest-ServerRescueNegativeTestJSON-773079660-project-member</nova:user>
Aug 01 15:28:50 user nova-compute[72201]:         <nova:project uuid="f130c48f19cf4ab7803c1169b759ccb6">tempest-ServerRescueNegativeTestJSON-773079660</nova:project>
Aug 01 15:28:50 user nova-compute[72201]:       </nova:owner>
Aug 01 15:28:50 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:28:50 user nova-compute[72201]:       <nova:ports>
Aug 01 15:28:50 user nova-compute[72201]:         <nova:port uuid="983acc56-f35e-463b-9792-e837ce96710d">
Aug 01 15:28:50 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 15:28:50 user nova-compute[72201]:         </nova:port>
Aug 01 15:28:50 user nova-compute[72201]:       </nova:ports>
Aug 01 15:28:50 user nova-compute[72201]:     </nova:instance>
Aug 01 15:28:50 user nova-compute[72201]:   </metadata>
Aug 01 15:28:50 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:28:50 user nova-compute[72201]:     <system>
Aug 01 15:28:50 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:28:50 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:28:50 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:28:50 user nova-compute[72201]:       <entry name="serial">9e946b4a-9b93-459f-8e5e-d88612c4ec34</entry>
Aug 01 15:28:50 user nova-compute[72201]:       <entry name="uuid">9e946b4a-9b93-459f-8e5e-d88612c4ec34</entry>
Aug 01 15:28:50 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:28:50 user nova-compute[72201]:     </system>
Aug 01 15:28:50 user nova-compute[72201]:   </sysinfo>
Aug 01 15:28:50 user nova-compute[72201]:   <os>
Aug 01 15:28:50 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:28:50 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:28:50 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:28:50 user nova-compute[72201]:   </os>
Aug 01 15:28:50 user nova-compute[72201]:   <features>
Aug 01 15:28:50 user nova-compute[72201]:     <acpi/>
Aug 01 15:28:50 user nova-compute[72201]:     <apic/>
Aug 01 15:28:50 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:28:50 user nova-compute[72201]:   </features>
Aug 01 15:28:50 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:28:50 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:28:50 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:28:50 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:28:50 user nova-compute[72201]:   </clock>
Aug 01 15:28:50 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:28:50 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:28:50 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:28:50 user nova-compute[72201]:   </cpu>
Aug 01 15:28:50 user nova-compute[72201]:   <devices>
Aug 01 15:28:50 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:28:50 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:28:50 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk"/>
Aug 01 15:28:50 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:28:50 user nova-compute[72201]:     </disk>
Aug 01 15:28:50 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:28:50 user nova-compute[72201]:       <mac address="fa:16:3e:28:f5:cf"/>
Aug 01 15:28:50 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:28:50 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:28:50 user nova-compute[72201]:       <target dev="tap983acc56-f3"/>
Aug 01 15:28:50 user nova-compute[72201]:     </interface>
Aug 01 15:28:50 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:28:50 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/console.log" append="off"/>
Aug 01 15:28:50 user nova-compute[72201]:     </serial>
Aug 01 15:28:50 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:28:50 user nova-compute[72201]:     <video>
Aug 01 15:28:50 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:28:50 user nova-compute[72201]:     </video>
Aug 01 15:28:50 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:28:50 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:28:50 user nova-compute[72201]:     </rng>
Aug 01 15:28:50 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:28:50 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:28:50 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:28:50 user nova-compute[72201]:     </memballoon>
Aug 01 15:28:50 user nova-compute[72201]:   </devices>
Aug 01 15:28:50 user nova-compute[72201]: </domain>
Aug 01 15:28:50 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1814665883',display_name='tempest-ServerRescueNegativeTestJSON-server-1814665883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1814665883',id=25,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5njYzs7ALDcBWQSpVvDF+8eqtD/Nud28PRDonSHT12d1GA4E+ONV1w236vrdEKCSPLvrSiG9PlbH87hDgkoI2dCf1VNNLJnIgp5Ae3jA2xzUAVN6UK1g1BY7za6MohKg==',key_name='tempest-keypair-1891226028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f130c48f19cf4ab7803c1169b759ccb6',ramdisk_id='',reservation_id='r-d77b8fyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-773079660',owner_user_name='tempest-ServerRescueNegativeTestJSON-773079660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:28:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a432c1165e4ff4a9a10b4d71ddc513',uuid=9e946b4a-9b93-459f-8e5e-d88612c4ec34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "983acc56-f35e-463b-9792-e837ce96710d", "address": "fa:16:3e:28:f5:cf", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983acc56-f3", "ovs_interfaceid": "983acc56-f35e-463b-9792-e837ce96710d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converting VIF {"id": "983acc56-f35e-463b-9792-e837ce96710d", "address": "fa:16:3e:28:f5:cf", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983acc56-f3", "ovs_interfaceid": "983acc56-f35e-463b-9792-e837ce96710d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:f5:cf,bridge_name='br-int',has_traffic_filtering=True,id=983acc56-f35e-463b-9792-e837ce96710d,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983acc56-f3') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG os_vif [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:f5:cf,bridge_name='br-int',has_traffic_filtering=True,id=983acc56-f35e-463b-9792-e837ce96710d,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983acc56-f3') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap983acc56-f3, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap983acc56-f3, col_values=(('external_ids', {'iface-id': '983acc56-f35e-463b-9792-e837ce96710d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:f5:cf', 'vm-uuid': '9e946b4a-9b93-459f-8e5e-d88612c4ec34'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:50 user nova-compute[72201]: INFO os_vif [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:f5:cf,bridge_name='br-int',has_traffic_filtering=True,id=983acc56-f35e-463b-9792-e837ce96710d,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983acc56-f3')
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:28:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] No VIF found with MAC fa:16:3e:28:f5:cf, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:28:51 user nova-compute[72201]: DEBUG nova.network.neutron [req-7fdca34e-ac96-4213-95fe-5207fc449d6f req-a062e514-5826-4218-ae3a-deb31fe18f32 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Updated VIF entry in instance network info cache for port 983acc56-f35e-463b-9792-e837ce96710d. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:28:51 user nova-compute[72201]: DEBUG nova.network.neutron [req-7fdca34e-ac96-4213-95fe-5207fc449d6f req-a062e514-5826-4218-ae3a-deb31fe18f32 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Updating instance_info_cache with network_info: [{"id": "983acc56-f35e-463b-9792-e837ce96710d", "address": "fa:16:3e:28:f5:cf", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983acc56-f3", "ovs_interfaceid": "983acc56-f35e-463b-9792-e837ce96710d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:28:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7fdca34e-ac96-4213-95fe-5207fc449d6f req-a062e514-5826-4218-ae3a-deb31fe18f32 service nova] Releasing lock "refresh_cache-9e946b4a-9b93-459f-8e5e-d88612c4ec34" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:28:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:52 user nova-compute[72201]: DEBUG nova.compute.manager [req-34370b7f-bee0-4d6c-8b6f-96e982851e69 req-6fd5ccc9-9198-440d-a2f8-06ea3b8ab8c2 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received event network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:28:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-34370b7f-bee0-4d6c-8b6f-96e982851e69 req-6fd5ccc9-9198-440d-a2f8-06ea3b8ab8c2 service nova] Acquiring lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-34370b7f-bee0-4d6c-8b6f-96e982851e69 req-6fd5ccc9-9198-440d-a2f8-06ea3b8ab8c2 service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-34370b7f-bee0-4d6c-8b6f-96e982851e69 req-6fd5ccc9-9198-440d-a2f8-06ea3b8ab8c2 service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:52 user nova-compute[72201]: DEBUG nova.compute.manager [req-34370b7f-bee0-4d6c-8b6f-96e982851e69 req-6fd5ccc9-9198-440d-a2f8-06ea3b8ab8c2 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] No waiting events found dispatching network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:28:52 user nova-compute[72201]: WARNING nova.compute.manager [req-34370b7f-bee0-4d6c-8b6f-96e982851e69 req-6fd5ccc9-9198-440d-a2f8-06ea3b8ab8c2 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received unexpected event network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d for instance with vm_state building and task_state spawning.
Aug 01 15:28:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:28:54 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903734.3667772, 9e946b4a-9b93-459f-8e5e-d88612c4ec34 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:28:54 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] VM Resumed (Lifecycle Event)
Aug 01 15:28:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:28:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:28:54 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Instance spawned successfully.
Aug 01 15:28:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:28:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:28:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:28:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:28:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:28:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:28:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:28:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:28:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:28:54 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:28:54 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903734.370609, 9e946b4a-9b93-459f-8e5e-d88612c4ec34 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:28:54 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] VM Started (Lifecycle Event)
Aug 01 15:28:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:28:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:28:54 user nova-compute[72201]: INFO nova.compute.manager [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Took 5.70 seconds to spawn the instance on the hypervisor.
Aug 01 15:28:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:28:54 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:28:54 user nova-compute[72201]: DEBUG nova.compute.manager [req-5c7db836-50d8-4b70-bf92-68393ab8f0ea req-6a08aeb0-df40-43dd-9ccb-153a5cda1237 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received event network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:28:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5c7db836-50d8-4b70-bf92-68393ab8f0ea req-6a08aeb0-df40-43dd-9ccb-153a5cda1237 service nova] Acquiring lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:28:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5c7db836-50d8-4b70-bf92-68393ab8f0ea req-6a08aeb0-df40-43dd-9ccb-153a5cda1237 service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:28:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5c7db836-50d8-4b70-bf92-68393ab8f0ea req-6a08aeb0-df40-43dd-9ccb-153a5cda1237 service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:54 user nova-compute[72201]: DEBUG nova.compute.manager [req-5c7db836-50d8-4b70-bf92-68393ab8f0ea req-6a08aeb0-df40-43dd-9ccb-153a5cda1237 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] No waiting events found dispatching network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:28:54 user nova-compute[72201]: WARNING nova.compute.manager [req-5c7db836-50d8-4b70-bf92-68393ab8f0ea req-6a08aeb0-df40-43dd-9ccb-153a5cda1237 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received unexpected event network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d for instance with vm_state building and task_state spawning.
Aug 01 15:28:54 user nova-compute[72201]: INFO nova.compute.manager [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Took 6.51 seconds to build instance.
Aug 01 15:28:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-160157d4-5692-4428-8120-0706ed6c9731 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.646s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:28:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:29:01 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:29:01 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:29:02 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:29:02 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:29:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-0f059ccc-f609-4cf3-a644-c3d1305ae26e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:29:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-0f059ccc-f609-4cf3-a644-c3d1305ae26e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:29:02 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:29:02 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Updating instance_info_cache with network_info: [{"id": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "address": "fa:16:3e:2d:e0:8c", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1fc053-fd", "ovs_interfaceid": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:29:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-0f059ccc-f609-4cf3-a644-c3d1305ae26e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:29:02 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG nova.objects.instance [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lazy-loading 'flavor' on Instance uuid 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "bd70360d-30b8-47d5-b35e-adf0d28482dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:05 user nova-compute[72201]: INFO nova.compute.manager [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Attaching volume 8f263670-c9fb-4506-980a-810ff56314a0 to /dev/vdb
Aug 01 15:29:05 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG os_brick.utils [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccc0ad1-8a39-4ce0-a53b-4e81a73982b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:29:05 user nova-compute[72201]: INFO nova.compute.claims [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Claim successful on node user
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d36c0b-c91d-420b-8086-286721acef33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[00199ab3-037b-4a88-837e-a107cff11791]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3cb300-98e6-4c1a-a910-7c28cf9fc21d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:29:05 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd88f42-e764-4adc-a657-b364efa53085]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG os_brick.utils [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Updating existing volume attachment record: a81bcc69-4c92-4057-b8b0-d78a8312c996 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:05 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:29:06 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:29:06 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:29:06 user nova-compute[72201]: INFO nova.virt.block_device [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Booting with volume a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 at /dev/vda
Aug 01 15:29:06 user nova-compute[72201]: DEBUG nova.policy [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ccd18b99219749fe8febdc0da8fc4388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85c7d5f159c4ff2896b5549cf73b977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG os_brick.utils [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8aaf789-15ac-459c-889b-0a1b2d0cd989]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c80053-ebb3-4548-9b78-9bb36902f139]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d705ec-5586-4e11-b4ed-4dae5ebacac3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b150db73-cd3f-4d0a-ab9b-f7bfe3d94185]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:29:06 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:29:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[35905700-339a-425a-a423-7412218ac392]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG os_brick.utils [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:29:06 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Updating existing volume attachment record: 19a0391b-fe1c-4f0f-b4af-6af50d865a52 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:29:07 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Successfully created port: 9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:29:07 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Successfully updated port: 9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:29:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "refresh_cache-bd70360d-30b8-47d5-b35e-adf0d28482dd" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:29:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquired lock "refresh_cache-bd70360d-30b8-47d5-b35e-adf0d28482dd" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:29:07 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:29:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-5d87b7ed-469e-41ab-8a5f-d8a3c4834f67 req-077447e9-76cf-435d-be76-bc93865e3048 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Received event network-changed-9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-5d87b7ed-469e-41ab-8a5f-d8a3c4834f67 req-077447e9-76cf-435d-be76-bc93865e3048 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Refreshing instance network info cache due to event network-changed-9640f8a6-86a4-403c-9dac-06c68368d6dd. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:29:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5d87b7ed-469e-41ab-8a5f-d8a3c4834f67 req-077447e9-76cf-435d-be76-bc93865e3048 service nova] Acquiring lock "refresh_cache-bd70360d-30b8-47d5-b35e-adf0d28482dd" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:29:08 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:29:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:29:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:29:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:29:08 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Updating instance_info_cache with network_info: [{"id": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "address": "fa:16:3e:9c:ca:83", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9640f8a6-86", "ovs_interfaceid": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:29:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Releasing lock "refresh_cache-bd70360d-30b8-47d5-b35e-adf0d28482dd" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:29:08 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Instance network_info: |[{"id": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "address": "fa:16:3e:9c:ca:83", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9640f8a6-86", "ovs_interfaceid": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:29:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5d87b7ed-469e-41ab-8a5f-d8a3c4834f67 req-077447e9-76cf-435d-be76-bc93865e3048 service nova] Acquired lock "refresh_cache-bd70360d-30b8-47d5-b35e-adf0d28482dd" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:29:08 user nova-compute[72201]: DEBUG nova.network.neutron [req-5d87b7ed-469e-41ab-8a5f-d8a3c4834f67 req-077447e9-76cf-435d-be76-bc93865e3048 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Refreshing network info cache for port 9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:29:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:08 user nova-compute[72201]: DEBUG nova.network.neutron [req-5d87b7ed-469e-41ab-8a5f-d8a3c4834f67 req-077447e9-76cf-435d-be76-bc93865e3048 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Updated VIF entry in instance network info cache for port 9640f8a6-86a4-403c-9dac-06c68368d6dd. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:29:08 user nova-compute[72201]: DEBUG nova.network.neutron [req-5d87b7ed-469e-41ab-8a5f-d8a3c4834f67 req-077447e9-76cf-435d-be76-bc93865e3048 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Updating instance_info_cache with network_info: [{"id": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "address": "fa:16:3e:9c:ca:83", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9640f8a6-86", "ovs_interfaceid": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:29:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5d87b7ed-469e-41ab-8a5f-d8a3c4834f67 req-077447e9-76cf-435d-be76-bc93865e3048 service nova] Releasing lock "refresh_cache-bd70360d-30b8-47d5-b35e-adf0d28482dd" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:29:09 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:29:10 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:29:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.003s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:29:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLisTgOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:29:13 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:29:13 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:29:13 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c948ad9-c5ee-4f71-9494-5859d7a04318]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:29:13 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a73907-7327-41e6-860f-5154a354b9d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0] added
Aug 01 15:29:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e05eeb-62bf-44b4-b78e-bce4171a505c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7766b679-11c0-40ea-8504-be3f2ec9e6f7]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CLisTgOB {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CLisTgOB" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed89eec5-0284-4942-9659-cf072df19bec]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CLisTgOB'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2664aca-54b1-4f5e-bdb5-8b3451c24f45]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6429f6c9-b371-4e50-a5d1-c7f340065424]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:29:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:29:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e73a945-b84f-4d52-af35-1d3a82c1787e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0, portal: 172.16.0.220,3260]
Aug 01 15:29:13 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0, portal: 172.16.0.220,3260] successful.
Aug 01 15:29:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5a207b-5934-4f95-9833-d71eac25658c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[096b16cf-4c19-428f-b4a0-23a8f6f73879]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:29:13 user nova-compute[72201]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:29:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:29:13 user nova-compute[72201]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:29:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f6220e-4059-45ed-964e-ec25f576f2e3]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLisTgOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:14 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:29:14 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:29:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=6834MB free_disk=25.340923309326172GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance b64f1cfb-64f2-4493-8721-fc63fcd93bb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e2ca19ea-868c-40ad-a453-f6e348cfac15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 0f059ccc-f609-4cf3-a644-c3d1305ae26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance d4146775-a271-4822-84ec-e723ff09c386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 865b371c-59c5-4004-8469-cdc1e9327ecb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 14e890ca-dc2a-4d89-a497-d55805d0c42e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 930bd7a5-5dbb-40a4-a51c-3340f9eb3626 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 4d307a58-226b-40dd-a548-e854cf761f57 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 9530577b-69a6-45bc-a33b-1dc60d69a16f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance ed5f91f1-b3fd-4737-8ed6-fca13617bd6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 9e946b4a-9b93-459f-8e5e-d88612c4ec34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance bd70360d-30b8-47d5-b35e-adf0d28482dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '23035343634313632', 'path': '/dev/sdc'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035343634313632', 'path': '/dev/sdc'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG nova.objects.instance [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lazy-loading 'flavor' on Instance uuid 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:29:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:29:14 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:29:14 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 15:29:14 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:29:14 user nova-compute[72201]:   <serial>8f263670-c9fb-4506-980a-810ff56314a0</serial>
Aug 01 15:29:14 user nova-compute[72201]: </disk>
Aug 01 15:29:14 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.595s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:29:15 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Creating image(s)
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Did not create local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Ensure instance console log exists: /opt/stack/data/nova/instances/bd70360d-30b8-47d5-b35e-adf0d28482dd/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Start _get_guest_xml network_info=[{"id": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "address": "fa:16:3e:9c:ca:83", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9640f8a6-86", "ovs_interfaceid": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SJcMhgkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bd70360d-30b8-47d5-b35e-adf0d28482dd', 'attached_at': '', 'detached_at': '', 'volume_id': 'a3fc5574-1c65-46a3-9e0b-85f222ac4cb7', 'serial': 'a3fc5574-1c65-46a3-9e0b-85f222ac4cb7'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '19a0391b-fe1c-4f0f-b4af-6af50d865a52', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:29:15 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:29:15 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SJcMhgkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:29:15 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:29:15 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:29:15 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[332552ed-7cad-4a91-913f-cf7b9bd645c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:29:15 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[319e2991-455e-4178-ba1d-c16ecb1cf9af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7] added
Aug 01 15:29:15 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] No VIF found with MAC fa:16:3e:49:45:f6, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[757d6c15-ab2f-447d-b52b-7e3c962f9e91]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5f68a2-7c5d-40f3-bcde-0f2814068f02]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SJcMhgkx {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SJcMhgkx" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf18268-248c-4961-bfbd-201aaa5dce79]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SJcMhgkx'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b026de-74ef-4ccd-bc5c-1c803a2f6ca4]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffa5fa9-8e23-4b00-9130-5fede3141bcd]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:29:15 user nova-compute[72201]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:29:15 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:29:15 user nova-compute[72201]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:29:15 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-fad7095b-32f7-45bf-9264-664272b4d557 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.172s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[debc5cf2-5e00-47cf-8e13-d2a2e6f950c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7, portal: 172.16.0.220,3260]
Aug 01 15:29:15 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7, portal: 172.16.0.220,3260] successful.
Aug 01 15:29:15 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17848fc-7fd9-4ed5-b005-8b30395de9f6]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48c3197-34b7-4177-b57c-bfd25d8d1457]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:29:15 user nova-compute[72201]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:29:15 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:29:15 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:29:15 user nova-compute[72201]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:29:15 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:29:15 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac095d2-faf7-4b42-9a97-193da23c71fc]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: None {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:29:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "d4146775-a271-4822-84ec-e723ff09c386" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "d4146775-a271-4822-84ec-e723ff09c386" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "d4146775-a271-4822-84ec-e723ff09c386-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "d4146775-a271-4822-84ec-e723ff09c386-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "d4146775-a271-4822-84ec-e723ff09c386-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:16 user nova-compute[72201]: INFO nova.compute.manager [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Terminating instance
Aug 01 15:29:16 user nova-compute[72201]: DEBUG nova.compute.manager [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:29:16 user nova-compute[72201]: INFO nova.compute.manager [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Rescuing
Aug 01 15:29:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquired lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SJcMhgkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23832633431386438', 'path': '/dev/sdd'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832633431386438', 'path': '/dev/sdd'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-831320262',display_name='tempest-ServerActionsTestOtherA-server-831320262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-831320262',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj9M7ZGdr6vvGAAN6LlX0Yd4KFWs7o7dSiIrZzG0de25MryOgdU0IQWkOsGcYGYZLChUKVpEI60JU+ZGbYHXhk4M5ia3Yx+QGjlFCbCEmncodiyKPCipVQmd8JPh2FoTg==',key_name='tempest-keypair-1499887671',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e85c7d5f159c4ff2896b5549cf73b977',ramdisk_id='',reservation_id='r-ce52lrt8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-765053637',owner_user_name='tempest-ServerActionsTestOtherA-765053637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ccd18b99219749fe8febdc0da8fc4388',uuid=bd70360d-30b8-47d5-b35e-adf0d28482dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "address": "fa:16:3e:9c:ca:83", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9640f8a6-86", "ovs_interfaceid": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converting VIF {"id": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "address": "fa:16:3e:9c:ca:83", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9640f8a6-86", "ovs_interfaceid": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:ca:83,bridge_name='br-int',has_traffic_filtering=True,id=9640f8a6-86a4-403c-9dac-06c68368d6dd,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9640f8a6-86') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lazy-loading 'pci_devices' on Instance uuid bd70360d-30b8-47d5-b35e-adf0d28482dd {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:29:16 user nova-compute[72201]:   <uuid>bd70360d-30b8-47d5-b35e-adf0d28482dd</uuid>
Aug 01 15:29:16 user nova-compute[72201]:   <name>instance-0000001a</name>
Aug 01 15:29:16 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:29:16 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:29:16 user nova-compute[72201]:   <metadata>
Aug 01 15:29:16 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:29:16 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:29:16 user nova-compute[72201]:       <nova:name>tempest-ServerActionsTestOtherA-server-831320262</nova:name>
Aug 01 15:29:16 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:29:15</nova:creationTime>
Aug 01 15:29:16 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:29:16 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:29:16 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:29:16 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:29:16 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:29:16 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:29:16 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:29:16 user nova-compute[72201]:       <nova:owner>
Aug 01 15:29:16 user nova-compute[72201]:         <nova:user uuid="ccd18b99219749fe8febdc0da8fc4388">tempest-ServerActionsTestOtherA-765053637-project-member</nova:user>
Aug 01 15:29:16 user nova-compute[72201]:         <nova:project uuid="e85c7d5f159c4ff2896b5549cf73b977">tempest-ServerActionsTestOtherA-765053637</nova:project>
Aug 01 15:29:16 user nova-compute[72201]:       </nova:owner>
Aug 01 15:29:16 user nova-compute[72201]:       <nova:ports>
Aug 01 15:29:16 user nova-compute[72201]:         <nova:port uuid="9640f8a6-86a4-403c-9dac-06c68368d6dd">
Aug 01 15:29:16 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 15:29:16 user nova-compute[72201]:         </nova:port>
Aug 01 15:29:16 user nova-compute[72201]:       </nova:ports>
Aug 01 15:29:16 user nova-compute[72201]:     </nova:instance>
Aug 01 15:29:16 user nova-compute[72201]:   </metadata>
Aug 01 15:29:16 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:29:16 user nova-compute[72201]:     <system>
Aug 01 15:29:16 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:29:16 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:29:16 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:29:16 user nova-compute[72201]:       <entry name="serial">bd70360d-30b8-47d5-b35e-adf0d28482dd</entry>
Aug 01 15:29:16 user nova-compute[72201]:       <entry name="uuid">bd70360d-30b8-47d5-b35e-adf0d28482dd</entry>
Aug 01 15:29:16 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:29:16 user nova-compute[72201]:     </system>
Aug 01 15:29:16 user nova-compute[72201]:   </sysinfo>
Aug 01 15:29:16 user nova-compute[72201]:   <os>
Aug 01 15:29:16 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:29:16 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:29:16 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:29:16 user nova-compute[72201]:   </os>
Aug 01 15:29:16 user nova-compute[72201]:   <features>
Aug 01 15:29:16 user nova-compute[72201]:     <acpi/>
Aug 01 15:29:16 user nova-compute[72201]:     <apic/>
Aug 01 15:29:16 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:29:16 user nova-compute[72201]:   </features>
Aug 01 15:29:16 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:29:16 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:29:16 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:29:16 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:29:16 user nova-compute[72201]:   </clock>
Aug 01 15:29:16 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:29:16 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:29:16 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:29:16 user nova-compute[72201]:   </cpu>
Aug 01 15:29:16 user nova-compute[72201]:   <devices>
Aug 01 15:29:16 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:29:16 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:29:16 user nova-compute[72201]:       <source dev="/dev/sdd"/>
Aug 01 15:29:16 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:29:16 user nova-compute[72201]:       <serial>a3fc5574-1c65-46a3-9e0b-85f222ac4cb7</serial>
Aug 01 15:29:16 user nova-compute[72201]:     </disk>
Aug 01 15:29:16 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:29:16 user nova-compute[72201]:       <mac address="fa:16:3e:9c:ca:83"/>
Aug 01 15:29:16 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:29:16 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:29:16 user nova-compute[72201]:       <target dev="tap9640f8a6-86"/>
Aug 01 15:29:16 user nova-compute[72201]:     </interface>
Aug 01 15:29:16 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:29:16 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/bd70360d-30b8-47d5-b35e-adf0d28482dd/console.log" append="off"/>
Aug 01 15:29:16 user nova-compute[72201]:     </serial>
Aug 01 15:29:16 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:29:16 user nova-compute[72201]:     <video>
Aug 01 15:29:16 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:29:16 user nova-compute[72201]:     </video>
Aug 01 15:29:16 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:29:16 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:29:16 user nova-compute[72201]:     </rng>
Aug 01 15:29:16 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:29:16 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:29:16 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:29:16 user nova-compute[72201]:     </memballoon>
Aug 01 15:29:16 user nova-compute[72201]:   </devices>
Aug 01 15:29:16 user nova-compute[72201]: </domain>
Aug 01 15:29:16 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-831320262',display_name='tempest-ServerActionsTestOtherA-server-831320262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-831320262',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj9M7ZGdr6vvGAAN6LlX0Yd4KFWs7o7dSiIrZzG0de25MryOgdU0IQWkOsGcYGYZLChUKVpEI60JU+ZGbYHXhk4M5ia3Yx+QGjlFCbCEmncodiyKPCipVQmd8JPh2FoTg==',key_name='tempest-keypair-1499887671',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e85c7d5f159c4ff2896b5549cf73b977',ramdisk_id='',reservation_id='r-ce52lrt8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-765053637',owner_user_name='tempest-ServerActionsTestOtherA-765053637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ccd18b99219749fe8febdc0da8fc4388',uuid=bd70360d-30b8-47d5-b35e-adf0d28482dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "address": "fa:16:3e:9c:ca:83", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9640f8a6-86", "ovs_interfaceid": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converting VIF {"id": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "address": "fa:16:3e:9c:ca:83", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9640f8a6-86", "ovs_interfaceid": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:ca:83,bridge_name='br-int',has_traffic_filtering=True,id=9640f8a6-86a4-403c-9dac-06c68368d6dd,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9640f8a6-86') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG os_vif [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:ca:83,bridge_name='br-int',has_traffic_filtering=True,id=9640f8a6-86a4-403c-9dac-06c68368d6dd,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9640f8a6-86') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9640f8a6-86, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9640f8a6-86, col_values=(('external_ids', {'iface-id': '9640f8a6-86a4-403c-9dac-06c68368d6dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:ca:83', 'vm-uuid': 'bd70360d-30b8-47d5-b35e-adf0d28482dd'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:16 user nova-compute[72201]: INFO os_vif [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:ca:83,bridge_name='br-int',has_traffic_filtering=True,id=9640f8a6-86a4-403c-9dac-06c68368d6dd,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9640f8a6-86')
Aug 01 15:29:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] No VIF found with MAC fa:16:3e:9c:ca:83, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-a1b0b008-6437-4024-8e13-c89c52957bf2 req-8bec65d1-efd1-46fa-ab98-cf50d1950ff8 service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Received event network-vif-unplugged-befcc650-86a7-49a1-b877-7fd179b494e4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a1b0b008-6437-4024-8e13-c89c52957bf2 req-8bec65d1-efd1-46fa-ab98-cf50d1950ff8 service nova] Acquiring lock "d4146775-a271-4822-84ec-e723ff09c386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a1b0b008-6437-4024-8e13-c89c52957bf2 req-8bec65d1-efd1-46fa-ab98-cf50d1950ff8 service nova] Lock "d4146775-a271-4822-84ec-e723ff09c386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a1b0b008-6437-4024-8e13-c89c52957bf2 req-8bec65d1-efd1-46fa-ab98-cf50d1950ff8 service nova] Lock "d4146775-a271-4822-84ec-e723ff09c386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-a1b0b008-6437-4024-8e13-c89c52957bf2 req-8bec65d1-efd1-46fa-ab98-cf50d1950ff8 service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] No waiting events found dispatching network-vif-unplugged-befcc650-86a7-49a1-b877-7fd179b494e4 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:29:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-a1b0b008-6437-4024-8e13-c89c52957bf2 req-8bec65d1-efd1-46fa-ab98-cf50d1950ff8 service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Received event network-vif-unplugged-befcc650-86a7-49a1-b877-7fd179b494e4 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:29:17 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: d4146775-a271-4822-84ec-e723ff09c386] Instance destroyed successfully.
Aug 01 15:29:17 user nova-compute[72201]: DEBUG nova.objects.instance [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lazy-loading 'resources' on Instance uuid d4146775-a271-4822-84ec-e723ff09c386 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:29:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:23:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-232907404',display_name='tempest-AttachVolumeNegativeTest-server-232907404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-232907404',id=14,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASYj7RarSxXe2Fm7m/BCygB8o+e8Htq3f8j2t0pCdJGLFf0W4hMn3JjVz61/uQr5toXcYBVfpZgNunxs2VLYdrnhjnEwSnm4ovuZioXY0x+ynhI8bX0uu2FChrls33wrw==',key_name='tempest-keypair-792720467',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:23:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='548641aee9954aa48c567e798b4be247',ramdisk_id='',reservation_id='r-zk6ja004',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2028543234',owner_user_name='tempest-AttachVolumeNegativeTest-2028543234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:23:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd505dbb02e4d3d8e8f97839b25ed22',uuid=d4146775-a271-4822-84ec-e723ff09c386,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "befcc650-86a7-49a1-b877-7fd179b494e4", "address": "fa:16:3e:25:25:a5", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefcc650-86", "ovs_interfaceid": "befcc650-86a7-49a1-b877-7fd179b494e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:29:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converting VIF {"id": "befcc650-86a7-49a1-b877-7fd179b494e4", "address": "fa:16:3e:25:25:a5", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefcc650-86", "ovs_interfaceid": "befcc650-86a7-49a1-b877-7fd179b494e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:29:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:25:a5,bridge_name='br-int',has_traffic_filtering=True,id=befcc650-86a7-49a1-b877-7fd179b494e4,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbefcc650-86') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:29:17 user nova-compute[72201]: DEBUG os_vif [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:25:a5,bridge_name='br-int',has_traffic_filtering=True,id=befcc650-86a7-49a1-b877-7fd179b494e4,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbefcc650-86') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:29:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbefcc650-86, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:29:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:29:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:17 user nova-compute[72201]: INFO os_vif [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:25:a5,bridge_name='br-int',has_traffic_filtering=True,id=befcc650-86a7-49a1-b877-7fd179b494e4,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbefcc650-86')
Aug 01 15:29:17 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Deleting instance files /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386_del
Aug 01 15:29:17 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Deletion of /opt/stack/data/nova/instances/d4146775-a271-4822-84ec-e723ff09c386_del complete
Aug 01 15:29:17 user nova-compute[72201]: INFO nova.compute.manager [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: d4146775-a271-4822-84ec-e723ff09c386] Took 1.48 seconds to destroy the instance on the hypervisor.
Aug 01 15:29:17 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:29:17 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: d4146775-a271-4822-84ec-e723ff09c386] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:29:17 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: d4146775-a271-4822-84ec-e723ff09c386] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:29:18 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Updating instance_info_cache with network_info: [{"id": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "address": "fa:16:3e:49:45:f6", "network": {"id": "11d4bdb2-99b5-468c-aeb3-79328fdd2d1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58b7341ffe06448bb276bdee2d242c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf512d66-cb", "ovs_interfaceid": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:29:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Releasing lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:29:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:18 user nova-compute[72201]: DEBUG nova.compute.manager [req-923992b1-bbbb-4aec-8b85-4ee81146eccf req-7a4cafa3-8b4a-40a9-9186-f4458b044721 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Received event network-vif-plugged-9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-923992b1-bbbb-4aec-8b85-4ee81146eccf req-7a4cafa3-8b4a-40a9-9186-f4458b044721 service nova] Acquiring lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-923992b1-bbbb-4aec-8b85-4ee81146eccf req-7a4cafa3-8b4a-40a9-9186-f4458b044721 service nova] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-923992b1-bbbb-4aec-8b85-4ee81146eccf req-7a4cafa3-8b4a-40a9-9186-f4458b044721 service nova] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:18 user nova-compute[72201]: DEBUG nova.compute.manager [req-923992b1-bbbb-4aec-8b85-4ee81146eccf req-7a4cafa3-8b4a-40a9-9186-f4458b044721 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] No waiting events found dispatching network-vif-plugged-9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:29:18 user nova-compute[72201]: WARNING nova.compute.manager [req-923992b1-bbbb-4aec-8b85-4ee81146eccf req-7a4cafa3-8b4a-40a9-9186-f4458b044721 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Received unexpected event network-vif-plugged-9640f8a6-86a4-403c-9dac-06c68368d6dd for instance with vm_state building and task_state spawning.
Aug 01 15:29:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:19 user nova-compute[72201]: DEBUG nova.compute.manager [req-ed707981-b08f-430a-863a-6556b3fe2d01 req-c55fa313-0cf9-405c-9bd9-2f8b2b9672e3 service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Received event network-vif-plugged-befcc650-86a7-49a1-b877-7fd179b494e4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ed707981-b08f-430a-863a-6556b3fe2d01 req-c55fa313-0cf9-405c-9bd9-2f8b2b9672e3 service nova] Acquiring lock "d4146775-a271-4822-84ec-e723ff09c386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ed707981-b08f-430a-863a-6556b3fe2d01 req-c55fa313-0cf9-405c-9bd9-2f8b2b9672e3 service nova] Lock "d4146775-a271-4822-84ec-e723ff09c386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ed707981-b08f-430a-863a-6556b3fe2d01 req-c55fa313-0cf9-405c-9bd9-2f8b2b9672e3 service nova] Lock "d4146775-a271-4822-84ec-e723ff09c386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:19 user nova-compute[72201]: DEBUG nova.compute.manager [req-ed707981-b08f-430a-863a-6556b3fe2d01 req-c55fa313-0cf9-405c-9bd9-2f8b2b9672e3 service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] No waiting events found dispatching network-vif-plugged-befcc650-86a7-49a1-b877-7fd179b494e4 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:29:19 user nova-compute[72201]: WARNING nova.compute.manager [req-ed707981-b08f-430a-863a-6556b3fe2d01 req-c55fa313-0cf9-405c-9bd9-2f8b2b9672e3 service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Received unexpected event network-vif-plugged-befcc650-86a7-49a1-b877-7fd179b494e4 for instance with vm_state active and task_state deleting.
Aug 01 15:29:19 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: d4146775-a271-4822-84ec-e723ff09c386] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:29:19 user nova-compute[72201]: DEBUG nova.compute.manager [req-a65acbf0-a4c6-4a68-a93b-01fe5c6f5209 req-0fbfc236-1cea-4b6c-afb8-1f5480f3ab93 service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Received event network-vif-deleted-befcc650-86a7-49a1-b877-7fd179b494e4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:19 user nova-compute[72201]: INFO nova.compute.manager [req-a65acbf0-a4c6-4a68-a93b-01fe5c6f5209 req-0fbfc236-1cea-4b6c-afb8-1f5480f3ab93 service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Neutron deleted interface befcc650-86a7-49a1-b877-7fd179b494e4; detaching it from the instance and deleting it from the info cache
Aug 01 15:29:19 user nova-compute[72201]: DEBUG nova.network.neutron [req-a65acbf0-a4c6-4a68-a93b-01fe5c6f5209 req-0fbfc236-1cea-4b6c-afb8-1f5480f3ab93 service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:29:19 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: d4146775-a271-4822-84ec-e723ff09c386] Took 1.40 seconds to deallocate network for instance.
Aug 01 15:29:19 user nova-compute[72201]: DEBUG nova.compute.manager [req-a65acbf0-a4c6-4a68-a93b-01fe5c6f5209 req-0fbfc236-1cea-4b6c-afb8-1f5480f3ab93 service nova] [instance: d4146775-a271-4822-84ec-e723ff09c386] Detach interface failed, port_id=befcc650-86a7-49a1-b877-7fd179b494e4, reason: Instance d4146775-a271-4822-84ec-e723ff09c386 could not be found. {{(pid=72201) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 15:29:19 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Instance destroyed successfully.
Aug 01 15:29:19 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Attempting a stable device rescue
Aug 01 15:29:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72201) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 15:29:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Instance directory exists: not creating {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 15:29:19 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Creating image(s)
Aug 01 15:29:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "/opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "/opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:19 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:29:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "5dabb16936b5dfc445343a8222c2af7825a58f3b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "5dabb16936b5dfc445343a8222c2af7825a58f3b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Acquiring lock "930bd7a5-5dbb-40a4-a51c-3340f9eb3626" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Lock "930bd7a5-5dbb-40a4-a51c-3340f9eb3626" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Acquiring lock "930bd7a5-5dbb-40a4-a51c-3340f9eb3626-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Lock "930bd7a5-5dbb-40a4-a51c-3340f9eb3626-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Lock "930bd7a5-5dbb-40a4-a51c-3340f9eb3626-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:19 user nova-compute[72201]: INFO nova.compute.manager [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Terminating instance
Aug 01 15:29:19 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:29:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dabb16936b5dfc445343a8222c2af7825a58f3b.part --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-dad66287-21cc-4e85-8a46-28b364fa9352 req-9286851f-1d06-4aa5-97b7-b09cc1d67a41 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Received event network-vif-plugged-9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-dad66287-21cc-4e85-8a46-28b364fa9352 req-9286851f-1d06-4aa5-97b7-b09cc1d67a41 service nova] Acquiring lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-dad66287-21cc-4e85-8a46-28b364fa9352 req-9286851f-1d06-4aa5-97b7-b09cc1d67a41 service nova] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-dad66287-21cc-4e85-8a46-28b364fa9352 req-9286851f-1d06-4aa5-97b7-b09cc1d67a41 service nova] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-dad66287-21cc-4e85-8a46-28b364fa9352 req-9286851f-1d06-4aa5-97b7-b09cc1d67a41 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] No waiting events found dispatching network-vif-plugged-9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:29:21 user nova-compute[72201]: WARNING nova.compute.manager [req-dad66287-21cc-4e85-8a46-28b364fa9352 req-9286851f-1d06-4aa5-97b7-b09cc1d67a41 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Received unexpected event network-vif-plugged-9640f8a6-86a4-403c-9dac-06c68368d6dd for instance with vm_state building and task_state spawning.
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-dad66287-21cc-4e85-8a46-28b364fa9352 req-9286851f-1d06-4aa5-97b7-b09cc1d67a41 service nova] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Received event network-vif-unplugged-7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-dad66287-21cc-4e85-8a46-28b364fa9352 req-9286851f-1d06-4aa5-97b7-b09cc1d67a41 service nova] Acquiring lock "930bd7a5-5dbb-40a4-a51c-3340f9eb3626-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-dad66287-21cc-4e85-8a46-28b364fa9352 req-9286851f-1d06-4aa5-97b7-b09cc1d67a41 service nova] Lock "930bd7a5-5dbb-40a4-a51c-3340f9eb3626-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-dad66287-21cc-4e85-8a46-28b364fa9352 req-9286851f-1d06-4aa5-97b7-b09cc1d67a41 service nova] Lock "930bd7a5-5dbb-40a4-a51c-3340f9eb3626-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-dad66287-21cc-4e85-8a46-28b364fa9352 req-9286851f-1d06-4aa5-97b7-b09cc1d67a41 service nova] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] No waiting events found dispatching network-vif-unplugged-7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-dad66287-21cc-4e85-8a46-28b364fa9352 req-9286851f-1d06-4aa5-97b7-b09cc1d67a41 service nova] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Received event network-vif-unplugged-7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-dad66287-21cc-4e85-8a46-28b364fa9352 req-9286851f-1d06-4aa5-97b7-b09cc1d67a41 service nova] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Received event network-vif-plugged-7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-dad66287-21cc-4e85-8a46-28b364fa9352 req-9286851f-1d06-4aa5-97b7-b09cc1d67a41 service nova] Acquiring lock "930bd7a5-5dbb-40a4-a51c-3340f9eb3626-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-dad66287-21cc-4e85-8a46-28b364fa9352 req-9286851f-1d06-4aa5-97b7-b09cc1d67a41 service nova] Lock "930bd7a5-5dbb-40a4-a51c-3340f9eb3626-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-dad66287-21cc-4e85-8a46-28b364fa9352 req-9286851f-1d06-4aa5-97b7-b09cc1d67a41 service nova] Lock "930bd7a5-5dbb-40a4-a51c-3340f9eb3626-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-dad66287-21cc-4e85-8a46-28b364fa9352 req-9286851f-1d06-4aa5-97b7-b09cc1d67a41 service nova] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] No waiting events found dispatching network-vif-plugged-7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:29:21 user nova-compute[72201]: WARNING nova.compute.manager [req-dad66287-21cc-4e85-8a46-28b364fa9352 req-9286851f-1d06-4aa5-97b7-b09cc1d67a41 service nova] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Received unexpected event network-vif-plugged-7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b for instance with vm_state active and task_state deleting.
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-9916ca38-a0ed-420f-87b2-f3eb53a084d1 req-18da2f69-2835-49f6-8b78-62816d99edcf service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received event network-vif-unplugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9916ca38-a0ed-420f-87b2-f3eb53a084d1 req-18da2f69-2835-49f6-8b78-62816d99edcf service nova] Acquiring lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9916ca38-a0ed-420f-87b2-f3eb53a084d1 req-18da2f69-2835-49f6-8b78-62816d99edcf service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9916ca38-a0ed-420f-87b2-f3eb53a084d1 req-18da2f69-2835-49f6-8b78-62816d99edcf service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-9916ca38-a0ed-420f-87b2-f3eb53a084d1 req-18da2f69-2835-49f6-8b78-62816d99edcf service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] No waiting events found dispatching network-vif-unplugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:29:21 user nova-compute[72201]: WARNING nova.compute.manager [req-9916ca38-a0ed-420f-87b2-f3eb53a084d1 req-18da2f69-2835-49f6-8b78-62816d99edcf service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received unexpected event network-vif-unplugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 for instance with vm_state active and task_state rescuing.
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-9916ca38-a0ed-420f-87b2-f3eb53a084d1 req-18da2f69-2835-49f6-8b78-62816d99edcf service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received event network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9916ca38-a0ed-420f-87b2-f3eb53a084d1 req-18da2f69-2835-49f6-8b78-62816d99edcf service nova] Acquiring lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9916ca38-a0ed-420f-87b2-f3eb53a084d1 req-18da2f69-2835-49f6-8b78-62816d99edcf service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9916ca38-a0ed-420f-87b2-f3eb53a084d1 req-18da2f69-2835-49f6-8b78-62816d99edcf service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-9916ca38-a0ed-420f-87b2-f3eb53a084d1 req-18da2f69-2835-49f6-8b78-62816d99edcf service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] No waiting events found dispatching network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:29:21 user nova-compute[72201]: WARNING nova.compute.manager [req-9916ca38-a0ed-420f-87b2-f3eb53a084d1 req-18da2f69-2835-49f6-8b78-62816d99edcf service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received unexpected event network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 for instance with vm_state active and task_state rescuing.
Aug 01 15:29:21 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Instance destroyed successfully.
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Lazy-loading 'resources' on Instance uuid 930bd7a5-5dbb-40a4-a51c-3340f9eb3626 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:27:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-541289900',display_name='tempest-VolumesNegativeTest-instance-541289900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-541289900',id=21,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:27:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='741a552742a845fe8bb0bdc85f4286a8',ramdisk_id='',reservation_id='r-i7xuqntd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2144524353',owner_user_name='tempest-VolumesNegativeTest-2144524353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:27:40Z,user_data=None,user_id='c359a4c9166a4110a5830fcb90fb4687',uuid=930bd7a5-5dbb-40a4-a51c-3340f9eb3626,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b", "address": "fa:16:3e:76:35:38", "network": {"id": "57d99a32-fe6c-4e6f-b9f5-230b8a58c5cc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "61c269efda764109a1920e63e9db119e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3dc6bd-cb", "ovs_interfaceid": "7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Converting VIF {"id": "7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b", "address": "fa:16:3e:76:35:38", "network": {"id": "57d99a32-fe6c-4e6f-b9f5-230b8a58c5cc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "61c269efda764109a1920e63e9db119e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3dc6bd-cb", "ovs_interfaceid": "7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:35:38,bridge_name='br-int',has_traffic_filtering=True,id=7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b,network=Network(57d99a32-fe6c-4e6f-b9f5-230b8a58c5cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3dc6bd-cb') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG os_vif [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:35:38,bridge_name='br-int',has_traffic_filtering=True,id=7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b,network=Network(57d99a32-fe6c-4e6f-b9f5-230b8a58c5cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3dc6bd-cb') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e3dc6bd-cb, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:21 user nova-compute[72201]: INFO os_vif [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:35:38,bridge_name='br-int',has_traffic_filtering=True,id=7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b,network=Network(57d99a32-fe6c-4e6f-b9f5-230b8a58c5cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3dc6bd-cb')
Aug 01 15:29:21 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Deleting instance files /opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626_del
Aug 01 15:29:21 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Deletion of /opt/stack/data/nova/instances/930bd7a5-5dbb-40a4-a51c-3340f9eb3626_del complete
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dabb16936b5dfc445343a8222c2af7825a58f3b.part --force-share --output=json" returned: 0 in 0.152s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.virt.images [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] 9eaa17e7-06c6-4ead-a0ba-09554e42be98 was qcow2, converting to raw {{(pid=72201) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.privsep.utils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72201) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5dabb16936b5dfc445343a8222c2af7825a58f3b.part /opt/stack/data/nova/instances/_base/5dabb16936b5dfc445343a8222c2af7825a58f3b.converted {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:21 user nova-compute[72201]: INFO nova.compute.manager [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Took 1.71 seconds to destroy the instance on the hypervisor.
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.004s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:21 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Deleted allocations for instance d4146775-a271-4822-84ec-e723ff09c386
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2325c8f7-e03d-4133-9554-1e80a257116f tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "d4146775-a271-4822-84ec-e723ff09c386" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.302s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5dabb16936b5dfc445343a8222c2af7825a58f3b.part /opt/stack/data/nova/instances/_base/5dabb16936b5dfc445343a8222c2af7825a58f3b.converted" returned: 0 in 0.619s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dabb16936b5dfc445343a8222c2af7825a58f3b.converted --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903761.9180508, bd70360d-30b8-47d5-b35e-adf0d28482dd => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:29:21 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] VM Resumed (Lifecycle Event)
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:29:21 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Instance spawned successfully.
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:29:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:29:22 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903761.9216928, bd70360d-30b8-47d5-b35e-adf0d28482dd => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:29:22 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] VM Started (Lifecycle Event)
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dabb16936b5dfc445343a8222c2af7825a58f3b.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "5dabb16936b5dfc445343a8222c2af7825a58f3b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.628s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.compute.manager [req-07f2ceb3-b368-466a-8d97-d21eb79aed4a req-a4a5a391-c619-4816-8cf6-268953ef5cbc service nova] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Received event network-vif-deleted-7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:22 user nova-compute[72201]: INFO nova.compute.manager [req-07f2ceb3-b368-466a-8d97-d21eb79aed4a req-a4a5a391-c619-4816-8cf6-268953ef5cbc service nova] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Neutron deleted interface 7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b; detaching it from the instance and deleting it from the info cache
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.network.neutron [req-07f2ceb3-b368-466a-8d97-d21eb79aed4a req-a4a5a391-c619-4816-8cf6-268953ef5cbc service nova] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "5dabb16936b5dfc445343a8222c2af7825a58f3b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "5dabb16936b5dfc445343a8222c2af7825a58f3b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dabb16936b5dfc445343a8222c2af7825a58f3b --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:22 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Took 0.82 seconds to deallocate network for instance.
Aug 01 15:29:22 user nova-compute[72201]: INFO nova.compute.manager [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Took 6.99 seconds to spawn the instance on the hypervisor.
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.compute.manager [req-07f2ceb3-b368-466a-8d97-d21eb79aed4a req-a4a5a391-c619-4816-8cf6-268953ef5cbc service nova] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Detach interface failed, port_id=7e3dc6bd-cb64-489d-8ab5-7ab4f7eda28b, reason: Instance 930bd7a5-5dbb-40a4-a51c-3340f9eb3626 could not be found. {{(pid=72201) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 15:29:22 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dabb16936b5dfc445343a8222c2af7825a58f3b --force-share --output=json" returned: 0 in 0.163s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dabb16936b5dfc445343a8222c2af7825a58f3b,backing_fmt=raw /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk.rescue {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:22 user nova-compute[72201]: INFO nova.compute.manager [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Took 16.96 seconds to build instance.
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dabb16936b5dfc445343a8222c2af7825a58f3b,backing_fmt=raw /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk.rescue" returned: 0 in 0.068s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "5dabb16936b5dfc445343a8222c2af7825a58f3b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lazy-loading 'migration_context' on Instance uuid 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Start _get_guest_xml network_info=[{"id": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "address": "fa:16:3e:49:45:f6", "network": {"id": "11d4bdb2-99b5-468c-aeb3-79328fdd2d1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "vif_mac": "fa:16:3e:49:45:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58b7341ffe06448bb276bdee2d242c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf512d66-cb", "ovs_interfaceid": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9eaa17e7-06c6-4ead-a0ba-09554e42be98', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLisTgOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '3a2d865c-6c6c-49b1-a2d3-4afc63b10581', 'attached_at': '', 'detached_at': '', 'volume_id': '8f263670-c9fb-4506-980a-810ff56314a0', 'serial': '8f263670-c9fb-4506-980a-810ff56314a0'}, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'a81bcc69-4c92-4057-b8b0-d78a8312c996', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lazy-loading 'resources' on Instance uuid 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed92d0e6-2fd3-434c-a496-c48e80d490eb tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.073s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lazy-loading 'numa_topology' on Instance uuid 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:29:22 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:29:22 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLisTgOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:29:22 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:29:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:29:22 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:29:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:29:22 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f7bb72-07f3-45e7-a812-4ca172741831]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = CLisTgOB\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 15:29:22 user nova-compute[72201]: node.name = iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0
Aug 01 15:29:22 user nova-compute[72201]: node.tpgt = -1
Aug 01 15:29:22 user nova-compute[72201]: node.startup = automatic
Aug 01 15:29:22 user nova-compute[72201]: node.leading_login = No
Aug 01 15:29:22 user nova-compute[72201]: iface.iscsi_ifacename = default
Aug 01 15:29:22 user nova-compute[72201]: iface.net_ifacename = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.ipaddress = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.prefix_len = 0
Aug 01 15:29:22 user nova-compute[72201]: iface.hwaddress = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.transport_name = tcp
Aug 01 15:29:22 user nova-compute[72201]: iface.initiatorname = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.state = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.vlan_id = 0
Aug 01 15:29:22 user nova-compute[72201]: iface.vlan_priority = 0
Aug 01 15:29:22 user nova-compute[72201]: iface.vlan_state = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.iface_num = 0
Aug 01 15:29:22 user nova-compute[72201]: iface.mtu = 0
Aug 01 15:29:22 user nova-compute[72201]: iface.port = 0
Aug 01 15:29:22 user nova-compute[72201]: iface.bootproto = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.subnet_mask = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.gateway = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.dhcp_alt_client_id = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.dhcp_dns = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.dhcp_learn_iqn = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.dhcp_vendor_id_state = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.dhcp_vendor_id = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.dhcp_slp_da = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.fragmentation = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.gratuitous_arp = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.incoming_forwarding = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.tos_state = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.tos = 0
Aug 01 15:29:22 user nova-compute[72201]: iface.ttl = 0
Aug 01 15:29:22 user nova-compute[72201]: iface.delayed_ack = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.tcp_nagle = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.tcp_wsf_state = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.tcp_wsf = 0
Aug 01 15:29:22 user nova-compute[72201]: iface.tcp_timer_scale = 0
Aug 01 15:29:22 user nova-compute[72201]: iface.tcp_timestamp = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.redirect = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.def_task_mgmt_timeout = 0
Aug 01 15:29:22 user nova-compute[72201]: iface.header_digest = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.data_digest = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.immediate_data = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.initial_r2t = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.data_seq_inorder = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.data_pdu_inorder = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.erl = 0
Aug 01 15:29:22 user nova-compute[72201]: iface.max_receive_data_len = 0
Aug 01 15:29:22 user nova-compute[72201]: iface.first_burst_len = 0
Aug 01 15:29:22 user nova-compute[72201]: iface.max_outstanding_r2t = 0
Aug 01 15:29:22 user nova-compute[72201]: iface.max_burst_len = 0
Aug 01 15:29:22 user nova-compute[72201]: iface.chap_auth = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.bidi_chap = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.strict_login_compliance = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.discovery_auth = <empty>
Aug 01 15:29:22 user nova-compute[72201]: iface.discovery_logout = <empty>
Aug 01 15:29:22 user nova-compute[72201]: node.discovery_address = <empty>
Aug 01 15:29:22 user nova-compute[72201]: node.discovery_port = 0
Aug 01 15:29:22 user nova-compute[72201]: node.discovery_type = static
Aug 01 15:29:22 user nova-compute[72201]: node.session.initial_cmdsn = 0
Aug 01 15:29:22 user nova-compute[72201]: node.session.initial_login_retry_max = 8
Aug 01 15:29:22 user nova-compute[72201]: node.session.xmit_thread_priority = -20
Aug 01 15:29:22 user nova-compute[72201]: node.session.cmds_max = 128
Aug 01 15:29:22 user nova-compute[72201]: node.session.queue_depth = 32
Aug 01 15:29:22 user nova-compute[72201]: node.session.nr_sessions = 1
Aug 01 15:29:22 user nova-compute[72201]: node.session.auth.authmethod = CHAP
Aug 01 15:29:22 user nova-compute[72201]: node.session.auth.username = CLisTgOB
Aug 01 15:29:22 user nova-compute[72201]: node.session.auth.password = ***
Aug 01 15:29:22 user nova-compute[72201]: node.session.auth.username_in = <empty>
Aug 01 15:29:22 user nova-compute[72201]: node.session.auth.password_in = <empty>
Aug 01 15:29:22 user nova-compute[72201]: node.session.auth.chap_algs = MD5
Aug 01 15:29:22 user nova-compute[72201]: node.session.timeo.replacement_timeout = 120
Aug 01 15:29:22 user nova-compute[72201]: node.session.err_timeo.abort_timeout = 15
Aug 01 15:29:22 user nova-compute[72201]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 15:29:22 user nova-compute[72201]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 15:29:22 user nova-compute[72201]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 15:29:22 user nova-compute[72201]: node.session.iscsi.FastAbort = Yes
Aug 01 15:29:22 user nova-compute[72201]: node.session.iscsi.InitialR2T = No
Aug 01 15:29:22 user nova-compute[72201]: node.session.iscsi.ImmediateData = Yes
Aug 01 15:29:22 user nova-compute[72201]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 15:29:22 user nova-compute[72201]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 15:29:22 user nova-compute[72201]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 15:29:22 user nova-compute[72201]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 15:29:22 user nova-compute[72201]: node.session.iscsi.MaxConnections = 1
Aug 01 15:29:22 user nova-compute[72201]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 15:29:22 user nova-compute[72201]: node.session.iscsi.ERL = 0
Aug 01 15:29:22 user nova-compute[72201]: node.session.scan = manual
Aug 01 15:29:22 user nova-compute[72201]: node.session.reopen_max = 0
Aug 01 15:29:22 user nova-compute[72201]: node.conn[0].address = 172.16.0.220
Aug 01 15:29:22 user nova-compute[72201]: node.conn[0].port = 3260
Aug 01 15:29:22 user nova-compute[72201]: node.conn[0].startup = manual
Aug 01 15:29:22 user nova-compute[72201]: node.conn[0].tcp.window_size = 524288
Aug 01 15:29:22 user nova-compute[72201]: node.conn[0].tcp.type_of_service = 0
Aug 01 15:29:22 user nova-compute[72201]: node.conn[0].timeo.logout_timeout = 15
Aug 01 15:29:22 user nova-compute[72201]: node.conn[0].timeo.login_timeout = 15
Aug 01 15:29:22 user nova-compute[72201]: node.conn[0].timeo.auth_timeout = 45
Aug 01 15:29:22 user nova-compute[72201]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 15:29:22 user nova-compute[72201]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 15:29:22 user nova-compute[72201]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 15:29:22 user nova-compute[72201]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 15:29:22 user nova-compute[72201]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 15:29:22 user nova-compute[72201]: node.conn[0].iscsi.DataDigest = None
Aug 01 15:29:22 user nova-compute[72201]: node.conn[0].iscsi.IFMarker = No
Aug 01 15:29:22 user nova-compute[72201]: node.conn[0].iscsi.OFMarker = No
Aug 01 15:29:22 user nova-compute[72201]: # END RECORD
Aug 01 15:29:22 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf052eb-ca1f-4a7d-b078-6faf2195c9a5]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bf72bd-119c-4d25-b34c-78c727dbc1c1]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CLisTgOB {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CLisTgOB" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[160e593d-bdeb-46c8-a24a-eccf566060de]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CLisTgOB'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[076c3f8a-1d9d-410b-be6c-4c763969816e]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e543802b-8e62-4d26-85e9-0d92c4401b30]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:29:22 user nova-compute[72201]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:29:22 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:29:22 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:29:22 user nova-compute[72201]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:29:22 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:29:22 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.178s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] HCTL ('34', '0', '0', 0) found on session 25 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.036s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec716d7d-0218-463d-9622-6935dfdb84f3]: (4, ('0 0 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Searching for a device in session 25 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLisTgOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.232s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] <== connect_volume: return (233ms) {'type': 'block', 'scsi_wwn': '23035343634313632', 'path': '/dev/sdc'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035343634313632', 'path': '/dev/sdc'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-616113067',display_name='tempest-ServerStableDeviceRescueTest-server-616113067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-616113067',id=17,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3mv2L6pRwzDlLhsAfZgKjBYSoCSBLrKTMYtnKHzKZtZOFIChaqjgdb/atxzSM7ZpmJlUyit0iamU+T/ZT2+eMI8rXjGQV0wQ6XbxnRS7VabRySFu2LJnSzE7DAZn7bCw==',key_name='tempest-keypair-553162897',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:25:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='58b7341ffe06448bb276bdee2d242c59',ramdisk_id='',reservation_id='r-b64x8tdl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1956540841',owner_user_name='tempest-ServerStableDeviceRescueTest-1956540841-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:27:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f08e5ef13d74417a8f07e7c82858ac86',uuid=3a2d865c-6c6c-49b1-a2d3-4afc63b10581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "address": "fa:16:3e:49:45:f6", "network": {"id": "11d4bdb2-99b5-468c-aeb3-79328fdd2d1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "vif_mac": "fa:16:3e:49:45:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58b7341ffe06448bb276bdee2d242c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf512d66-cb", "ovs_interfaceid": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Converting VIF {"id": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "address": "fa:16:3e:49:45:f6", "network": {"id": "11d4bdb2-99b5-468c-aeb3-79328fdd2d1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "vif_mac": "fa:16:3e:49:45:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58b7341ffe06448bb276bdee2d242c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf512d66-cb", "ovs_interfaceid": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:45:f6,bridge_name='br-int',has_traffic_filtering=True,id=af512d66-cb4c-4633-ba94-d8b6b3af6e87,network=Network(11d4bdb2-99b5-468c-aeb3-79328fdd2d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf512d66-cb') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:29:22 user nova-compute[72201]:   <uuid>3a2d865c-6c6c-49b1-a2d3-4afc63b10581</uuid>
Aug 01 15:29:22 user nova-compute[72201]:   <name>instance-00000011</name>
Aug 01 15:29:22 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:29:22 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:29:22 user nova-compute[72201]:   <metadata>
Aug 01 15:29:22 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:29:22 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:29:22 user nova-compute[72201]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-616113067</nova:name>
Aug 01 15:29:22 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:29:22</nova:creationTime>
Aug 01 15:29:22 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:29:22 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:29:22 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:29:22 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:29:22 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:29:22 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:29:22 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:29:22 user nova-compute[72201]:       <nova:owner>
Aug 01 15:29:22 user nova-compute[72201]:         <nova:user uuid="f08e5ef13d74417a8f07e7c82858ac86">tempest-ServerStableDeviceRescueTest-1956540841-project-member</nova:user>
Aug 01 15:29:22 user nova-compute[72201]:         <nova:project uuid="58b7341ffe06448bb276bdee2d242c59">tempest-ServerStableDeviceRescueTest-1956540841</nova:project>
Aug 01 15:29:22 user nova-compute[72201]:       </nova:owner>
Aug 01 15:29:22 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:29:22 user nova-compute[72201]:       <nova:ports>
Aug 01 15:29:22 user nova-compute[72201]:         <nova:port uuid="af512d66-cb4c-4633-ba94-d8b6b3af6e87">
Aug 01 15:29:22 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 15:29:22 user nova-compute[72201]:         </nova:port>
Aug 01 15:29:22 user nova-compute[72201]:       </nova:ports>
Aug 01 15:29:22 user nova-compute[72201]:     </nova:instance>
Aug 01 15:29:22 user nova-compute[72201]:   </metadata>
Aug 01 15:29:22 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:29:22 user nova-compute[72201]:     <system>
Aug 01 15:29:22 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:29:22 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:29:22 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:29:22 user nova-compute[72201]:       <entry name="serial">3a2d865c-6c6c-49b1-a2d3-4afc63b10581</entry>
Aug 01 15:29:22 user nova-compute[72201]:       <entry name="uuid">3a2d865c-6c6c-49b1-a2d3-4afc63b10581</entry>
Aug 01 15:29:22 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:29:22 user nova-compute[72201]:     </system>
Aug 01 15:29:22 user nova-compute[72201]:   </sysinfo>
Aug 01 15:29:22 user nova-compute[72201]:   <os>
Aug 01 15:29:22 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:29:22 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:29:22 user nova-compute[72201]:   </os>
Aug 01 15:29:22 user nova-compute[72201]:   <features>
Aug 01 15:29:22 user nova-compute[72201]:     <acpi/>
Aug 01 15:29:22 user nova-compute[72201]:     <apic/>
Aug 01 15:29:22 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:29:22 user nova-compute[72201]:   </features>
Aug 01 15:29:22 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:29:22 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:29:22 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:29:22 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:29:22 user nova-compute[72201]:   </clock>
Aug 01 15:29:22 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:29:22 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:29:22 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:29:22 user nova-compute[72201]:   </cpu>
Aug 01 15:29:22 user nova-compute[72201]:   <devices>
Aug 01 15:29:22 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:29:22 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:29:22 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk"/>
Aug 01 15:29:22 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:29:22 user nova-compute[72201]:     </disk>
Aug 01 15:29:22 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:29:22 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:29:22 user nova-compute[72201]:       <source dev="/dev/sdc"/>
Aug 01 15:29:22 user nova-compute[72201]:       <target dev="vdb" bus="virtio"/>
Aug 01 15:29:22 user nova-compute[72201]:       <serial>8f263670-c9fb-4506-980a-810ff56314a0</serial>
Aug 01 15:29:22 user nova-compute[72201]:     </disk>
Aug 01 15:29:22 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:29:22 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:29:22 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk.rescue"/>
Aug 01 15:29:22 user nova-compute[72201]:       <target dev="vdc" bus="virtio"/>
Aug 01 15:29:22 user nova-compute[72201]:       <boot order="1"/>
Aug 01 15:29:22 user nova-compute[72201]:     </disk>
Aug 01 15:29:22 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:29:22 user nova-compute[72201]:       <mac address="fa:16:3e:49:45:f6"/>
Aug 01 15:29:22 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:29:22 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:29:22 user nova-compute[72201]:       <target dev="tapaf512d66-cb"/>
Aug 01 15:29:22 user nova-compute[72201]:     </interface>
Aug 01 15:29:22 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:29:22 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/console.log" append="off"/>
Aug 01 15:29:22 user nova-compute[72201]:     </serial>
Aug 01 15:29:22 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:29:22 user nova-compute[72201]:     <video>
Aug 01 15:29:22 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:29:22 user nova-compute[72201]:     </video>
Aug 01 15:29:22 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:29:22 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:29:22 user nova-compute[72201]:     </rng>
Aug 01 15:29:22 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:29:22 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:29:22 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:29:22 user nova-compute[72201]:     </memballoon>
Aug 01 15:29:22 user nova-compute[72201]:   </devices>
Aug 01 15:29:22 user nova-compute[72201]: </domain>
Aug 01 15:29:22 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:29:22 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Instance destroyed successfully.
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] No VIF found with MAC fa:16:3e:49:45:f6, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:29:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.633s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:22 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Deleted allocations for instance 930bd7a5-5dbb-40a4-a51c-3340f9eb3626
Aug 01 15:29:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ade7be8c-d99a-49b1-a2d5-a23d4b4aa03d tempest-VolumesNegativeTest-2144524353 tempest-VolumesNegativeTest-2144524353-project-member] Lock "930bd7a5-5dbb-40a4-a51c-3340f9eb3626" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.491s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:29:24 user nova-compute[72201]: INFO nova.compute.manager [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] instance snapshotting
Aug 01 15:29:24 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Beginning live snapshot process
Aug 01 15:29:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json -f qcow2 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:24 user nova-compute[72201]: DEBUG nova.compute.manager [req-1938456b-06a4-4e7c-9425-82815fab85f3 req-3617e1be-0c8e-4576-b105-cf06ac4f2ccb service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received event network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1938456b-06a4-4e7c-9425-82815fab85f3 req-3617e1be-0c8e-4576-b105-cf06ac4f2ccb service nova] Acquiring lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1938456b-06a4-4e7c-9425-82815fab85f3 req-3617e1be-0c8e-4576-b105-cf06ac4f2ccb service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1938456b-06a4-4e7c-9425-82815fab85f3 req-3617e1be-0c8e-4576-b105-cf06ac4f2ccb service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:24 user nova-compute[72201]: DEBUG nova.compute.manager [req-1938456b-06a4-4e7c-9425-82815fab85f3 req-3617e1be-0c8e-4576-b105-cf06ac4f2ccb service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] No waiting events found dispatching network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:29:24 user nova-compute[72201]: WARNING nova.compute.manager [req-1938456b-06a4-4e7c-9425-82815fab85f3 req-3617e1be-0c8e-4576-b105-cf06ac4f2ccb service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received unexpected event network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 for instance with vm_state active and task_state rescuing.
Aug 01 15:29:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json -f qcow2 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json -f qcow2" returned: 0 in 0.164s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.165s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpocfwme0i/3d1db4f76792458d90f89076430d9892.delta 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpocfwme0i/3d1db4f76792458d90f89076430d9892.delta 1073741824" returned: 0 in 0.052s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:25 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 15:29:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:29:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] COPY block job progress, current cursor: 53870592 final cursor: 75563008 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:29:26 user nova-compute[72201]: DEBUG nova.compute.manager [req-63534fa5-950f-47b2-b950-2288fa78e267 req-485aba8f-12db-44db-87b2-9e74fd91e7b9 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received event network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-63534fa5-950f-47b2-b950-2288fa78e267 req-485aba8f-12db-44db-87b2-9e74fd91e7b9 service nova] Acquiring lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-63534fa5-950f-47b2-b950-2288fa78e267 req-485aba8f-12db-44db-87b2-9e74fd91e7b9 service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-63534fa5-950f-47b2-b950-2288fa78e267 req-485aba8f-12db-44db-87b2-9e74fd91e7b9 service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:26 user nova-compute[72201]: DEBUG nova.compute.manager [req-63534fa5-950f-47b2-b950-2288fa78e267 req-485aba8f-12db-44db-87b2-9e74fd91e7b9 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] No waiting events found dispatching network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:29:26 user nova-compute[72201]: WARNING nova.compute.manager [req-63534fa5-950f-47b2-b950-2288fa78e267 req-485aba8f-12db-44db-87b2-9e74fd91e7b9 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received unexpected event network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 for instance with vm_state active and task_state rescuing.
Aug 01 15:29:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Removed pending event for 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 due to event {{(pid=72201) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 15:29:27 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903767.0777762, 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:29:27 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] VM Resumed (Lifecycle Event)
Aug 01 15:29:27 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ea32da2b-e146-48e4-a7ca-ce09390a9c7d tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:29:27 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:29:27 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:29:27 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 15:29:27 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903767.0795605, 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:29:27 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] VM Started (Lifecycle Event)
Aug 01 15:29:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:29:27 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 15:29:27 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:29:27 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:29:27 user nova-compute[72201]: DEBUG nova.privsep.utils [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72201) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 15:29:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpocfwme0i/3d1db4f76792458d90f89076430d9892.delta /opt/stack/data/nova/instances/snapshots/tmpocfwme0i/3d1db4f76792458d90f89076430d9892 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpocfwme0i/3d1db4f76792458d90f89076430d9892.delta /opt/stack/data/nova/instances/snapshots/tmpocfwme0i/3d1db4f76792458d90f89076430d9892" returned: 0 in 0.594s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:27 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Snapshot extracted, beginning image upload
Aug 01 15:29:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:30 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Snapshot image upload complete
Aug 01 15:29:30 user nova-compute[72201]: INFO nova.compute.manager [None req-3af8ce2f-fa99-4b41-a094-583577c67fa1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Took 6.35 seconds to snapshot the instance on the hypervisor.
Aug 01 15:29:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:32 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903757.7338803, d4146775-a271-4822-84ec-e723ff09c386 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:29:32 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: d4146775-a271-4822-84ec-e723ff09c386] VM Stopped (Lifecycle Event)
Aug 01 15:29:32 user nova-compute[72201]: DEBUG nova.compute.manager [None req-2dc9dbea-0473-4913-8097-1b76297dcd30 None None] [instance: d4146775-a271-4822-84ec-e723ff09c386] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:29:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:33 user nova-compute[72201]: DEBUG nova.compute.manager [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:29:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:33 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:29:33 user nova-compute[72201]: INFO nova.compute.claims [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Claim successful on node user
Aug 01 15:29:33 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:29:33 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:29:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.602s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:33 user nova-compute[72201]: DEBUG nova.compute.manager [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:29:34 user nova-compute[72201]: DEBUG nova.compute.manager [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:29:34 user nova-compute[72201]: DEBUG nova.network.neutron [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:29:34 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:29:34 user nova-compute[72201]: DEBUG nova.compute.manager [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:29:34 user nova-compute[72201]: DEBUG nova.policy [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c69154feccc402f9f0d2c0aafdbdea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8289b01d09f4cf4a35affa9e22fa7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:29:34 user nova-compute[72201]: DEBUG nova.compute.manager [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:29:34 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:29:34 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Creating image(s)
Aug 01 15:29:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "/opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "/opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "/opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "80b319fc241ed8d08e142859a7cbfc917c661fb5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "80b319fc241ed8d08e142859a7cbfc917c661fb5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80b319fc241ed8d08e142859a7cbfc917c661fb5.part --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:35 user nova-compute[72201]: DEBUG nova.network.neutron [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Successfully created port: 90984cd0-4fa8-4f64-bcdb-f3551a73d91b {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:29:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80b319fc241ed8d08e142859a7cbfc917c661fb5.part --force-share --output=json" returned: 0 in 0.146s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:35 user nova-compute[72201]: DEBUG nova.virt.images [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] 78d32fa9-528d-46b0-92cc-2cdea38b3808 was qcow2, converting to raw {{(pid=72201) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 15:29:35 user nova-compute[72201]: DEBUG nova.privsep.utils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72201) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 15:29:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/80b319fc241ed8d08e142859a7cbfc917c661fb5.part /opt/stack/data/nova/instances/_base/80b319fc241ed8d08e142859a7cbfc917c661fb5.converted {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/80b319fc241ed8d08e142859a7cbfc917c661fb5.part /opt/stack/data/nova/instances/_base/80b319fc241ed8d08e142859a7cbfc917c661fb5.converted" returned: 0 in 0.202s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80b319fc241ed8d08e142859a7cbfc917c661fb5.converted --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80b319fc241ed8d08e142859a7cbfc917c661fb5.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "80b319fc241ed8d08e142859a7cbfc917c661fb5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.558s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80b319fc241ed8d08e142859a7cbfc917c661fb5 --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80b319fc241ed8d08e142859a7cbfc917c661fb5 --force-share --output=json" returned: 0 in 0.141s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "80b319fc241ed8d08e142859a7cbfc917c661fb5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "80b319fc241ed8d08e142859a7cbfc917c661fb5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80b319fc241ed8d08e142859a7cbfc917c661fb5 --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80b319fc241ed8d08e142859a7cbfc917c661fb5 --force-share --output=json" returned: 0 in 0.149s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80b319fc241ed8d08e142859a7cbfc917c661fb5,backing_fmt=raw /opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903760.2385159, 930bd7a5-5dbb-40a4-a51c-3340f9eb3626 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:29:36 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] VM Stopped (Lifecycle Event)
Aug 01 15:29:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80b319fc241ed8d08e142859a7cbfc917c661fb5,backing_fmt=raw /opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2/disk 1073741824" returned: 0 in 0.065s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "80b319fc241ed8d08e142859a7cbfc917c661fb5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80b319fc241ed8d08e142859a7cbfc917c661fb5 --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG nova.compute.manager [None req-489b96c8-bda6-449f-92a2-797534bcc0d4 None None] [instance: 930bd7a5-5dbb-40a4-a51c-3340f9eb3626] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80b319fc241ed8d08e142859a7cbfc917c661fb5 --force-share --output=json" returned: 0 in 0.145s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG nova.objects.instance [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lazy-loading 'migration_context' on Instance uuid 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Ensure instance console log exists: /opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG nova.compute.manager [req-7741f921-cf7f-4ec0-99ff-8193ab4e711c req-966d2d5f-3e50-4953-94c5-9dea3b3fa516 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received event network-changed-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG nova.compute.manager [req-7741f921-cf7f-4ec0-99ff-8193ab4e711c req-966d2d5f-3e50-4953-94c5-9dea3b3fa516 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Refreshing instance network info cache due to event network-changed-1eb5fe53-2534-45e8-a39b-1eebaa30159a. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7741f921-cf7f-4ec0-99ff-8193ab4e711c req-966d2d5f-3e50-4953-94c5-9dea3b3fa516 service nova] Acquiring lock "refresh_cache-4d307a58-226b-40dd-a548-e854cf761f57" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7741f921-cf7f-4ec0-99ff-8193ab4e711c req-966d2d5f-3e50-4953-94c5-9dea3b3fa516 service nova] Acquired lock "refresh_cache-4d307a58-226b-40dd-a548-e854cf761f57" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG nova.network.neutron [req-7741f921-cf7f-4ec0-99ff-8193ab4e711c req-966d2d5f-3e50-4953-94c5-9dea3b3fa516 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Refreshing network info cache for port 1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG nova.network.neutron [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Successfully updated port: 90984cd0-4fa8-4f64-bcdb-f3551a73d91b {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "refresh_cache-2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquired lock "refresh_cache-2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:29:36 user nova-compute[72201]: DEBUG nova.network.neutron [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.compute.manager [req-d1cc2f7a-5070-4557-9601-1556081cdcd6 req-9bd85fa0-5682-460f-9041-d802e0f0976c service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Received event network-changed-90984cd0-4fa8-4f64-bcdb-f3551a73d91b {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.compute.manager [req-d1cc2f7a-5070-4557-9601-1556081cdcd6 req-9bd85fa0-5682-460f-9041-d802e0f0976c service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Refreshing instance network info cache due to event network-changed-90984cd0-4fa8-4f64-bcdb-f3551a73d91b. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d1cc2f7a-5070-4557-9601-1556081cdcd6 req-9bd85fa0-5682-460f-9041-d802e0f0976c service nova] Acquiring lock "refresh_cache-2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.network.neutron [req-7741f921-cf7f-4ec0-99ff-8193ab4e711c req-966d2d5f-3e50-4953-94c5-9dea3b3fa516 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Updated VIF entry in instance network info cache for port 1eb5fe53-2534-45e8-a39b-1eebaa30159a. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.network.neutron [req-7741f921-cf7f-4ec0-99ff-8193ab4e711c req-966d2d5f-3e50-4953-94c5-9dea3b3fa516 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Updating instance_info_cache with network_info: [{"id": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "address": "fa:16:3e:ad:58:90", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb5fe53-25", "ovs_interfaceid": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7741f921-cf7f-4ec0-99ff-8193ab4e711c req-966d2d5f-3e50-4953-94c5-9dea3b3fa516 service nova] Releasing lock "refresh_cache-4d307a58-226b-40dd-a548-e854cf761f57" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.network.neutron [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.network.neutron [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Updating instance_info_cache with network_info: [{"id": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "address": "fa:16:3e:e5:db:9d", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90984cd0-4f", "ovs_interfaceid": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Releasing lock "refresh_cache-2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.compute.manager [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Instance network_info: |[{"id": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "address": "fa:16:3e:e5:db:9d", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90984cd0-4f", "ovs_interfaceid": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d1cc2f7a-5070-4557-9601-1556081cdcd6 req-9bd85fa0-5682-460f-9041-d802e0f0976c service nova] Acquired lock "refresh_cache-2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.network.neutron [req-d1cc2f7a-5070-4557-9601-1556081cdcd6 req-9bd85fa0-5682-460f-9041-d802e0f0976c service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Refreshing network info cache for port 90984cd0-4fa8-4f64-bcdb-f3551a73d91b {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Start _get_guest_xml network_info=[{"id": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "address": "fa:16:3e:e5:db:9d", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90984cd0-4f", "ovs_interfaceid": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d7ebaf0f9f68f35e3f427018359170f4',container_format='bare',created_at=2023-08-01T15:29:24Z,direct_url=<?>,disk_format='qcow2',id=78d32fa9-528d-46b0-92cc-2cdea38b3808,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-405969598',owner='d8289b01d09f4cf4a35affa9e22fa7fd',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T15:29:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '78d32fa9-528d-46b0-92cc-2cdea38b3808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:29:37 user nova-compute[72201]: INFO nova.compute.manager [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Rebuilding instance
Aug 01 15:29:37 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:29:37 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d7ebaf0f9f68f35e3f427018359170f4',container_format='bare',created_at=2023-08-01T15:29:24Z,direct_url=<?>,disk_format='qcow2',id=78d32fa9-528d-46b0-92cc-2cdea38b3808,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-405969598',owner='d8289b01d09f4cf4a35affa9e22fa7fd',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T15:29:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:29:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1181180077',display_name='tempest-TestStampPattern-server-1181180077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1181180077',id=27,image_ref='78d32fa9-528d-46b0-92cc-2cdea38b3808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4cjcpIrCgWJ8HeEyRLEl6J/NtkzbCoKCzwQr+AGaVQkH5fVBdRsWj/5tVNxW6Q1XUhgysYXiPaBl9ORZIAWs2VQxGxCYnIlCoMMGp8aO9DwuzAUIuYOHmCwk/FaqacxQ==',key_name='tempest-TestStampPattern-853407470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8289b01d09f4cf4a35affa9e22fa7fd',ramdisk_id='',reservation_id='r-50lu7svo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='14e890ca-dc2a-4d89-a497-d55805d0c42e',image_min_disk='1',image_min_ram='0',image_owner_id='d8289b01d09f4cf4a35affa9e22fa7fd',image_owner_project_name='tempest-TestStampPattern-2066377363',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2066377363-project-member',image_user_id='7c69154feccc402f9f0d2c0aafdbdea7',network_allocated='True',owner_project_name='tempest-TestStampPattern-2066377363',owner_user_name='tempest-TestStampPattern-2066377363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:29:34Z,user_data=None,user_id='7c69154feccc402f9f0d2c0aafdbdea7',uuid=2813e0b2-5480-4098-ab5f-9fe33c1eb3c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "address": "fa:16:3e:e5:db:9d", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90984cd0-4f", "ovs_interfaceid": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Converting VIF {"id": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "address": "fa:16:3e:e5:db:9d", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90984cd0-4f", "ovs_interfaceid": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:db:9d,bridge_name='br-int',has_traffic_filtering=True,id=90984cd0-4fa8-4f64-bcdb-f3551a73d91b,network=Network(302af7b4-2054-4148-870e-a04f75c18a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90984cd0-4f') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.objects.instance [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lazy-loading 'pci_devices' on Instance uuid 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:29:37 user nova-compute[72201]:   <uuid>2813e0b2-5480-4098-ab5f-9fe33c1eb3c2</uuid>
Aug 01 15:29:37 user nova-compute[72201]:   <name>instance-0000001b</name>
Aug 01 15:29:37 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:29:37 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:29:37 user nova-compute[72201]:   <metadata>
Aug 01 15:29:37 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:29:37 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:29:37 user nova-compute[72201]:       <nova:name>tempest-TestStampPattern-server-1181180077</nova:name>
Aug 01 15:29:37 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:29:37</nova:creationTime>
Aug 01 15:29:37 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:29:37 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:29:37 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:29:37 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:29:37 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:29:37 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:29:37 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:29:37 user nova-compute[72201]:       <nova:owner>
Aug 01 15:29:37 user nova-compute[72201]:         <nova:user uuid="7c69154feccc402f9f0d2c0aafdbdea7">tempest-TestStampPattern-2066377363-project-member</nova:user>
Aug 01 15:29:37 user nova-compute[72201]:         <nova:project uuid="d8289b01d09f4cf4a35affa9e22fa7fd">tempest-TestStampPattern-2066377363</nova:project>
Aug 01 15:29:37 user nova-compute[72201]:       </nova:owner>
Aug 01 15:29:37 user nova-compute[72201]:       <nova:root type="image" uuid="78d32fa9-528d-46b0-92cc-2cdea38b3808"/>
Aug 01 15:29:37 user nova-compute[72201]:       <nova:ports>
Aug 01 15:29:37 user nova-compute[72201]:         <nova:port uuid="90984cd0-4fa8-4f64-bcdb-f3551a73d91b">
Aug 01 15:29:37 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 15:29:37 user nova-compute[72201]:         </nova:port>
Aug 01 15:29:37 user nova-compute[72201]:       </nova:ports>
Aug 01 15:29:37 user nova-compute[72201]:     </nova:instance>
Aug 01 15:29:37 user nova-compute[72201]:   </metadata>
Aug 01 15:29:37 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:29:37 user nova-compute[72201]:     <system>
Aug 01 15:29:37 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:29:37 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:29:37 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:29:37 user nova-compute[72201]:       <entry name="serial">2813e0b2-5480-4098-ab5f-9fe33c1eb3c2</entry>
Aug 01 15:29:37 user nova-compute[72201]:       <entry name="uuid">2813e0b2-5480-4098-ab5f-9fe33c1eb3c2</entry>
Aug 01 15:29:37 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:29:37 user nova-compute[72201]:     </system>
Aug 01 15:29:37 user nova-compute[72201]:   </sysinfo>
Aug 01 15:29:37 user nova-compute[72201]:   <os>
Aug 01 15:29:37 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:29:37 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:29:37 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:29:37 user nova-compute[72201]:   </os>
Aug 01 15:29:37 user nova-compute[72201]:   <features>
Aug 01 15:29:37 user nova-compute[72201]:     <acpi/>
Aug 01 15:29:37 user nova-compute[72201]:     <apic/>
Aug 01 15:29:37 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:29:37 user nova-compute[72201]:   </features>
Aug 01 15:29:37 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:29:37 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:29:37 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:29:37 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:29:37 user nova-compute[72201]:   </clock>
Aug 01 15:29:37 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:29:37 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:29:37 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:29:37 user nova-compute[72201]:   </cpu>
Aug 01 15:29:37 user nova-compute[72201]:   <devices>
Aug 01 15:29:37 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:29:37 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:29:37 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2/disk"/>
Aug 01 15:29:37 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:29:37 user nova-compute[72201]:     </disk>
Aug 01 15:29:37 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:29:37 user nova-compute[72201]:       <mac address="fa:16:3e:e5:db:9d"/>
Aug 01 15:29:37 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:29:37 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:29:37 user nova-compute[72201]:       <target dev="tap90984cd0-4f"/>
Aug 01 15:29:37 user nova-compute[72201]:     </interface>
Aug 01 15:29:37 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:29:37 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2/console.log" append="off"/>
Aug 01 15:29:37 user nova-compute[72201]:     </serial>
Aug 01 15:29:37 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:29:37 user nova-compute[72201]:     <video>
Aug 01 15:29:37 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:29:37 user nova-compute[72201]:     </video>
Aug 01 15:29:37 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:29:37 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:29:37 user nova-compute[72201]:     </rng>
Aug 01 15:29:37 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:29:37 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:29:37 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:29:37 user nova-compute[72201]:     </memballoon>
Aug 01 15:29:37 user nova-compute[72201]:   </devices>
Aug 01 15:29:37 user nova-compute[72201]: </domain>
Aug 01 15:29:37 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:29:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1181180077',display_name='tempest-TestStampPattern-server-1181180077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1181180077',id=27,image_ref='78d32fa9-528d-46b0-92cc-2cdea38b3808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4cjcpIrCgWJ8HeEyRLEl6J/NtkzbCoKCzwQr+AGaVQkH5fVBdRsWj/5tVNxW6Q1XUhgysYXiPaBl9ORZIAWs2VQxGxCYnIlCoMMGp8aO9DwuzAUIuYOHmCwk/FaqacxQ==',key_name='tempest-TestStampPattern-853407470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8289b01d09f4cf4a35affa9e22fa7fd',ramdisk_id='',reservation_id='r-50lu7svo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='14e890ca-dc2a-4d89-a497-d55805d0c42e',image_min_disk='1',image_min_ram='0',image_owner_id='d8289b01d09f4cf4a35affa9e22fa7fd',image_owner_project_name='tempest-TestStampPattern-2066377363',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2066377363-project-member',image_user_id='7c69154feccc402f9f0d2c0aafdbdea7',network_allocated='True',owner_project_name='tempest-TestStampPattern-2066377363',owner_user_name='tempest-TestStampPattern-2066377363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:29:34Z,user_data=None,user_id='7c69154feccc402f9f0d2c0aafdbdea7',uuid=2813e0b2-5480-4098-ab5f-9fe33c1eb3c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "address": "fa:16:3e:e5:db:9d", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90984cd0-4f", "ovs_interfaceid": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Converting VIF {"id": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "address": "fa:16:3e:e5:db:9d", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90984cd0-4f", "ovs_interfaceid": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:db:9d,bridge_name='br-int',has_traffic_filtering=True,id=90984cd0-4fa8-4f64-bcdb-f3551a73d91b,network=Network(302af7b4-2054-4148-870e-a04f75c18a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90984cd0-4f') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG os_vif [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:db:9d,bridge_name='br-int',has_traffic_filtering=True,id=90984cd0-4fa8-4f64-bcdb-f3551a73d91b,network=Network(302af7b4-2054-4148-870e-a04f75c18a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90984cd0-4f') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90984cd0-4f, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap90984cd0-4f, col_values=(('external_ids', {'iface-id': '90984cd0-4fa8-4f64-bcdb-f3551a73d91b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:db:9d', 'vm-uuid': '2813e0b2-5480-4098-ab5f-9fe33c1eb3c2'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:37 user nova-compute[72201]: INFO os_vif [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:db:9d,bridge_name='br-int',has_traffic_filtering=True,id=90984cd0-4fa8-4f64-bcdb-f3551a73d91b,network=Network(302af7b4-2054-4148-870e-a04f75c18a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90984cd0-4f')
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.objects.instance [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4d307a58-226b-40dd-a548-e854cf761f57 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.compute.manager [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] No VIF found with MAC fa:16:3e:e5:db:9d, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.objects.instance [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lazy-loading 'pci_requests' on Instance uuid 4d307a58-226b-40dd-a548-e854cf761f57 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.objects.instance [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d307a58-226b-40dd-a548-e854cf761f57 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.objects.instance [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lazy-loading 'resources' on Instance uuid 4d307a58-226b-40dd-a548-e854cf761f57 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.objects.instance [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lazy-loading 'migration_context' on Instance uuid 4d307a58-226b-40dd-a548-e854cf761f57 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG nova.objects.instance [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72201) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:38 user nova-compute[72201]: DEBUG nova.network.neutron [req-d1cc2f7a-5070-4557-9601-1556081cdcd6 req-9bd85fa0-5682-460f-9041-d802e0f0976c service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Updated VIF entry in instance network info cache for port 90984cd0-4fa8-4f64-bcdb-f3551a73d91b. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:29:38 user nova-compute[72201]: DEBUG nova.network.neutron [req-d1cc2f7a-5070-4557-9601-1556081cdcd6 req-9bd85fa0-5682-460f-9041-d802e0f0976c service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Updating instance_info_cache with network_info: [{"id": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "address": "fa:16:3e:e5:db:9d", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90984cd0-4f", "ovs_interfaceid": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:29:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d1cc2f7a-5070-4557-9601-1556081cdcd6 req-9bd85fa0-5682-460f-9041-d802e0f0976c service nova] Releasing lock "refresh_cache-2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:29:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-7fc7ae9e-5b1c-4fc3-9e78-4104d4083ade req-b6ce7af5-850c-4d6a-bc5e-a44528798669 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received event network-vif-unplugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7fc7ae9e-5b1c-4fc3-9e78-4104d4083ade req-b6ce7af5-850c-4d6a-bc5e-a44528798669 service nova] Acquiring lock "4d307a58-226b-40dd-a548-e854cf761f57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7fc7ae9e-5b1c-4fc3-9e78-4104d4083ade req-b6ce7af5-850c-4d6a-bc5e-a44528798669 service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7fc7ae9e-5b1c-4fc3-9e78-4104d4083ade req-b6ce7af5-850c-4d6a-bc5e-a44528798669 service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-7fc7ae9e-5b1c-4fc3-9e78-4104d4083ade req-b6ce7af5-850c-4d6a-bc5e-a44528798669 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] No waiting events found dispatching network-vif-unplugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:29:39 user nova-compute[72201]: WARNING nova.compute.manager [req-7fc7ae9e-5b1c-4fc3-9e78-4104d4083ade req-b6ce7af5-850c-4d6a-bc5e-a44528798669 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received unexpected event network-vif-unplugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a for instance with vm_state active and task_state rebuilding.
Aug 01 15:29:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-7fc7ae9e-5b1c-4fc3-9e78-4104d4083ade req-b6ce7af5-850c-4d6a-bc5e-a44528798669 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received event network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7fc7ae9e-5b1c-4fc3-9e78-4104d4083ade req-b6ce7af5-850c-4d6a-bc5e-a44528798669 service nova] Acquiring lock "4d307a58-226b-40dd-a548-e854cf761f57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7fc7ae9e-5b1c-4fc3-9e78-4104d4083ade req-b6ce7af5-850c-4d6a-bc5e-a44528798669 service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7fc7ae9e-5b1c-4fc3-9e78-4104d4083ade req-b6ce7af5-850c-4d6a-bc5e-a44528798669 service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-7fc7ae9e-5b1c-4fc3-9e78-4104d4083ade req-b6ce7af5-850c-4d6a-bc5e-a44528798669 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] No waiting events found dispatching network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:29:39 user nova-compute[72201]: WARNING nova.compute.manager [req-7fc7ae9e-5b1c-4fc3-9e78-4104d4083ade req-b6ce7af5-850c-4d6a-bc5e-a44528798669 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received unexpected event network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a for instance with vm_state active and task_state rebuilding.
Aug 01 15:29:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:39 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Instance destroyed successfully.
Aug 01 15:29:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:39 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Instance destroyed successfully.
Aug 01 15:29:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:27:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1642919789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1833175817',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqQ3JyX5grzt34vgysHqxBFLfCGjR43NVcbWJ9AgvjUJAkeBHgFdLOk4UNppE+XbYa1pHxYkJwB0eE/x04yybsP4ZAiP/yhpagpnjq+IWr2x3Qlg+8KzJgt+RkxU443Og==',key_name='tempest-keypair-714015429',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:27:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0a434898181465ea2df89c7b1e42597',ramdisk_id='',reservation_id='r-0et8cou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1609612653',owner_user_name='tempest-ServerActionsV293TestJSON-1609612653-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:29:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32967fa82739495685f336d7ace68000',uuid=4d307a58-226b-40dd-a548-e854cf761f57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "address": "fa:16:3e:ad:58:90", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb5fe53-25", "ovs_interfaceid": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Converting VIF {"id": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "address": "fa:16:3e:ad:58:90", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb5fe53-25", "ovs_interfaceid": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:58:90,bridge_name='br-int',has_traffic_filtering=True,id=1eb5fe53-2534-45e8-a39b-1eebaa30159a,network=Network(968d4faa-613e-4954-86cc-3df6b86a2491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb5fe53-25') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_vif [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:58:90,bridge_name='br-int',has_traffic_filtering=True,id=1eb5fe53-2534-45e8-a39b-1eebaa30159a,network=Network(968d4faa-613e-4954-86cc-3df6b86a2491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb5fe53-25') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1eb5fe53-25, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:39 user nova-compute[72201]: INFO os_vif [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:58:90,bridge_name='br-int',has_traffic_filtering=True,id=1eb5fe53-2534-45e8-a39b-1eebaa30159a,network=Network(968d4faa-613e-4954-86cc-3df6b86a2491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb5fe53-25')
Aug 01 15:29:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkrBcZdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:29:39 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56c4ab1-f362-464e-908c-529f9a135ee8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[439742fd-c0b4-4dc6-ad8b-ad08bb42a60f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:29:39 user nova-compute[72201]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:29:39 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:29:39 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:29:39 user nova-compute[72201]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:29:39 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:29:39 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5443056c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926'): ({'sdb'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Removing single pathed devices sdb {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bead3306-f3b4-4b98-b477-067073c6e71f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61062ef-fad5-4285-ab17-390ce0de2e60]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Flushing IO for device /dev/sdb {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ad35ef-9b12-4d8b-9ebc-f7ab214e53d2]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4905077a-0d16-4a58-93e8-2791c9a4f08e]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[565ef898-2011-4838-aec8-d4df0307c5cb]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a08e95a-1023-4215-be00-41eb84421e99]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926, portal: 172.16.0.220,3260]
Aug 01 15:29:39 user nova-compute[72201]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926, portal: 172.16.0.220,3260] successful.
Aug 01 15:29:39 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c2f760-41d3-419a-bb2c-7050445f0b6a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] <== disconnect_volume: return (366ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:29:39 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Deleting instance files /opt/stack/data/nova/instances/4d307a58-226b-40dd-a548-e854cf761f57_del
Aug 01 15:29:39 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Deletion of /opt/stack/data/nova/instances/4d307a58-226b-40dd-a548-e854cf761f57_del complete
Aug 01 15:29:39 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 4d307a58-226b-40dd-a548-e854cf761f57 could not be found.
Aug 01 15:29:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkrBcZdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:29:39 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5226defb-1608-492a-8a77-69a42aabaaf0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bd35bb-4b9b-4f23-a026-13f3e0f8fabb]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:29:39 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:29:39 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:29:39 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:29:39 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5441bd480>, {}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Disconnecting from: [] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.056s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] <== disconnect_volume: return (57ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:29:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:29:40 user nova-compute[72201]: DEBUG nova.compute.manager [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Preparing to wait for external event volume-reimaged-002775d0-efbb-42ab-aa46-9e065adaa926 {{(pid=72201) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 01 15:29:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "4d307a58-226b-40dd-a548-e854cf761f57-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received event network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] Acquiring lock "4d307a58-226b-40dd-a548-e854cf761f57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] No event matching network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a in dict_keys([('volume-reimaged', '002775d0-efbb-42ab-aa46-9e065adaa926')]) {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 01 15:29:41 user nova-compute[72201]: WARNING nova.compute.manager [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received unexpected event network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a for instance with vm_state active and task_state rebuilding.
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received event network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] Acquiring lock "4d307a58-226b-40dd-a548-e854cf761f57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] No event matching network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a in dict_keys([('volume-reimaged', '002775d0-efbb-42ab-aa46-9e065adaa926')]) {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 01 15:29:41 user nova-compute[72201]: WARNING nova.compute.manager [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received unexpected event network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a for instance with vm_state active and task_state rebuilding.
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received event network-vif-unplugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] Acquiring lock "4d307a58-226b-40dd-a548-e854cf761f57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] No event matching network-vif-unplugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a in dict_keys([('volume-reimaged', '002775d0-efbb-42ab-aa46-9e065adaa926')]) {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 01 15:29:41 user nova-compute[72201]: WARNING nova.compute.manager [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received unexpected event network-vif-unplugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a for instance with vm_state active and task_state rebuilding.
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received event network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] Acquiring lock "4d307a58-226b-40dd-a548-e854cf761f57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] No event matching network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a in dict_keys([('volume-reimaged', '002775d0-efbb-42ab-aa46-9e065adaa926')]) {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 01 15:29:41 user nova-compute[72201]: WARNING nova.compute.manager [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received unexpected event network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a for instance with vm_state active and task_state rebuilding.
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Received event network-vif-plugged-90984cd0-4fa8-4f64-bcdb-f3551a73d91b {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] Acquiring lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] Lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] Lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] No waiting events found dispatching network-vif-plugged-90984cd0-4fa8-4f64-bcdb-f3551a73d91b {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:29:41 user nova-compute[72201]: WARNING nova.compute.manager [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Received unexpected event network-vif-plugged-90984cd0-4fa8-4f64-bcdb-f3551a73d91b for instance with vm_state building and task_state spawning.
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Received event network-vif-plugged-90984cd0-4fa8-4f64-bcdb-f3551a73d91b {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] Acquiring lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] Lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] Lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] No waiting events found dispatching network-vif-plugged-90984cd0-4fa8-4f64-bcdb-f3551a73d91b {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:29:41 user nova-compute[72201]: WARNING nova.compute.manager [req-54af7dea-1025-4dd2-995f-1e1a0b92cb9f req-a3538cce-089b-4689-8741-c63aef8ced55 service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Received unexpected event network-vif-plugged-90984cd0-4fa8-4f64-bcdb-f3551a73d91b for instance with vm_state building and task_state spawning.
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903781.8865385, 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:29:41 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] VM Resumed (Lifecycle Event)
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.compute.manager [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:29:41 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Instance spawned successfully.
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:29:41 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903781.8878117, 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:29:41 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] VM Started (Lifecycle Event)
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:29:41 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:29:42 user nova-compute[72201]: INFO nova.compute.manager [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Took 7.75 seconds to spawn the instance on the hypervisor.
Aug 01 15:29:42 user nova-compute[72201]: DEBUG nova.compute.manager [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:29:42 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:29:42 user nova-compute[72201]: INFO nova.compute.manager [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Took 8.76 seconds to build instance.
Aug 01 15:29:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-24636aca-c4a2-40ef-8ada-2abc5635294c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.864s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:48 user nova-compute[72201]: DEBUG nova.compute.manager [req-863e9b15-4076-4781-8d93-8f814d3f005e req-9d7751b5-a872-47d2-91ae-f30d69e1c4d5 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received event network-changed-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:48 user nova-compute[72201]: DEBUG nova.compute.manager [req-863e9b15-4076-4781-8d93-8f814d3f005e req-9d7751b5-a872-47d2-91ae-f30d69e1c4d5 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Refreshing instance network info cache due to event network-changed-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:29:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-863e9b15-4076-4781-8d93-8f814d3f005e req-9d7751b5-a872-47d2-91ae-f30d69e1c4d5 service nova] Acquiring lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:29:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-863e9b15-4076-4781-8d93-8f814d3f005e req-9d7751b5-a872-47d2-91ae-f30d69e1c4d5 service nova] Acquired lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:29:48 user nova-compute[72201]: DEBUG nova.network.neutron [req-863e9b15-4076-4781-8d93-8f814d3f005e req-9d7751b5-a872-47d2-91ae-f30d69e1c4d5 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Refreshing network info cache for port 2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:29:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:48 user nova-compute[72201]: DEBUG nova.network.neutron [req-863e9b15-4076-4781-8d93-8f814d3f005e req-9d7751b5-a872-47d2-91ae-f30d69e1c4d5 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Updated VIF entry in instance network info cache for port 2cccc4c0-1ece-49a9-9e19-065c8fe55d9f. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:29:48 user nova-compute[72201]: DEBUG nova.network.neutron [req-863e9b15-4076-4781-8d93-8f814d3f005e req-9d7751b5-a872-47d2-91ae-f30d69e1c4d5 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Updating instance_info_cache with network_info: [{"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:29:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-863e9b15-4076-4781-8d93-8f814d3f005e req-9d7751b5-a872-47d2-91ae-f30d69e1c4d5 service nova] Releasing lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:29:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:54 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903779.1394842, 4d307a58-226b-40dd-a548-e854cf761f57 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:29:54 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] VM Stopped (Lifecycle Event)
Aug 01 15:29:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9fedad26-a5c7-4a48-b614-2811060c3f54 None None] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:29:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG nova.objects.instance [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lazy-loading 'flavor' on Instance uuid ed5f91f1-b3fd-4737-8ed6-fca13617bd6e {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:55 user nova-compute[72201]: INFO nova.compute.manager [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Attaching volume 5029d699-a8e1-47e1-baf9-1ca8c0d05aee to /dev/vdb
Aug 01 15:29:55 user nova-compute[72201]: DEBUG os_brick.utils [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5ff0f3-5bff-4319-83e1-5bd68fe9d412]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fca4d30-9212-46f0-b537-98db2ba2df71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79d120d-e314-45e2-966e-4be1f8111000]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[211ef8ce-35bf-450c-9fca-3a5c3d4e095a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:29:55 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:29:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[48236461-1a3f-49d9-b586-8a2b485fa3f4]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG os_brick.utils [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:29:55 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Updating existing volume attachment record: ae52f3d4-d675-4fda-be40-98117376a875 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:29:57 user nova-compute[72201]: DEBUG nova.compute.manager [req-600fc06d-c128-405a-8096-d93009f0e73b req-cab563e7-5703-43a7-961b-4942213adf3d service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received event volume-reimaged-002775d0-efbb-42ab-aa46-9e065adaa926 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:29:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-600fc06d-c128-405a-8096-d93009f0e73b req-cab563e7-5703-43a7-961b-4942213adf3d service nova] Acquiring lock "4d307a58-226b-40dd-a548-e854cf761f57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:29:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-600fc06d-c128-405a-8096-d93009f0e73b req-cab563e7-5703-43a7-961b-4942213adf3d service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:29:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-600fc06d-c128-405a-8096-d93009f0e73b req-cab563e7-5703-43a7-961b-4942213adf3d service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:29:57 user nova-compute[72201]: DEBUG nova.compute.manager [req-600fc06d-c128-405a-8096-d93009f0e73b req-cab563e7-5703-43a7-961b-4942213adf3d service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Processing event volume-reimaged-002775d0-efbb-42ab-aa46-9e065adaa926 {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 01 15:29:57 user nova-compute[72201]: DEBUG nova.compute.manager [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Instance event wait completed in 16 seconds for volume-reimaged {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:29:58 user nova-compute[72201]: INFO nova.virt.block_device [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Booting with volume 002775d0-efbb-42ab-aa46-9e065adaa926 at /dev/vda
Aug 01 15:29:58 user nova-compute[72201]: DEBUG os_brick.utils [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:29:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:58 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e64da7-5720-48fb-9916-5aea2b7d93a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:58 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ce2e5c-10ed-477a-bdfb-977fde693bba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:29:58 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcd882c-457a-4513-b49b-089d172b201b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:58 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1065d753-01a8-4d29-a863-0922bd011f49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:29:58 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:29:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:29:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:29:58 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:29:58 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[907471a2-b56e-473f-8e71-71e214a4c79c]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:29:58 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:29:58 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:29:58 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:29:58 user nova-compute[72201]: DEBUG os_brick.utils [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:29:58 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Updating existing volume attachment record: 91d37a2e-30e2-4b6d-a108-b36c11cbd52f {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:29:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:29:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquiring lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:00 user nova-compute[72201]: DEBUG nova.compute.manager [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:30:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:30:00 user nova-compute[72201]: INFO nova.compute.claims [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Claim successful on node user
Aug 01 15:30:00 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:30:00 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:30:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:00 user nova-compute[72201]: DEBUG nova.compute.manager [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:30:00 user nova-compute[72201]: DEBUG nova.compute.manager [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:30:00 user nova-compute[72201]: DEBUG nova.network.neutron [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:30:00 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:30:00 user nova-compute[72201]: DEBUG nova.compute.manager [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG nova.compute.manager [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:30:01 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Creating image(s)
Aug 01 15:30:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquiring lock "/opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "/opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "/opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG nova.policy [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f54d83edcf3a4816b7d30714dd0b20b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa68dc043d456f85c918466114934f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.186s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.176s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk 1073741824" returned: 0 in 0.064s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.187s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Cannot resize image /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG nova.objects.instance [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lazy-loading 'migration_context' on Instance uuid eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Ensure instance console log exists: /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:02 user nova-compute[72201]: DEBUG nova.network.neutron [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Successfully created port: 001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:30:02 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:30:02 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:30:02 user nova-compute[72201]: DEBUG nova.network.neutron [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Successfully updated port: 001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:30:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquiring lock "refresh_cache-eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:30:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquired lock "refresh_cache-eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:30:02 user nova-compute[72201]: DEBUG nova.network.neutron [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:30:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-7baa3413-2838-4ddb-b514-ab2c4f85ed41 req-d7813166-fa97-470f-b592-f7f7d93feb5e service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Received event network-changed-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-7baa3413-2838-4ddb-b514-ab2c4f85ed41 req-d7813166-fa97-470f-b592-f7f7d93feb5e service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Refreshing instance network info cache due to event network-changed-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:30:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7baa3413-2838-4ddb-b514-ab2c4f85ed41 req-d7813166-fa97-470f-b592-f7f7d93feb5e service nova] Acquiring lock "refresh_cache-eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:30:02 user nova-compute[72201]: DEBUG nova.network.neutron [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.network.neutron [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Updating instance_info_cache with network_info: [{"id": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "address": "fa:16:3e:b2:68:3a", "network": {"id": "0a5cd34a-6838-4b6e-b44b-5d561a6a1573", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-719005822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fa68dc043d456f85c918466114934f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001b32aa-da", "ovs_interfaceid": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Releasing lock "refresh_cache-eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.compute.manager [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Instance network_info: |[{"id": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "address": "fa:16:3e:b2:68:3a", "network": {"id": "0a5cd34a-6838-4b6e-b44b-5d561a6a1573", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-719005822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fa68dc043d456f85c918466114934f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001b32aa-da", "ovs_interfaceid": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7baa3413-2838-4ddb-b514-ab2c4f85ed41 req-d7813166-fa97-470f-b592-f7f7d93feb5e service nova] Acquired lock "refresh_cache-eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.network.neutron [req-7baa3413-2838-4ddb-b514-ab2c4f85ed41 req-d7813166-fa97-470f-b592-f7f7d93feb5e service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Refreshing network info cache for port 001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Start _get_guest_xml network_info=[{"id": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "address": "fa:16:3e:b2:68:3a", "network": {"id": "0a5cd34a-6838-4b6e-b44b-5d561a6a1573", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-719005822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fa68dc043d456f85c918466114934f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001b32aa-da", "ovs_interfaceid": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:30:03 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:30:03 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:29:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1259013972',display_name='tempest-TestServerVolumeAttachmentScenario-server-1259013972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1259013972',id=28,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWP+JYsGMev02QM0JIA9apIF5G6P/qi4HJmT2Ye1rdJdIsbQJKEtEANSTb8xt9oxCa1Rzb8weZKKOwv9sqI5FEsl+7Flpo3H5Jdll4/XjqLqaLLGOQS2tbmpCzYp5ucxA==',key_name='tempest-keypair-1383056269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1fa68dc043d456f85c918466114934f',ramdisk_id='',reservation_id='r-7kjs6382',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1394607266',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1394607266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f54d83edcf3a4816b7d30714dd0b20b9',uuid=eaf8c38a-c309-4a7a-a8d5-11f82deae5f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "address": "fa:16:3e:b2:68:3a", "network": {"id": "0a5cd34a-6838-4b6e-b44b-5d561a6a1573", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-719005822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fa68dc043d456f85c918466114934f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001b32aa-da", "ovs_interfaceid": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Converting VIF {"id": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "address": "fa:16:3e:b2:68:3a", "network": {"id": "0a5cd34a-6838-4b6e-b44b-5d561a6a1573", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-719005822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fa68dc043d456f85c918466114934f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001b32aa-da", "ovs_interfaceid": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:68:3a,bridge_name='br-int',has_traffic_filtering=True,id=001b32aa-da69-4d16-8f4c-ab2a0a5b91d8,network=Network(0a5cd34a-6838-4b6e-b44b-5d561a6a1573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap001b32aa-da') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.objects.instance [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lazy-loading 'pci_devices' on Instance uuid eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:30:03 user nova-compute[72201]:   <uuid>eaf8c38a-c309-4a7a-a8d5-11f82deae5f2</uuid>
Aug 01 15:30:03 user nova-compute[72201]:   <name>instance-0000001c</name>
Aug 01 15:30:03 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:30:03 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:30:03 user nova-compute[72201]:   <metadata>
Aug 01 15:30:03 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:30:03 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:30:03 user nova-compute[72201]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1259013972</nova:name>
Aug 01 15:30:03 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:30:03</nova:creationTime>
Aug 01 15:30:03 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:30:03 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:30:03 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:30:03 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:30:03 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:30:03 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:30:03 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:30:03 user nova-compute[72201]:       <nova:owner>
Aug 01 15:30:03 user nova-compute[72201]:         <nova:user uuid="f54d83edcf3a4816b7d30714dd0b20b9">tempest-TestServerVolumeAttachmentScenario-1394607266-project-member</nova:user>
Aug 01 15:30:03 user nova-compute[72201]:         <nova:project uuid="d1fa68dc043d456f85c918466114934f">tempest-TestServerVolumeAttachmentScenario-1394607266</nova:project>
Aug 01 15:30:03 user nova-compute[72201]:       </nova:owner>
Aug 01 15:30:03 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:30:03 user nova-compute[72201]:       <nova:ports>
Aug 01 15:30:03 user nova-compute[72201]:         <nova:port uuid="001b32aa-da69-4d16-8f4c-ab2a0a5b91d8">
Aug 01 15:30:03 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 15:30:03 user nova-compute[72201]:         </nova:port>
Aug 01 15:30:03 user nova-compute[72201]:       </nova:ports>
Aug 01 15:30:03 user nova-compute[72201]:     </nova:instance>
Aug 01 15:30:03 user nova-compute[72201]:   </metadata>
Aug 01 15:30:03 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:30:03 user nova-compute[72201]:     <system>
Aug 01 15:30:03 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:30:03 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:30:03 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:30:03 user nova-compute[72201]:       <entry name="serial">eaf8c38a-c309-4a7a-a8d5-11f82deae5f2</entry>
Aug 01 15:30:03 user nova-compute[72201]:       <entry name="uuid">eaf8c38a-c309-4a7a-a8d5-11f82deae5f2</entry>
Aug 01 15:30:03 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:30:03 user nova-compute[72201]:     </system>
Aug 01 15:30:03 user nova-compute[72201]:   </sysinfo>
Aug 01 15:30:03 user nova-compute[72201]:   <os>
Aug 01 15:30:03 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:30:03 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:30:03 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:30:03 user nova-compute[72201]:   </os>
Aug 01 15:30:03 user nova-compute[72201]:   <features>
Aug 01 15:30:03 user nova-compute[72201]:     <acpi/>
Aug 01 15:30:03 user nova-compute[72201]:     <apic/>
Aug 01 15:30:03 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:30:03 user nova-compute[72201]:   </features>
Aug 01 15:30:03 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:30:03 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:30:03 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:30:03 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:30:03 user nova-compute[72201]:   </clock>
Aug 01 15:30:03 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:30:03 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:30:03 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:30:03 user nova-compute[72201]:   </cpu>
Aug 01 15:30:03 user nova-compute[72201]:   <devices>
Aug 01 15:30:03 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:30:03 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:30:03 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk"/>
Aug 01 15:30:03 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:30:03 user nova-compute[72201]:     </disk>
Aug 01 15:30:03 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:30:03 user nova-compute[72201]:       <mac address="fa:16:3e:b2:68:3a"/>
Aug 01 15:30:03 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:30:03 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:30:03 user nova-compute[72201]:       <target dev="tap001b32aa-da"/>
Aug 01 15:30:03 user nova-compute[72201]:     </interface>
Aug 01 15:30:03 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:30:03 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/console.log" append="off"/>
Aug 01 15:30:03 user nova-compute[72201]:     </serial>
Aug 01 15:30:03 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:30:03 user nova-compute[72201]:     <video>
Aug 01 15:30:03 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:30:03 user nova-compute[72201]:     </video>
Aug 01 15:30:03 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:30:03 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:30:03 user nova-compute[72201]:     </rng>
Aug 01 15:30:03 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:30:03 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:30:03 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:30:03 user nova-compute[72201]:     </memballoon>
Aug 01 15:30:03 user nova-compute[72201]:   </devices>
Aug 01 15:30:03 user nova-compute[72201]: </domain>
Aug 01 15:30:03 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:29:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1259013972',display_name='tempest-TestServerVolumeAttachmentScenario-server-1259013972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1259013972',id=28,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWP+JYsGMev02QM0JIA9apIF5G6P/qi4HJmT2Ye1rdJdIsbQJKEtEANSTb8xt9oxCa1Rzb8weZKKOwv9sqI5FEsl+7Flpo3H5Jdll4/XjqLqaLLGOQS2tbmpCzYp5ucxA==',key_name='tempest-keypair-1383056269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1fa68dc043d456f85c918466114934f',ramdisk_id='',reservation_id='r-7kjs6382',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1394607266',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1394607266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f54d83edcf3a4816b7d30714dd0b20b9',uuid=eaf8c38a-c309-4a7a-a8d5-11f82deae5f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "address": "fa:16:3e:b2:68:3a", "network": {"id": "0a5cd34a-6838-4b6e-b44b-5d561a6a1573", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-719005822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fa68dc043d456f85c918466114934f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001b32aa-da", "ovs_interfaceid": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Converting VIF {"id": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "address": "fa:16:3e:b2:68:3a", "network": {"id": "0a5cd34a-6838-4b6e-b44b-5d561a6a1573", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-719005822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fa68dc043d456f85c918466114934f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001b32aa-da", "ovs_interfaceid": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:68:3a,bridge_name='br-int',has_traffic_filtering=True,id=001b32aa-da69-4d16-8f4c-ab2a0a5b91d8,network=Network(0a5cd34a-6838-4b6e-b44b-5d561a6a1573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap001b32aa-da') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG os_vif [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:68:3a,bridge_name='br-int',has_traffic_filtering=True,id=001b32aa-da69-4d16-8f4c-ab2a0a5b91d8,network=Network(0a5cd34a-6838-4b6e-b44b-5d561a6a1573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap001b32aa-da') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap001b32aa-da, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap001b32aa-da, col_values=(('external_ids', {'iface-id': '001b32aa-da69-4d16-8f4c-ab2a0a5b91d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:68:3a', 'vm-uuid': 'eaf8c38a-c309-4a7a-a8d5-11f82deae5f2'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:03 user nova-compute[72201]: INFO os_vif [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:68:3a,bridge_name='br-int',has_traffic_filtering=True,id=001b32aa-da69-4d16-8f4c-ab2a0a5b91d8,network=Network(0a5cd34a-6838-4b6e-b44b-5d561a6a1573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap001b32aa-da')
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] No VIF found with MAC fa:16:3e:b2:68:3a, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.network.neutron [req-7baa3413-2838-4ddb-b514-ab2c4f85ed41 req-d7813166-fa97-470f-b592-f7f7d93feb5e service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Updated VIF entry in instance network info cache for port 001b32aa-da69-4d16-8f4c-ab2a0a5b91d8. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG nova.network.neutron [req-7baa3413-2838-4ddb-b514-ab2c4f85ed41 req-d7813166-fa97-470f-b592-f7f7d93feb5e service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Updating instance_info_cache with network_info: [{"id": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "address": "fa:16:3e:b2:68:3a", "network": {"id": "0a5cd34a-6838-4b6e-b44b-5d561a6a1573", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-719005822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fa68dc043d456f85c918466114934f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001b32aa-da", "ovs_interfaceid": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:30:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7baa3413-2838-4ddb-b514-ab2c4f85ed41 req-d7813166-fa97-470f-b592-f7f7d93feb5e service nova] Releasing lock "refresh_cache-eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Updating instance_info_cache with network_info: [{"id": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "address": "fa:16:3e:49:45:f6", "network": {"id": "11d4bdb2-99b5-468c-aeb3-79328fdd2d1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58b7341ffe06448bb276bdee2d242c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf512d66-cb", "ovs_interfaceid": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCKQTRfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:30:04 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:30:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:30:04 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:30:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:30:04 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d70451c-1443-4b44-be82-3ce3f6d59ec2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:30:04 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13e1642-9f13-45a4-a749-69a8c7a2108b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee] added
Aug 01 15:30:04 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccaa3e5-fa0e-48d8-9a5e-ec0cbbf399b9]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a443eb07-c86c-42fd-a014-3bca80e2850b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mCKQTRfw {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mCKQTRfw" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e8403c-b4bf-4c51-a5da-a9d27868b456]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mCKQTRfw'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d9327a-2140-49ee-9c3d-d110645a0475]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[512e3a4a-2af4-489b-bd41-fb6cf4d8d171]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:30:04 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:30:04 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:30:04 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:30:04 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e283c9-1f76-47e4-836d-4a30020fda87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee, portal: 172.16.0.220,3260]
Aug 01 15:30:04 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee, portal: 172.16.0.220,3260] successful.
Aug 01 15:30:04 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a63e31-3dee-4e64-8709-e1fc4060f8e9]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-0be5d851-346b-4bd0-b027-bc1faeea6b1e req-3afb6b20-8d71-40ad-b58a-a55c66553b32 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Received event network-vif-plugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0be5d851-346b-4bd0-b027-bc1faeea6b1e req-3afb6b20-8d71-40ad-b58a-a55c66553b32 service nova] Acquiring lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0be5d851-346b-4bd0-b027-bc1faeea6b1e req-3afb6b20-8d71-40ad-b58a-a55c66553b32 service nova] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0be5d851-346b-4bd0-b027-bc1faeea6b1e req-3afb6b20-8d71-40ad-b58a-a55c66553b32 service nova] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-0be5d851-346b-4bd0-b027-bc1faeea6b1e req-3afb6b20-8d71-40ad-b58a-a55c66553b32 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] No waiting events found dispatching network-vif-plugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:30:05 user nova-compute[72201]: WARNING nova.compute.manager [req-0be5d851-346b-4bd0-b027-bc1faeea6b1e req-3afb6b20-8d71-40ad-b58a-a55c66553b32 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Received unexpected event network-vif-plugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 for instance with vm_state building and task_state spawning.
Aug 01 15:30:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0a4b85-1bdf-48f2-b7ce-0f40de2cd6d3]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:30:05 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:30:05 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:30:05 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:30:05 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:30:05 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:30:05 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dacfe8-edf7-4c5e-8264-bc32ab28f171]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCKQTRfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26532383739323666', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532383739323666', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.objects.instance [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lazy-loading 'flavor' on Instance uuid ed5f91f1-b3fd-4737-8ed6-fca13617bd6e {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:30:06 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:30:06 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 15:30:06 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:30:06 user nova-compute[72201]:   <serial>5029d699-a8e1-47e1-baf9-1ca8c0d05aee</serial>
Aug 01 15:30:06 user nova-compute[72201]: </disk>
Aug 01 15:30:06 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] No VIF found with MAC fa:16:3e:89:dd:94, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:30:06 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Creating image(s)
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Did not create local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Ensure instance console log exists: /opt/stack/data/nova/instances/4d307a58-226b-40dd-a548-e854cf761f57/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Start _get_guest_xml network_info=[{"id": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "address": "fa:16:3e:ad:58:90", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb5fe53-25", "ovs_interfaceid": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkrBcZdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4d307a58-226b-40dd-a548-e854cf761f57', 'attached_at': '', 'detached_at': '', 'volume_id': '002775d0-efbb-42ab-aa46-9e065adaa926', 'serial': '002775d0-efbb-42ab-aa46-9e065adaa926'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '91d37a2e-30e2-4b6d-a108-b36c11cbd52f', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:30:06 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 15:30:06 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.objects.instance [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4d307a58-226b-40dd-a548-e854cf761f57 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkrBcZdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:30:06 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:30:06 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:30:06 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f1659b-367f-4795-b976-0e00c4671c04]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:30:06 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4f169b6c-e59b-441d-baa4-e676cd3f7833 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.010s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7b1d20-1f0d-4862-88e8-8006195e86d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926] added
Aug 01 15:30:06 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cb035d-19e3-4e90-bca2-48a204727742]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6e0c95-8e43-4989-9b9e-475296cc1a3c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hkrBcZdt {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hkrBcZdt" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[26939c01-14ba-45ea-b54d-74be48a811ca]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hkrBcZdt'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0446e889-6460-4c39-9b4f-70f9f572274c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef5f3c6-6ea7-4c4a-bd84-7bd7819f04e8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:30:06 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:30:06 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:30:06 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:30:06 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:30:06 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:30:06 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1323c1-64d2-40f6-8ab1-31607570e225]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926, portal: 172.16.0.220,3260]
Aug 01 15:30:06 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926, portal: 172.16.0.220,3260] successful.
Aug 01 15:30:06 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903806.9064384, eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:30:06 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] VM Resumed (Lifecycle Event)
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.compute.manager [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:30:06 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Instance spawned successfully.
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9742e311-fd27-4b2a-8f48-a77baeeb3114]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:06 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903806.9118876, eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:30:06 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] VM Started (Lifecycle Event)
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6815cbc9-530c-4185-8294-89234999d8fb]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:30:06 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:30:06 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:30:06 user nova-compute[72201]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:30:06 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:30:06 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:30:06 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:30:06 user nova-compute[72201]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:30:06 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee084e11-325b-4787-a571-f0082361e56a]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:30:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkrBcZdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:30:07 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:30:07 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:30:07 user nova-compute[72201]: INFO nova.compute.manager [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Took 5.92 seconds to spawn the instance on the hypervisor.
Aug 01 15:30:07 user nova-compute[72201]: DEBUG nova.compute.manager [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:30:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-f4d294d5-8454-4e50-9ccc-29a9aea126be req-017ae5e8-4d0a-4034-9fe7-be5ecfd39cb8 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Received event network-vif-plugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f4d294d5-8454-4e50-9ccc-29a9aea126be req-017ae5e8-4d0a-4034-9fe7-be5ecfd39cb8 service nova] Acquiring lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f4d294d5-8454-4e50-9ccc-29a9aea126be req-017ae5e8-4d0a-4034-9fe7-be5ecfd39cb8 service nova] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f4d294d5-8454-4e50-9ccc-29a9aea126be req-017ae5e8-4d0a-4034-9fe7-be5ecfd39cb8 service nova] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-f4d294d5-8454-4e50-9ccc-29a9aea126be req-017ae5e8-4d0a-4034-9fe7-be5ecfd39cb8 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] No waiting events found dispatching network-vif-plugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:30:07 user nova-compute[72201]: WARNING nova.compute.manager [req-f4d294d5-8454-4e50-9ccc-29a9aea126be req-017ae5e8-4d0a-4034-9fe7-be5ecfd39cb8 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Received unexpected event network-vif-plugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 for instance with vm_state building and task_state spawning.
Aug 01 15:30:07 user nova-compute[72201]: INFO nova.compute.manager [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Took 7.04 seconds to build instance.
Aug 01 15:30:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-1ddc47f2-bd33-425f-b36e-196822a510bb tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.144s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23030386464363935', 'path': '/dev/sde'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030386464363935', 'path': '/dev/sde'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T15:27:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1642919789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1833175817',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqQ3JyX5grzt34vgysHqxBFLfCGjR43NVcbWJ9AgvjUJAkeBHgFdLOk4UNppE+XbYa1pHxYkJwB0eE/x04yybsP4ZAiP/yhpagpnjq+IWr2x3Qlg+8KzJgt+RkxU443Og==',key_name='tempest-keypair-714015429',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:27:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0a434898181465ea2df89c7b1e42597',ramdisk_id='',reservation_id='r-0et8cou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1609612653',owner_user_name='tempest-ServerActionsV293TestJSON-1609612653-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:29:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32967fa82739495685f336d7ace68000',uuid=4d307a58-226b-40dd-a548-e854cf761f57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "address": "fa:16:3e:ad:58:90", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb5fe53-25", "ovs_interfaceid": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Converting VIF {"id": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "address": "fa:16:3e:ad:58:90", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb5fe53-25", "ovs_interfaceid": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:58:90,bridge_name='br-int',has_traffic_filtering=True,id=1eb5fe53-2534-45e8-a39b-1eebaa30159a,network=Network(968d4faa-613e-4954-86cc-3df6b86a2491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb5fe53-25') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:30:08 user nova-compute[72201]:   <uuid>4d307a58-226b-40dd-a548-e854cf761f57</uuid>
Aug 01 15:30:08 user nova-compute[72201]:   <name>instance-00000016</name>
Aug 01 15:30:08 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:30:08 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:30:08 user nova-compute[72201]:   <metadata>
Aug 01 15:30:08 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:30:08 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:30:08 user nova-compute[72201]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1642919789</nova:name>
Aug 01 15:30:08 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:30:06</nova:creationTime>
Aug 01 15:30:08 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:30:08 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:30:08 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:30:08 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:30:08 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:30:08 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:30:08 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:30:08 user nova-compute[72201]:       <nova:owner>
Aug 01 15:30:08 user nova-compute[72201]:         <nova:user uuid="32967fa82739495685f336d7ace68000">tempest-ServerActionsV293TestJSON-1609612653-project-member</nova:user>
Aug 01 15:30:08 user nova-compute[72201]:         <nova:project uuid="b0a434898181465ea2df89c7b1e42597">tempest-ServerActionsV293TestJSON-1609612653</nova:project>
Aug 01 15:30:08 user nova-compute[72201]:       </nova:owner>
Aug 01 15:30:08 user nova-compute[72201]:       <nova:ports>
Aug 01 15:30:08 user nova-compute[72201]:         <nova:port uuid="1eb5fe53-2534-45e8-a39b-1eebaa30159a">
Aug 01 15:30:08 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 15:30:08 user nova-compute[72201]:         </nova:port>
Aug 01 15:30:08 user nova-compute[72201]:       </nova:ports>
Aug 01 15:30:08 user nova-compute[72201]:     </nova:instance>
Aug 01 15:30:08 user nova-compute[72201]:   </metadata>
Aug 01 15:30:08 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:30:08 user nova-compute[72201]:     <system>
Aug 01 15:30:08 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:30:08 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:30:08 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:30:08 user nova-compute[72201]:       <entry name="serial">4d307a58-226b-40dd-a548-e854cf761f57</entry>
Aug 01 15:30:08 user nova-compute[72201]:       <entry name="uuid">4d307a58-226b-40dd-a548-e854cf761f57</entry>
Aug 01 15:30:08 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:30:08 user nova-compute[72201]:     </system>
Aug 01 15:30:08 user nova-compute[72201]:   </sysinfo>
Aug 01 15:30:08 user nova-compute[72201]:   <os>
Aug 01 15:30:08 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:30:08 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:30:08 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:30:08 user nova-compute[72201]:   </os>
Aug 01 15:30:08 user nova-compute[72201]:   <features>
Aug 01 15:30:08 user nova-compute[72201]:     <acpi/>
Aug 01 15:30:08 user nova-compute[72201]:     <apic/>
Aug 01 15:30:08 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:30:08 user nova-compute[72201]:   </features>
Aug 01 15:30:08 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:30:08 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:30:08 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:30:08 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:30:08 user nova-compute[72201]:   </clock>
Aug 01 15:30:08 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:30:08 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:30:08 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:30:08 user nova-compute[72201]:   </cpu>
Aug 01 15:30:08 user nova-compute[72201]:   <devices>
Aug 01 15:30:08 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:30:08 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:30:08 user nova-compute[72201]:       <source dev="/dev/sde"/>
Aug 01 15:30:08 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:30:08 user nova-compute[72201]:       <serial>002775d0-efbb-42ab-aa46-9e065adaa926</serial>
Aug 01 15:30:08 user nova-compute[72201]:     </disk>
Aug 01 15:30:08 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:30:08 user nova-compute[72201]:       <mac address="fa:16:3e:ad:58:90"/>
Aug 01 15:30:08 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:30:08 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:30:08 user nova-compute[72201]:       <target dev="tap1eb5fe53-25"/>
Aug 01 15:30:08 user nova-compute[72201]:     </interface>
Aug 01 15:30:08 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:30:08 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/4d307a58-226b-40dd-a548-e854cf761f57/console.log" append="off"/>
Aug 01 15:30:08 user nova-compute[72201]:     </serial>
Aug 01 15:30:08 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:30:08 user nova-compute[72201]:     <video>
Aug 01 15:30:08 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:30:08 user nova-compute[72201]:     </video>
Aug 01 15:30:08 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:30:08 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:30:08 user nova-compute[72201]:     </rng>
Aug 01 15:30:08 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:30:08 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:30:08 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:30:08 user nova-compute[72201]:     </memballoon>
Aug 01 15:30:08 user nova-compute[72201]:   </devices>
Aug 01 15:30:08 user nova-compute[72201]: </domain>
Aug 01 15:30:08 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T15:27:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1642919789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1833175817',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqQ3JyX5grzt34vgysHqxBFLfCGjR43NVcbWJ9AgvjUJAkeBHgFdLOk4UNppE+XbYa1pHxYkJwB0eE/x04yybsP4ZAiP/yhpagpnjq+IWr2x3Qlg+8KzJgt+RkxU443Og==',key_name='tempest-keypair-714015429',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:27:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0a434898181465ea2df89c7b1e42597',ramdisk_id='',reservation_id='r-0et8cou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1609612653',owner_user_name='tempest-ServerActionsV293TestJSON-1609612653-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:29:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32967fa82739495685f336d7ace68000',uuid=4d307a58-226b-40dd-a548-e854cf761f57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "address": "fa:16:3e:ad:58:90", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb5fe53-25", "ovs_interfaceid": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Converting VIF {"id": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "address": "fa:16:3e:ad:58:90", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb5fe53-25", "ovs_interfaceid": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:58:90,bridge_name='br-int',has_traffic_filtering=True,id=1eb5fe53-2534-45e8-a39b-1eebaa30159a,network=Network(968d4faa-613e-4954-86cc-3df6b86a2491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb5fe53-25') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG os_vif [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:58:90,bridge_name='br-int',has_traffic_filtering=True,id=1eb5fe53-2534-45e8-a39b-1eebaa30159a,network=Network(968d4faa-613e-4954-86cc-3df6b86a2491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb5fe53-25') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1eb5fe53-25, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1eb5fe53-25, col_values=(('external_ids', {'iface-id': '1eb5fe53-2534-45e8-a39b-1eebaa30159a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:58:90', 'vm-uuid': '4d307a58-226b-40dd-a548-e854cf761f57'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:08 user nova-compute[72201]: INFO os_vif [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:58:90,bridge_name='br-int',has_traffic_filtering=True,id=1eb5fe53-2534-45e8-a39b-1eebaa30159a,network=Network(968d4faa-613e-4954-86cc-3df6b86a2491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb5fe53-25')
Aug 01 15:30:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] No VIF found with MAC fa:16:3e:ad:58:90, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:30:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG nova.compute.manager [req-91a1b2ad-69ea-4d49-9a7f-1dced4bb4c60 req-bb0f4362-af25-4472-b189-641afd6d258f service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received event network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-91a1b2ad-69ea-4d49-9a7f-1dced4bb4c60 req-bb0f4362-af25-4472-b189-641afd6d258f service nova] Acquiring lock "4d307a58-226b-40dd-a548-e854cf761f57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-91a1b2ad-69ea-4d49-9a7f-1dced4bb4c60 req-bb0f4362-af25-4472-b189-641afd6d258f service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-91a1b2ad-69ea-4d49-9a7f-1dced4bb4c60 req-bb0f4362-af25-4472-b189-641afd6d258f service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG nova.compute.manager [req-91a1b2ad-69ea-4d49-9a7f-1dced4bb4c60 req-bb0f4362-af25-4472-b189-641afd6d258f service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] No waiting events found dispatching network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:30:10 user nova-compute[72201]: WARNING nova.compute.manager [req-91a1b2ad-69ea-4d49-9a7f-1dced4bb4c60 req-bb0f4362-af25-4472-b189-641afd6d258f service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received unexpected event network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a for instance with vm_state active and task_state rebuild_spawning.
Aug 01 15:30:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "a90b8dec-8529-4658-bf18-c5047c17c329" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "a90b8dec-8529-4658-bf18-c5047c17c329" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:30:10 user nova-compute[72201]: INFO nova.compute.claims [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Claim successful on node user
Aug 01 15:30:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.859s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:30:11 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:30:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG nova.policy [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fd505dbb02e4d3d8e8f97839b25ed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548641aee9954aa48c567e798b4be247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:30:11 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Creating image(s)
Aug 01 15:30:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "/opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "/opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "/opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903811.8712573, 4d307a58-226b-40dd-a548-e854cf761f57 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:30:11 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] VM Resumed (Lifecycle Event)
Aug 01 15:30:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:30:11 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Instance spawned successfully.
Aug 01 15:30:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.166s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:12 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 15:30:12 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903811.8731441, 4d307a58-226b-40dd-a548-e854cf761f57 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:30:12 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] VM Started (Lifecycle Event)
Aug 01 15:30:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.180s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:12 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG nova.objects.instance [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72201) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329/disk 1073741824" returned: 0 in 0.077s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-1773bddd-d260-4c2e-bd10-72a880e14935 req-bbc40773-00d1-4cf2-8331-3eb53dcac72f service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received event network-changed-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-1773bddd-d260-4c2e-bd10-72a880e14935 req-bbc40773-00d1-4cf2-8331-3eb53dcac72f service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Refreshing instance network info cache due to event network-changed-964ce05e-779d-4ccd-a19a-9c6832a9db28. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1773bddd-d260-4c2e-bd10-72a880e14935 req-bbc40773-00d1-4cf2-8331-3eb53dcac72f service nova] Acquiring lock "refresh_cache-ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1773bddd-d260-4c2e-bd10-72a880e14935 req-bbc40773-00d1-4cf2-8331-3eb53dcac72f service nova] Acquired lock "refresh_cache-ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG nova.network.neutron [req-1773bddd-d260-4c2e-bd10-72a880e14935 req-bbc40773-00d1-4cf2-8331-3eb53dcac72f service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Refreshing network info cache for port 964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-600fc06d-c128-405a-8096-d93009f0e73b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.170s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.173s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Cannot resize image /opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG nova.objects.instance [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lazy-loading 'migration_context' on Instance uuid a90b8dec-8529-4658-bf18-c5047c17c329 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Successfully created port: 14be95c0-4142-4241-89d8-2a084782c959 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Ensure instance console log exists: /opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:30:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG nova.compute.manager [req-29feb202-c747-49d7-8335-f335346f785d req-9f88594c-0058-4691-8ca4-12c99c7688d6 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received event network-changed-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG nova.compute.manager [req-29feb202-c747-49d7-8335-f335346f785d req-9f88594c-0058-4691-8ca4-12c99c7688d6 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Refreshing instance network info cache due to event network-changed-964ce05e-779d-4ccd-a19a-9c6832a9db28. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-29feb202-c747-49d7-8335-f335346f785d req-9f88594c-0058-4691-8ca4-12c99c7688d6 service nova] Acquiring lock "refresh_cache-ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG nova.network.neutron [req-1773bddd-d260-4c2e-bd10-72a880e14935 req-bbc40773-00d1-4cf2-8331-3eb53dcac72f service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Updated VIF entry in instance network info cache for port 964ce05e-779d-4ccd-a19a-9c6832a9db28. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG nova.network.neutron [req-1773bddd-d260-4c2e-bd10-72a880e14935 req-bbc40773-00d1-4cf2-8331-3eb53dcac72f service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Updating instance_info_cache with network_info: [{"id": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "address": "fa:16:3e:89:dd:94", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964ce05e-77", "ovs_interfaceid": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1773bddd-d260-4c2e-bd10-72a880e14935 req-bbc40773-00d1-4cf2-8331-3eb53dcac72f service nova] Releasing lock "refresh_cache-ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG nova.compute.manager [req-1773bddd-d260-4c2e-bd10-72a880e14935 req-bbc40773-00d1-4cf2-8331-3eb53dcac72f service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received event network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1773bddd-d260-4c2e-bd10-72a880e14935 req-bbc40773-00d1-4cf2-8331-3eb53dcac72f service nova] Acquiring lock "4d307a58-226b-40dd-a548-e854cf761f57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1773bddd-d260-4c2e-bd10-72a880e14935 req-bbc40773-00d1-4cf2-8331-3eb53dcac72f service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1773bddd-d260-4c2e-bd10-72a880e14935 req-bbc40773-00d1-4cf2-8331-3eb53dcac72f service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG nova.compute.manager [req-1773bddd-d260-4c2e-bd10-72a880e14935 req-bbc40773-00d1-4cf2-8331-3eb53dcac72f service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] No waiting events found dispatching network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:30:13 user nova-compute[72201]: WARNING nova.compute.manager [req-1773bddd-d260-4c2e-bd10-72a880e14935 req-bbc40773-00d1-4cf2-8331-3eb53dcac72f service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received unexpected event network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a for instance with vm_state active and task_state None.
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-29feb202-c747-49d7-8335-f335346f785d req-9f88594c-0058-4691-8ca4-12c99c7688d6 service nova] Acquired lock "refresh_cache-ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG nova.network.neutron [req-29feb202-c747-49d7-8335-f335346f785d req-9f88594c-0058-4691-8ca4-12c99c7688d6 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Refreshing network info cache for port 964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Successfully updated port: 14be95c0-4142-4241-89d8-2a084782c959 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "refresh_cache-a90b8dec-8529-4658-bf18-c5047c17c329" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquired lock "refresh_cache-a90b8dec-8529-4658-bf18-c5047c17c329" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a1e0df0-556e-40b4-8c13-cd097ac7ac8d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a1e0df0-556e-40b4-8c13-cd097ac7ac8d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.003s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:13 user nova-compute[72201]: INFO nova.compute.manager [None req-3a1e0df0-556e-40b4-8c13-cd097ac7ac8d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Rebooting instance
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a1e0df0-556e-40b4-8c13-cd097ac7ac8d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "refresh_cache-ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Updating instance_info_cache with network_info: [{"id": "14be95c0-4142-4241-89d8-2a084782c959", "address": "fa:16:3e:b5:d0:21", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14be95c0-41", "ovs_interfaceid": "14be95c0-4142-4241-89d8-2a084782c959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Releasing lock "refresh_cache-a90b8dec-8529-4658-bf18-c5047c17c329" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Instance network_info: |[{"id": "14be95c0-4142-4241-89d8-2a084782c959", "address": "fa:16:3e:b5:d0:21", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14be95c0-41", "ovs_interfaceid": "14be95c0-4142-4241-89d8-2a084782c959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Start _get_guest_xml network_info=[{"id": "14be95c0-4142-4241-89d8-2a084782c959", "address": "fa:16:3e:b5:d0:21", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14be95c0-41", "ovs_interfaceid": "14be95c0-4142-4241-89d8-2a084782c959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:14 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:30:14 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:30:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-509928076',display_name='tempest-AttachVolumeNegativeTest-server-509928076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-509928076',id=29,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeLxMiAHgYOHkydr1wZlfA2VWFtcWSO7Ia5NXoKQZgGVFqIbbrt6GyZW7GKvoTncZF05nwXtRUTNecvmf+eHCebn/MtWWmaWOSqwM87zUNmGLQLDLKQ8z/WTRPHlmRV9A==',key_name='tempest-keypair-2107548255',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548641aee9954aa48c567e798b4be247',ramdisk_id='',reservation_id='r-5gk9hj7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2028543234',owner_user_name='tempest-AttachVolumeNegativeTest-2028543234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd505dbb02e4d3d8e8f97839b25ed22',uuid=a90b8dec-8529-4658-bf18-c5047c17c329,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14be95c0-4142-4241-89d8-2a084782c959", "address": "fa:16:3e:b5:d0:21", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14be95c0-41", "ovs_interfaceid": "14be95c0-4142-4241-89d8-2a084782c959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converting VIF {"id": "14be95c0-4142-4241-89d8-2a084782c959", "address": "fa:16:3e:b5:d0:21", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14be95c0-41", "ovs_interfaceid": "14be95c0-4142-4241-89d8-2a084782c959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:d0:21,bridge_name='br-int',has_traffic_filtering=True,id=14be95c0-4142-4241-89d8-2a084782c959,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14be95c0-41') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.objects.instance [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lazy-loading 'pci_devices' on Instance uuid a90b8dec-8529-4658-bf18-c5047c17c329 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:30:14 user nova-compute[72201]:   <uuid>a90b8dec-8529-4658-bf18-c5047c17c329</uuid>
Aug 01 15:30:14 user nova-compute[72201]:   <name>instance-0000001d</name>
Aug 01 15:30:14 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:30:14 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:30:14 user nova-compute[72201]:   <metadata>
Aug 01 15:30:14 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:30:14 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:30:14 user nova-compute[72201]:       <nova:name>tempest-AttachVolumeNegativeTest-server-509928076</nova:name>
Aug 01 15:30:14 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:30:14</nova:creationTime>
Aug 01 15:30:14 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:30:14 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:30:14 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:30:14 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:30:14 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:30:14 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:30:14 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:30:14 user nova-compute[72201]:       <nova:owner>
Aug 01 15:30:14 user nova-compute[72201]:         <nova:user uuid="6fd505dbb02e4d3d8e8f97839b25ed22">tempest-AttachVolumeNegativeTest-2028543234-project-member</nova:user>
Aug 01 15:30:14 user nova-compute[72201]:         <nova:project uuid="548641aee9954aa48c567e798b4be247">tempest-AttachVolumeNegativeTest-2028543234</nova:project>
Aug 01 15:30:14 user nova-compute[72201]:       </nova:owner>
Aug 01 15:30:14 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:30:14 user nova-compute[72201]:       <nova:ports>
Aug 01 15:30:14 user nova-compute[72201]:         <nova:port uuid="14be95c0-4142-4241-89d8-2a084782c959">
Aug 01 15:30:14 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 15:30:14 user nova-compute[72201]:         </nova:port>
Aug 01 15:30:14 user nova-compute[72201]:       </nova:ports>
Aug 01 15:30:14 user nova-compute[72201]:     </nova:instance>
Aug 01 15:30:14 user nova-compute[72201]:   </metadata>
Aug 01 15:30:14 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:30:14 user nova-compute[72201]:     <system>
Aug 01 15:30:14 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:30:14 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:30:14 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:30:14 user nova-compute[72201]:       <entry name="serial">a90b8dec-8529-4658-bf18-c5047c17c329</entry>
Aug 01 15:30:14 user nova-compute[72201]:       <entry name="uuid">a90b8dec-8529-4658-bf18-c5047c17c329</entry>
Aug 01 15:30:14 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:30:14 user nova-compute[72201]:     </system>
Aug 01 15:30:14 user nova-compute[72201]:   </sysinfo>
Aug 01 15:30:14 user nova-compute[72201]:   <os>
Aug 01 15:30:14 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:30:14 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:30:14 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:30:14 user nova-compute[72201]:   </os>
Aug 01 15:30:14 user nova-compute[72201]:   <features>
Aug 01 15:30:14 user nova-compute[72201]:     <acpi/>
Aug 01 15:30:14 user nova-compute[72201]:     <apic/>
Aug 01 15:30:14 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:30:14 user nova-compute[72201]:   </features>
Aug 01 15:30:14 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:30:14 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:30:14 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:30:14 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:30:14 user nova-compute[72201]:   </clock>
Aug 01 15:30:14 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:30:14 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:30:14 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:30:14 user nova-compute[72201]:   </cpu>
Aug 01 15:30:14 user nova-compute[72201]:   <devices>
Aug 01 15:30:14 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:30:14 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:30:14 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329/disk"/>
Aug 01 15:30:14 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:30:14 user nova-compute[72201]:     </disk>
Aug 01 15:30:14 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:30:14 user nova-compute[72201]:       <mac address="fa:16:3e:b5:d0:21"/>
Aug 01 15:30:14 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:30:14 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:30:14 user nova-compute[72201]:       <target dev="tap14be95c0-41"/>
Aug 01 15:30:14 user nova-compute[72201]:     </interface>
Aug 01 15:30:14 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:30:14 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329/console.log" append="off"/>
Aug 01 15:30:14 user nova-compute[72201]:     </serial>
Aug 01 15:30:14 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:30:14 user nova-compute[72201]:     <video>
Aug 01 15:30:14 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:30:14 user nova-compute[72201]:     </video>
Aug 01 15:30:14 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:30:14 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:30:14 user nova-compute[72201]:     </rng>
Aug 01 15:30:14 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:30:14 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:30:14 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:30:14 user nova-compute[72201]:     </memballoon>
Aug 01 15:30:14 user nova-compute[72201]:   </devices>
Aug 01 15:30:14 user nova-compute[72201]: </domain>
Aug 01 15:30:14 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:30:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-509928076',display_name='tempest-AttachVolumeNegativeTest-server-509928076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-509928076',id=29,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeLxMiAHgYOHkydr1wZlfA2VWFtcWSO7Ia5NXoKQZgGVFqIbbrt6GyZW7GKvoTncZF05nwXtRUTNecvmf+eHCebn/MtWWmaWOSqwM87zUNmGLQLDLKQ8z/WTRPHlmRV9A==',key_name='tempest-keypair-2107548255',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548641aee9954aa48c567e798b4be247',ramdisk_id='',reservation_id='r-5gk9hj7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2028543234',owner_user_name='tempest-AttachVolumeNegativeTest-2028543234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd505dbb02e4d3d8e8f97839b25ed22',uuid=a90b8dec-8529-4658-bf18-c5047c17c329,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14be95c0-4142-4241-89d8-2a084782c959", "address": "fa:16:3e:b5:d0:21", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14be95c0-41", "ovs_interfaceid": "14be95c0-4142-4241-89d8-2a084782c959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converting VIF {"id": "14be95c0-4142-4241-89d8-2a084782c959", "address": "fa:16:3e:b5:d0:21", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14be95c0-41", "ovs_interfaceid": "14be95c0-4142-4241-89d8-2a084782c959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:d0:21,bridge_name='br-int',has_traffic_filtering=True,id=14be95c0-4142-4241-89d8-2a084782c959,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14be95c0-41') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG os_vif [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:d0:21,bridge_name='br-int',has_traffic_filtering=True,id=14be95c0-4142-4241-89d8-2a084782c959,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14be95c0-41') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14be95c0-41, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap14be95c0-41, col_values=(('external_ids', {'iface-id': '14be95c0-4142-4241-89d8-2a084782c959', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:d0:21', 'vm-uuid': 'a90b8dec-8529-4658-bf18-c5047c17c329'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:14 user nova-compute[72201]: INFO os_vif [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:d0:21,bridge_name='br-int',has_traffic_filtering=True,id=14be95c0-4142-4241-89d8-2a084782c959,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14be95c0-41')
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.network.neutron [req-29feb202-c747-49d7-8335-f335346f785d req-9f88594c-0058-4691-8ca4-12c99c7688d6 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Updated VIF entry in instance network info cache for port 964ce05e-779d-4ccd-a19a-9c6832a9db28. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.network.neutron [req-29feb202-c747-49d7-8335-f335346f785d req-9f88594c-0058-4691-8ca4-12c99c7688d6 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Updating instance_info_cache with network_info: [{"id": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "address": "fa:16:3e:89:dd:94", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964ce05e-77", "ovs_interfaceid": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-29feb202-c747-49d7-8335-f335346f785d req-9f88594c-0058-4691-8ca4-12c99c7688d6 service nova] Releasing lock "refresh_cache-ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a1e0df0-556e-40b4-8c13-cd097ac7ac8d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquired lock "refresh_cache-ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.network.neutron [None req-3a1e0df0-556e-40b4-8c13-cd097ac7ac8d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.compute.manager [req-155dd318-afbe-4c8e-9ea5-420f261f8d36 req-49057d00-b4a1-4192-8364-3418d3c31b7e service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Received event network-changed-14be95c0-4142-4241-89d8-2a084782c959 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.compute.manager [req-155dd318-afbe-4c8e-9ea5-420f261f8d36 req-49057d00-b4a1-4192-8364-3418d3c31b7e service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Refreshing instance network info cache due to event network-changed-14be95c0-4142-4241-89d8-2a084782c959. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-155dd318-afbe-4c8e-9ea5-420f261f8d36 req-49057d00-b4a1-4192-8364-3418d3c31b7e service nova] Acquiring lock "refresh_cache-a90b8dec-8529-4658-bf18-c5047c17c329" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-155dd318-afbe-4c8e-9ea5-420f261f8d36 req-49057d00-b4a1-4192-8364-3418d3c31b7e service nova] Acquired lock "refresh_cache-a90b8dec-8529-4658-bf18-c5047c17c329" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.network.neutron [req-155dd318-afbe-4c8e-9ea5-420f261f8d36 req-49057d00-b4a1-4192-8364-3418d3c31b7e service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Refreshing network info cache for port 14be95c0-4142-4241-89d8-2a084782c959 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] No VIF found with MAC fa:16:3e:b5:d0:21, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903818.0306814, a90b8dec-8529-4658-bf18-c5047c17c329 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:30:18 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] VM Resumed (Lifecycle Event)
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.network.neutron [req-155dd318-afbe-4c8e-9ea5-420f261f8d36 req-49057d00-b4a1-4192-8364-3418d3c31b7e service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Updated VIF entry in instance network info cache for port 14be95c0-4142-4241-89d8-2a084782c959. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.network.neutron [req-155dd318-afbe-4c8e-9ea5-420f261f8d36 req-49057d00-b4a1-4192-8364-3418d3c31b7e service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Updating instance_info_cache with network_info: [{"id": "14be95c0-4142-4241-89d8-2a084782c959", "address": "fa:16:3e:b5:d0:21", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14be95c0-41", "ovs_interfaceid": "14be95c0-4142-4241-89d8-2a084782c959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.network.neutron [None req-3a1e0df0-556e-40b4-8c13-cd097ac7ac8d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Updating instance_info_cache with network_info: [{"id": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "address": "fa:16:3e:89:dd:94", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964ce05e-77", "ovs_interfaceid": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.manager [req-289b3192-5b0b-4934-9be3-a9956671026d req-aa1663e0-f567-49ab-af42-81729355b023 service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Received event network-vif-plugged-14be95c0-4142-4241-89d8-2a084782c959 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-289b3192-5b0b-4934-9be3-a9956671026d req-aa1663e0-f567-49ab-af42-81729355b023 service nova] Acquiring lock "a90b8dec-8529-4658-bf18-c5047c17c329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-289b3192-5b0b-4934-9be3-a9956671026d req-aa1663e0-f567-49ab-af42-81729355b023 service nova] Lock "a90b8dec-8529-4658-bf18-c5047c17c329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-289b3192-5b0b-4934-9be3-a9956671026d req-aa1663e0-f567-49ab-af42-81729355b023 service nova] Lock "a90b8dec-8529-4658-bf18-c5047c17c329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.manager [req-289b3192-5b0b-4934-9be3-a9956671026d req-aa1663e0-f567-49ab-af42-81729355b023 service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] No waiting events found dispatching network-vif-plugged-14be95c0-4142-4241-89d8-2a084782c959 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:30:18 user nova-compute[72201]: WARNING nova.compute.manager [req-289b3192-5b0b-4934-9be3-a9956671026d req-aa1663e0-f567-49ab-af42-81729355b023 service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Received unexpected event network-vif-plugged-14be95c0-4142-4241-89d8-2a084782c959 for instance with vm_state building and task_state spawning.
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a1e0df0-556e-40b4-8c13-cd097ac7ac8d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Releasing lock "refresh_cache-ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-155dd318-afbe-4c8e-9ea5-420f261f8d36 req-49057d00-b4a1-4192-8364-3418d3c31b7e service nova] Releasing lock "refresh_cache-a90b8dec-8529-4658-bf18-c5047c17c329" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3a1e0df0-556e-40b4-8c13-cd097ac7ac8d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.manager [req-cbb55524-637e-4acf-9eb7-ae2c6b99bbfc req-094b76d8-f048-4a48-bdd7-7b3ffc6aff10 service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Received event network-vif-plugged-14be95c0-4142-4241-89d8-2a084782c959 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cbb55524-637e-4acf-9eb7-ae2c6b99bbfc req-094b76d8-f048-4a48-bdd7-7b3ffc6aff10 service nova] Acquiring lock "a90b8dec-8529-4658-bf18-c5047c17c329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cbb55524-637e-4acf-9eb7-ae2c6b99bbfc req-094b76d8-f048-4a48-bdd7-7b3ffc6aff10 service nova] Lock "a90b8dec-8529-4658-bf18-c5047c17c329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cbb55524-637e-4acf-9eb7-ae2c6b99bbfc req-094b76d8-f048-4a48-bdd7-7b3ffc6aff10 service nova] Lock "a90b8dec-8529-4658-bf18-c5047c17c329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.manager [req-cbb55524-637e-4acf-9eb7-ae2c6b99bbfc req-094b76d8-f048-4a48-bdd7-7b3ffc6aff10 service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] No waiting events found dispatching network-vif-plugged-14be95c0-4142-4241-89d8-2a084782c959 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:30:18 user nova-compute[72201]: WARNING nova.compute.manager [req-cbb55524-637e-4acf-9eb7-ae2c6b99bbfc req-094b76d8-f048-4a48-bdd7-7b3ffc6aff10 service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Received unexpected event network-vif-plugged-14be95c0-4142-4241-89d8-2a084782c959 for instance with vm_state building and task_state spawning.
Aug 01 15:30:18 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:30:18 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=7000MB free_disk=25.138427734375GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:18 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Instance spawned successfully.
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:30:18 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903818.0322897, a90b8dec-8529-4658-bf18-c5047c17c329 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:30:18 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] VM Started (Lifecycle Event)
Aug 01 15:30:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:30:18 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:30:18 user nova-compute[72201]: INFO nova.compute.manager [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Took 6.96 seconds to spawn the instance on the hypervisor.
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance b64f1cfb-64f2-4493-8721-fc63fcd93bb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e2ca19ea-868c-40ad-a453-f6e348cfac15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 0f059ccc-f609-4cf3-a644-c3d1305ae26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 865b371c-59c5-4004-8469-cdc1e9327ecb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 14e890ca-dc2a-4d89-a497-d55805d0c42e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 4d307a58-226b-40dd-a548-e854cf761f57 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 9530577b-69a6-45bc-a33b-1dc60d69a16f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance ed5f91f1-b3fd-4737-8ed6-fca13617bd6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 9e946b4a-9b93-459f-8e5e-d88612c4ec34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance bd70360d-30b8-47d5-b35e-adf0d28482dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance a90b8dec-8529-4658-bf18-c5047c17c329 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:30:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:30:18 user nova-compute[72201]: INFO nova.compute.manager [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Took 8.27 seconds to build instance.
Aug 01 15:30:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e7f8fbd-c033-4034-8490-eb9ea77ce104 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "a90b8dec-8529-4658-bf18-c5047c17c329" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.427s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:19 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:30:19 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:30:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:30:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.819s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-44807d9e-e3c6-4107-8c9a-8ac83cfadb7f req-a37367f3-1f57-4743-a421-821f09f23fd6 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received event network-vif-unplugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-44807d9e-e3c6-4107-8c9a-8ac83cfadb7f req-a37367f3-1f57-4743-a421-821f09f23fd6 service nova] Acquiring lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-44807d9e-e3c6-4107-8c9a-8ac83cfadb7f req-a37367f3-1f57-4743-a421-821f09f23fd6 service nova] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-44807d9e-e3c6-4107-8c9a-8ac83cfadb7f req-a37367f3-1f57-4743-a421-821f09f23fd6 service nova] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-44807d9e-e3c6-4107-8c9a-8ac83cfadb7f req-a37367f3-1f57-4743-a421-821f09f23fd6 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] No waiting events found dispatching network-vif-unplugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:30:21 user nova-compute[72201]: WARNING nova.compute.manager [req-44807d9e-e3c6-4107-8c9a-8ac83cfadb7f req-a37367f3-1f57-4743-a421-821f09f23fd6 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received unexpected event network-vif-unplugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 for instance with vm_state active and task_state reboot_started.
Aug 01 15:30:21 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-3a1e0df0-556e-40b4-8c13-cd097ac7ac8d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Instance shutdown successfully.
Aug 01 15:30:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-88dc0785-da9e-4e10-ac81-4a469c587b56 req-027f037b-3505-4de6-a805-d94920309208 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received event network-vif-plugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-88dc0785-da9e-4e10-ac81-4a469c587b56 req-027f037b-3505-4de6-a805-d94920309208 service nova] Acquiring lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-88dc0785-da9e-4e10-ac81-4a469c587b56 req-027f037b-3505-4de6-a805-d94920309208 service nova] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-88dc0785-da9e-4e10-ac81-4a469c587b56 req-027f037b-3505-4de6-a805-d94920309208 service nova] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-88dc0785-da9e-4e10-ac81-4a469c587b56 req-027f037b-3505-4de6-a805-d94920309208 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] No waiting events found dispatching network-vif-plugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:30:23 user nova-compute[72201]: WARNING nova.compute.manager [req-88dc0785-da9e-4e10-ac81-4a469c587b56 req-027f037b-3505-4de6-a805-d94920309208 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received unexpected event network-vif-plugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 for instance with vm_state active and task_state reboot_started.
Aug 01 15:30:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-d1dcd1bc-cb40-4389-b0b9-8722308a80e0 req-2d667702-d833-44c0-928f-fa0e4f0e1eb6 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received event network-vif-plugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d1dcd1bc-cb40-4389-b0b9-8722308a80e0 req-2d667702-d833-44c0-928f-fa0e4f0e1eb6 service nova] Acquiring lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d1dcd1bc-cb40-4389-b0b9-8722308a80e0 req-2d667702-d833-44c0-928f-fa0e4f0e1eb6 service nova] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d1dcd1bc-cb40-4389-b0b9-8722308a80e0 req-2d667702-d833-44c0-928f-fa0e4f0e1eb6 service nova] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-d1dcd1bc-cb40-4389-b0b9-8722308a80e0 req-2d667702-d833-44c0-928f-fa0e4f0e1eb6 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] No waiting events found dispatching network-vif-plugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:30:25 user nova-compute[72201]: WARNING nova.compute.manager [req-d1dcd1bc-cb40-4389-b0b9-8722308a80e0 req-2d667702-d833-44c0-928f-fa0e4f0e1eb6 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received unexpected event network-vif-plugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 for instance with vm_state active and task_state reboot_started.
Aug 01 15:30:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-d1dcd1bc-cb40-4389-b0b9-8722308a80e0 req-2d667702-d833-44c0-928f-fa0e4f0e1eb6 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received event network-vif-plugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d1dcd1bc-cb40-4389-b0b9-8722308a80e0 req-2d667702-d833-44c0-928f-fa0e4f0e1eb6 service nova] Acquiring lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d1dcd1bc-cb40-4389-b0b9-8722308a80e0 req-2d667702-d833-44c0-928f-fa0e4f0e1eb6 service nova] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d1dcd1bc-cb40-4389-b0b9-8722308a80e0 req-2d667702-d833-44c0-928f-fa0e4f0e1eb6 service nova] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-d1dcd1bc-cb40-4389-b0b9-8722308a80e0 req-2d667702-d833-44c0-928f-fa0e4f0e1eb6 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] No waiting events found dispatching network-vif-plugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:30:25 user nova-compute[72201]: WARNING nova.compute.manager [req-d1dcd1bc-cb40-4389-b0b9-8722308a80e0 req-2d667702-d833-44c0-928f-fa0e4f0e1eb6 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received unexpected event network-vif-plugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 for instance with vm_state active and task_state reboot_started.
Aug 01 15:30:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Removed pending event for ed5f91f1-b3fd-4737-8ed6-fca13617bd6e due to event {{(pid=72201) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 15:30:25 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903825.7898827, ed5f91f1-b3fd-4737-8ed6-fca13617bd6e => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:30:25 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] VM Resumed (Lifecycle Event)
Aug 01 15:30:25 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Instance running successfully.
Aug 01 15:30:25 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-3a1e0df0-556e-40b4-8c13-cd097ac7ac8d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Instance soft rebooted successfully.
Aug 01 15:30:25 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3a1e0df0-556e-40b4-8c13-cd097ac7ac8d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:30:25 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:30:25 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:30:25 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 01 15:30:25 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903825.798179, ed5f91f1-b3fd-4737-8ed6-fca13617bd6e => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:30:25 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] VM Started (Lifecycle Event)
Aug 01 15:30:25 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:30:25 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:30:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a1e0df0-556e-40b4-8c13-cd097ac7ac8d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 12.058s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-0c75ce9c-100b-4061-b007-162eda78b0de req-2741af10-3530-4e17-86b3-dfefa3267d32 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received event network-changed-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-0c75ce9c-100b-4061-b007-162eda78b0de req-2741af10-3530-4e17-86b3-dfefa3267d32 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Refreshing instance network info cache due to event network-changed-983acc56-f35e-463b-9792-e837ce96710d. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:30:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0c75ce9c-100b-4061-b007-162eda78b0de req-2741af10-3530-4e17-86b3-dfefa3267d32 service nova] Acquiring lock "refresh_cache-9e946b4a-9b93-459f-8e5e-d88612c4ec34" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:30:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0c75ce9c-100b-4061-b007-162eda78b0de req-2741af10-3530-4e17-86b3-dfefa3267d32 service nova] Acquired lock "refresh_cache-9e946b4a-9b93-459f-8e5e-d88612c4ec34" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:30:39 user nova-compute[72201]: DEBUG nova.network.neutron [req-0c75ce9c-100b-4061-b007-162eda78b0de req-2741af10-3530-4e17-86b3-dfefa3267d32 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Refreshing network info cache for port 983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:30:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:39 user nova-compute[72201]: DEBUG nova.objects.instance [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'flavor' on Instance uuid 9e946b4a-9b93-459f-8e5e-d88612c4ec34 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:30:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:39 user nova-compute[72201]: INFO nova.compute.manager [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Attaching volume f63575ac-6e2e-46b6-99c6-bfc53742fe57 to /dev/vdb
Aug 01 15:30:40 user nova-compute[72201]: DEBUG os_brick.utils [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3aa45a6-2d19-43d4-a82c-5f795142e297]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea81200d-973c-4856-94c4-da3b85df3c96]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG nova.network.neutron [req-0c75ce9c-100b-4061-b007-162eda78b0de req-2741af10-3530-4e17-86b3-dfefa3267d32 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Updated VIF entry in instance network info cache for port 983acc56-f35e-463b-9792-e837ce96710d. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG nova.network.neutron [req-0c75ce9c-100b-4061-b007-162eda78b0de req-2741af10-3530-4e17-86b3-dfefa3267d32 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Updating instance_info_cache with network_info: [{"id": "983acc56-f35e-463b-9792-e837ce96710d", "address": "fa:16:3e:28:f5:cf", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983acc56-f3", "ovs_interfaceid": "983acc56-f35e-463b-9792-e837ce96710d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[00801be6-0d43-49e6-95d2-3a3bf45d01e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d0b940-70d0-4273-9663-e369553c9108]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0c75ce9c-100b-4061-b007-162eda78b0de req-2741af10-3530-4e17-86b3-dfefa3267d32 service nova] Releasing lock "refresh_cache-9e946b4a-9b93-459f-8e5e-d88612c4ec34" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:30:40 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:30:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebd7eb4-a079-45c3-ba57-165781a4894d]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG os_brick.utils [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:30:40 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Updating existing volume attachment record: a3e78991-f114-49f7-beb0-b30733ff510c {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:30:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "79c02f2d-a143-4522-9054-369da11b54ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "79c02f2d-a143-4522-9054-369da11b54ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:43 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:30:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:44 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:30:44 user nova-compute[72201]: INFO nova.compute.claims [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Claim successful on node user
Aug 01 15:30:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:44 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:30:44 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:30:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:44 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:30:44 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:30:44 user nova-compute[72201]: DEBUG nova.network.neutron [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:30:44 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:30:44 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:30:44 user nova-compute[72201]: DEBUG nova.policy [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '488991a215a64482a71cb25f3ecd9f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85969cbfd374ba484cccd0f89fcf3be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:30:44 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:30:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:30:44 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Creating image(s)
Aug 01 15:30:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "/opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "/opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "/opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.187s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba/disk 1073741824" returned: 0 in 0.050s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.167s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:45 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:30:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:45 user nova-compute[72201]: DEBUG nova.network.neutron [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Successfully created port: a37cefd8-89f1-40f6-b0ed-68d450cbfbab {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:30:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:45 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Cannot resize image /opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:30:45 user nova-compute[72201]: DEBUG nova.objects.instance [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lazy-loading 'migration_context' on Instance uuid 79c02f2d-a143-4522-9054-369da11b54ba {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:30:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:30:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Ensure instance console log exists: /opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:30:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.network.neutron [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Successfully updated port: a37cefd8-89f1-40f6-b0ed-68d450cbfbab {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "refresh_cache-79c02f2d-a143-4522-9054-369da11b54ba" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquired lock "refresh_cache-79c02f2d-a143-4522-9054-369da11b54ba" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.network.neutron [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.network.neutron [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.compute.manager [req-7f6e8fe2-5c82-4a3b-80da-c5dc171e6d3b req-9c550b49-a67a-4174-90d1-8c4d953761e3 service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Received event network-changed-a37cefd8-89f1-40f6-b0ed-68d450cbfbab {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.compute.manager [req-7f6e8fe2-5c82-4a3b-80da-c5dc171e6d3b req-9c550b49-a67a-4174-90d1-8c4d953761e3 service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Refreshing instance network info cache due to event network-changed-a37cefd8-89f1-40f6-b0ed-68d450cbfbab. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7f6e8fe2-5c82-4a3b-80da-c5dc171e6d3b req-9c550b49-a67a-4174-90d1-8c4d953761e3 service nova] Acquiring lock "refresh_cache-79c02f2d-a143-4522-9054-369da11b54ba" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.network.neutron [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Updating instance_info_cache with network_info: [{"id": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "address": "fa:16:3e:2e:3a:2f", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37cefd8-89", "ovs_interfaceid": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Releasing lock "refresh_cache-79c02f2d-a143-4522-9054-369da11b54ba" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Instance network_info: |[{"id": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "address": "fa:16:3e:2e:3a:2f", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37cefd8-89", "ovs_interfaceid": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7f6e8fe2-5c82-4a3b-80da-c5dc171e6d3b req-9c550b49-a67a-4174-90d1-8c4d953761e3 service nova] Acquired lock "refresh_cache-79c02f2d-a143-4522-9054-369da11b54ba" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.network.neutron [req-7f6e8fe2-5c82-4a3b-80da-c5dc171e6d3b req-9c550b49-a67a-4174-90d1-8c4d953761e3 service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Refreshing network info cache for port a37cefd8-89f1-40f6-b0ed-68d450cbfbab {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Start _get_guest_xml network_info=[{"id": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "address": "fa:16:3e:2e:3a:2f", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37cefd8-89", "ovs_interfaceid": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:30:46 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:30:46 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:30:46 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1571001394',display_name='tempest-VolumesSnapshotTestJSON-instance-1571001394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1571001394',id=30,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDm8Bc5YsS3vm7aQlzAJa8MjUuHiiEnTag9i8ctsR644Y0O/g3V45e7cX217PMUm7oc7UheCit1YbaZqZ8jNRDwXLI1RagQ7xKpeT1lVGgXY/inHK8JU7f9SAXFI7t+lFQ==',key_name='tempest-keypair-1008891001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c85969cbfd374ba484cccd0f89fcf3be',ramdisk_id='',reservation_id='r-h0rb6c4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-840662389',owner_user_name='tempest-VolumesSnapshotTestJSON-840662389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:30:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='488991a215a64482a71cb25f3ecd9f0f',uuid=79c02f2d-a143-4522-9054-369da11b54ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "address": "fa:16:3e:2e:3a:2f", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37cefd8-89", "ovs_interfaceid": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Converting VIF {"id": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "address": "fa:16:3e:2e:3a:2f", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37cefd8-89", "ovs_interfaceid": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:3a:2f,bridge_name='br-int',has_traffic_filtering=True,id=a37cefd8-89f1-40f6-b0ed-68d450cbfbab,network=Network(5b881fdd-ff08-42a6-aa9c-3ec904123af2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37cefd8-89') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG nova.objects.instance [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lazy-loading 'pci_devices' on Instance uuid 79c02f2d-a143-4522-9054-369da11b54ba {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:30:47 user nova-compute[72201]:   <uuid>79c02f2d-a143-4522-9054-369da11b54ba</uuid>
Aug 01 15:30:47 user nova-compute[72201]:   <name>instance-0000001e</name>
Aug 01 15:30:47 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:30:47 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:30:47 user nova-compute[72201]:   <metadata>
Aug 01 15:30:47 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:30:47 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:30:47 user nova-compute[72201]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1571001394</nova:name>
Aug 01 15:30:47 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:30:46</nova:creationTime>
Aug 01 15:30:47 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:30:47 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:30:47 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:30:47 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:30:47 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:30:47 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:30:47 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:30:47 user nova-compute[72201]:       <nova:owner>
Aug 01 15:30:47 user nova-compute[72201]:         <nova:user uuid="488991a215a64482a71cb25f3ecd9f0f">tempest-VolumesSnapshotTestJSON-840662389-project-member</nova:user>
Aug 01 15:30:47 user nova-compute[72201]:         <nova:project uuid="c85969cbfd374ba484cccd0f89fcf3be">tempest-VolumesSnapshotTestJSON-840662389</nova:project>
Aug 01 15:30:47 user nova-compute[72201]:       </nova:owner>
Aug 01 15:30:47 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:30:47 user nova-compute[72201]:       <nova:ports>
Aug 01 15:30:47 user nova-compute[72201]:         <nova:port uuid="a37cefd8-89f1-40f6-b0ed-68d450cbfbab">
Aug 01 15:30:47 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 15:30:47 user nova-compute[72201]:         </nova:port>
Aug 01 15:30:47 user nova-compute[72201]:       </nova:ports>
Aug 01 15:30:47 user nova-compute[72201]:     </nova:instance>
Aug 01 15:30:47 user nova-compute[72201]:   </metadata>
Aug 01 15:30:47 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:30:47 user nova-compute[72201]:     <system>
Aug 01 15:30:47 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:30:47 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:30:47 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:30:47 user nova-compute[72201]:       <entry name="serial">79c02f2d-a143-4522-9054-369da11b54ba</entry>
Aug 01 15:30:47 user nova-compute[72201]:       <entry name="uuid">79c02f2d-a143-4522-9054-369da11b54ba</entry>
Aug 01 15:30:47 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:30:47 user nova-compute[72201]:     </system>
Aug 01 15:30:47 user nova-compute[72201]:   </sysinfo>
Aug 01 15:30:47 user nova-compute[72201]:   <os>
Aug 01 15:30:47 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:30:47 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:30:47 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:30:47 user nova-compute[72201]:   </os>
Aug 01 15:30:47 user nova-compute[72201]:   <features>
Aug 01 15:30:47 user nova-compute[72201]:     <acpi/>
Aug 01 15:30:47 user nova-compute[72201]:     <apic/>
Aug 01 15:30:47 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:30:47 user nova-compute[72201]:   </features>
Aug 01 15:30:47 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:30:47 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:30:47 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:30:47 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:30:47 user nova-compute[72201]:   </clock>
Aug 01 15:30:47 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:30:47 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:30:47 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:30:47 user nova-compute[72201]:   </cpu>
Aug 01 15:30:47 user nova-compute[72201]:   <devices>
Aug 01 15:30:47 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:30:47 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:30:47 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba/disk"/>
Aug 01 15:30:47 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:30:47 user nova-compute[72201]:     </disk>
Aug 01 15:30:47 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:30:47 user nova-compute[72201]:       <mac address="fa:16:3e:2e:3a:2f"/>
Aug 01 15:30:47 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:30:47 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:30:47 user nova-compute[72201]:       <target dev="tapa37cefd8-89"/>
Aug 01 15:30:47 user nova-compute[72201]:     </interface>
Aug 01 15:30:47 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:30:47 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba/console.log" append="off"/>
Aug 01 15:30:47 user nova-compute[72201]:     </serial>
Aug 01 15:30:47 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:30:47 user nova-compute[72201]:     <video>
Aug 01 15:30:47 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:30:47 user nova-compute[72201]:     </video>
Aug 01 15:30:47 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:30:47 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:30:47 user nova-compute[72201]:     </rng>
Aug 01 15:30:47 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:30:47 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:30:47 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:30:47 user nova-compute[72201]:     </memballoon>
Aug 01 15:30:47 user nova-compute[72201]:   </devices>
Aug 01 15:30:47 user nova-compute[72201]: </domain>
Aug 01 15:30:47 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1571001394',display_name='tempest-VolumesSnapshotTestJSON-instance-1571001394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1571001394',id=30,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDm8Bc5YsS3vm7aQlzAJa8MjUuHiiEnTag9i8ctsR644Y0O/g3V45e7cX217PMUm7oc7UheCit1YbaZqZ8jNRDwXLI1RagQ7xKpeT1lVGgXY/inHK8JU7f9SAXFI7t+lFQ==',key_name='tempest-keypair-1008891001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c85969cbfd374ba484cccd0f89fcf3be',ramdisk_id='',reservation_id='r-h0rb6c4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-840662389',owner_user_name='tempest-VolumesSnapshotTestJSON-840662389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:30:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='488991a215a64482a71cb25f3ecd9f0f',uuid=79c02f2d-a143-4522-9054-369da11b54ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "address": "fa:16:3e:2e:3a:2f", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37cefd8-89", "ovs_interfaceid": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Converting VIF {"id": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "address": "fa:16:3e:2e:3a:2f", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37cefd8-89", "ovs_interfaceid": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:3a:2f,bridge_name='br-int',has_traffic_filtering=True,id=a37cefd8-89f1-40f6-b0ed-68d450cbfbab,network=Network(5b881fdd-ff08-42a6-aa9c-3ec904123af2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37cefd8-89') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG os_vif [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:3a:2f,bridge_name='br-int',has_traffic_filtering=True,id=a37cefd8-89f1-40f6-b0ed-68d450cbfbab,network=Network(5b881fdd-ff08-42a6-aa9c-3ec904123af2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37cefd8-89') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa37cefd8-89, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa37cefd8-89, col_values=(('external_ids', {'iface-id': 'a37cefd8-89f1-40f6-b0ed-68d450cbfbab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:3a:2f', 'vm-uuid': '79c02f2d-a143-4522-9054-369da11b54ba'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:47 user nova-compute[72201]: INFO os_vif [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:3a:2f,bridge_name='br-int',has_traffic_filtering=True,id=a37cefd8-89f1-40f6-b0ed-68d450cbfbab,network=Network(5b881fdd-ff08-42a6-aa9c-3ec904123af2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37cefd8-89')
Aug 01 15:30:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] No VIF found with MAC fa:16:3e:2e:3a:2f, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG nova.network.neutron [req-7f6e8fe2-5c82-4a3b-80da-c5dc171e6d3b req-9c550b49-a67a-4174-90d1-8c4d953761e3 service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Updated VIF entry in instance network info cache for port a37cefd8-89f1-40f6-b0ed-68d450cbfbab. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG nova.network.neutron [req-7f6e8fe2-5c82-4a3b-80da-c5dc171e6d3b req-9c550b49-a67a-4174-90d1-8c4d953761e3 service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Updating instance_info_cache with network_info: [{"id": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "address": "fa:16:3e:2e:3a:2f", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37cefd8-89", "ovs_interfaceid": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:30:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7f6e8fe2-5c82-4a3b-80da-c5dc171e6d3b req-9c550b49-a67a-4174-90d1-8c4d953761e3 service nova] Releasing lock "refresh_cache-79c02f2d-a143-4522-9054-369da11b54ba" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVhbXNxO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:30:48 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:30:48 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:30:48 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13c0837-c256-491e-aa7d-c82cff54fae6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:30:48 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e965dc42-5b2d-4a2c-b6b0-2d1acd5ba560]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57] added
Aug 01 15:30:48 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ccc637-2fdd-478e-93eb-e9226ef49487]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[431419fc-d558-4a17-97cb-4c2a68eba89b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eVhbXNxO {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eVhbXNxO" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c1b4c8-cdd6-4997-90bc-b3d3cd2969b1]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eVhbXNxO'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de4b8c8-5ad7-4544-a06d-2bae8a2f6258]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[58690a67-3d11-42a9-8a89-2d4a75a042ff]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:30:48 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:30:48 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:30:48 user nova-compute[72201]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:30:48 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:30:48 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:30:48 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:30:48 user nova-compute[72201]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:30:48 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f4cd42-8fd3-483a-9996-eb9ba2ebe4f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57, portal: 172.16.0.220,3260]
Aug 01 15:30:48 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57, portal: 172.16.0.220,3260] successful.
Aug 01 15:30:48 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.059s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[60426c57-7e39-4d52-8e39-adf2d6ddcb0e]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7b1acb-292c-4140-ac36-f351d8900f38]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:30:48 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:30:48 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:30:48 user nova-compute[72201]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:30:48 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:30:48 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:30:48 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:30:48 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:30:48 user nova-compute[72201]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:30:48 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:30:48 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.037s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[852438ec-9973-41a0-827d-e3a4c0c8bf3e]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVhbXNxO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG nova.compute.manager [req-c9a61271-8954-43a2-b25b-ba1cc94d7797 req-37d7fb8c-7445-4122-ab22-8438afeb6a4c service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Received event network-vif-plugged-a37cefd8-89f1-40f6-b0ed-68d450cbfbab {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c9a61271-8954-43a2-b25b-ba1cc94d7797 req-37d7fb8c-7445-4122-ab22-8438afeb6a4c service nova] Acquiring lock "79c02f2d-a143-4522-9054-369da11b54ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c9a61271-8954-43a2-b25b-ba1cc94d7797 req-37d7fb8c-7445-4122-ab22-8438afeb6a4c service nova] Lock "79c02f2d-a143-4522-9054-369da11b54ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c9a61271-8954-43a2-b25b-ba1cc94d7797 req-37d7fb8c-7445-4122-ab22-8438afeb6a4c service nova] Lock "79c02f2d-a143-4522-9054-369da11b54ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:48 user nova-compute[72201]: DEBUG nova.compute.manager [req-c9a61271-8954-43a2-b25b-ba1cc94d7797 req-37d7fb8c-7445-4122-ab22-8438afeb6a4c service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] No waiting events found dispatching network-vif-plugged-a37cefd8-89f1-40f6-b0ed-68d450cbfbab {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:30:48 user nova-compute[72201]: WARNING nova.compute.manager [req-c9a61271-8954-43a2-b25b-ba1cc94d7797 req-37d7fb8c-7445-4122-ab22-8438afeb6a4c service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Received unexpected event network-vif-plugged-a37cefd8-89f1-40f6-b0ed-68d450cbfbab for instance with vm_state building and task_state spawning.
Aug 01 15:30:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:30:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23439626332653934', 'path': '/dev/sdf'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:30:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439626332653934', 'path': '/dev/sdf'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:30:49 user nova-compute[72201]: DEBUG nova.objects.instance [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'flavor' on Instance uuid 9e946b4a-9b93-459f-8e5e-d88612c4ec34 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:30:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:30:49 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:30:49 user nova-compute[72201]:   <source dev="/dev/sdf"/>
Aug 01 15:30:49 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:30:49 user nova-compute[72201]:   <serial>f63575ac-6e2e-46b6-99c6-bfc53742fe57</serial>
Aug 01 15:30:49 user nova-compute[72201]: </disk>
Aug 01 15:30:49 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:30:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:30:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:30:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] No VIF found with MAC fa:16:3e:28:f5:cf, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:30:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-34d77c86-0893-4ce8-873f-b3cd4de81ded tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.116s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:50 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903850.773083, 79c02f2d-a143-4522-9054-369da11b54ba => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:30:50 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] VM Resumed (Lifecycle Event)
Aug 01 15:30:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:30:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:30:50 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Instance spawned successfully.
Aug 01 15:30:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:30:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:30:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:30:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:30:50 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:30:50 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903850.7766795, 79c02f2d-a143-4522-9054-369da11b54ba => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:30:50 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] VM Started (Lifecycle Event)
Aug 01 15:30:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:30:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-6689f05d-0dc4-4fcb-9cf2-df390d2d8a63 req-9f0232d4-f1a3-4779-980f-2da88e2ff159 service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Received event network-vif-plugged-a37cefd8-89f1-40f6-b0ed-68d450cbfbab {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6689f05d-0dc4-4fcb-9cf2-df390d2d8a63 req-9f0232d4-f1a3-4779-980f-2da88e2ff159 service nova] Acquiring lock "79c02f2d-a143-4522-9054-369da11b54ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6689f05d-0dc4-4fcb-9cf2-df390d2d8a63 req-9f0232d4-f1a3-4779-980f-2da88e2ff159 service nova] Lock "79c02f2d-a143-4522-9054-369da11b54ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6689f05d-0dc4-4fcb-9cf2-df390d2d8a63 req-9f0232d4-f1a3-4779-980f-2da88e2ff159 service nova] Lock "79c02f2d-a143-4522-9054-369da11b54ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-6689f05d-0dc4-4fcb-9cf2-df390d2d8a63 req-9f0232d4-f1a3-4779-980f-2da88e2ff159 service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] No waiting events found dispatching network-vif-plugged-a37cefd8-89f1-40f6-b0ed-68d450cbfbab {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:30:50 user nova-compute[72201]: WARNING nova.compute.manager [req-6689f05d-0dc4-4fcb-9cf2-df390d2d8a63 req-9f0232d4-f1a3-4779-980f-2da88e2ff159 service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Received unexpected event network-vif-plugged-a37cefd8-89f1-40f6-b0ed-68d450cbfbab for instance with vm_state building and task_state spawning.
Aug 01 15:30:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:30:50 user nova-compute[72201]: INFO nova.compute.manager [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Took 6.04 seconds to spawn the instance on the hypervisor.
Aug 01 15:30:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:30:50 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:30:50 user nova-compute[72201]: INFO nova.compute.manager [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Took 6.91 seconds to build instance.
Aug 01 15:30:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d2363570-fe61-47bd-ba29-02c0f004761e tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "79c02f2d-a143-4522-9054-369da11b54ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.003s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:51 user nova-compute[72201]: INFO nova.compute.manager [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Rescuing
Aug 01 15:30:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "refresh_cache-9e946b4a-9b93-459f-8e5e-d88612c4ec34" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:30:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquired lock "refresh_cache-9e946b4a-9b93-459f-8e5e-d88612c4ec34" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:30:51 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:30:51 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Updating instance_info_cache with network_info: [{"id": "983acc56-f35e-463b-9792-e837ce96710d", "address": "fa:16:3e:28:f5:cf", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983acc56-f3", "ovs_interfaceid": "983acc56-f35e-463b-9792-e837ce96710d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:30:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Releasing lock "refresh_cache-9e946b4a-9b93-459f-8e5e-d88612c4ec34" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:30:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:51 user nova-compute[72201]: DEBUG nova.compute.manager [req-224df34a-f6a3-45e1-bb78-60764e3e784d req-601d0318-bcf5-40cd-8454-63af75252654 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received event network-vif-unplugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-224df34a-f6a3-45e1-bb78-60764e3e784d req-601d0318-bcf5-40cd-8454-63af75252654 service nova] Acquiring lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-224df34a-f6a3-45e1-bb78-60764e3e784d req-601d0318-bcf5-40cd-8454-63af75252654 service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-224df34a-f6a3-45e1-bb78-60764e3e784d req-601d0318-bcf5-40cd-8454-63af75252654 service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:51 user nova-compute[72201]: DEBUG nova.compute.manager [req-224df34a-f6a3-45e1-bb78-60764e3e784d req-601d0318-bcf5-40cd-8454-63af75252654 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] No waiting events found dispatching network-vif-unplugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:30:51 user nova-compute[72201]: WARNING nova.compute.manager [req-224df34a-f6a3-45e1-bb78-60764e3e784d req-601d0318-bcf5-40cd-8454-63af75252654 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received unexpected event network-vif-unplugged-983acc56-f35e-463b-9792-e837ce96710d for instance with vm_state active and task_state rescuing.
Aug 01 15:30:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:52 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Instance destroyed successfully.
Aug 01 15:30:52 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Attempting rescue
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72201) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Instance directory exists: not creating {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 15:30:52 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Creating image(s)
Aug 01 15:30:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "/opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "/opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9e946b4a-9b93-459f-8e5e-d88612c4ec34 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk.rescue {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk.rescue" returned: 0 in 0.047s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'migration_context' on Instance uuid 9e946b4a-9b93-459f-8e5e-d88612c4ec34 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Start _get_guest_xml network_info=[{"id": "983acc56-f35e-463b-9792-e837ce96710d", "address": "fa:16:3e:28:f5:cf", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "vif_mac": "fa:16:3e:28:f5:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983acc56-f3", "ovs_interfaceid": "983acc56-f35e-463b-9792-e837ce96710d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'resources' on Instance uuid 9e946b4a-9b93-459f-8e5e-d88612c4ec34 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'numa_topology' on Instance uuid 9e946b4a-9b93-459f-8e5e-d88612c4ec34 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:30:52 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:30:52 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9e946b4a-9b93-459f-8e5e-d88612c4ec34 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1814665883',display_name='tempest-ServerRescueNegativeTestJSON-server-1814665883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1814665883',id=25,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5njYzs7ALDcBWQSpVvDF+8eqtD/Nud28PRDonSHT12d1GA4E+ONV1w236vrdEKCSPLvrSiG9PlbH87hDgkoI2dCf1VNNLJnIgp5Ae3jA2xzUAVN6UK1g1BY7za6MohKg==',key_name='tempest-keypair-1891226028',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:28:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f130c48f19cf4ab7803c1169b759ccb6',ramdisk_id='',reservation_id='r-d77b8fyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-773079660',owner_user_name='tempest-ServerRescueNegativeTestJSON-773079660-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:28:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a432c1165e4ff4a9a10b4d71ddc513',uuid=9e946b4a-9b93-459f-8e5e-d88612c4ec34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "983acc56-f35e-463b-9792-e837ce96710d", "address": "fa:16:3e:28:f5:cf", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "vif_mac": "fa:16:3e:28:f5:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983acc56-f3", "ovs_interfaceid": "983acc56-f35e-463b-9792-e837ce96710d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converting VIF {"id": "983acc56-f35e-463b-9792-e837ce96710d", "address": "fa:16:3e:28:f5:cf", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "vif_mac": "fa:16:3e:28:f5:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983acc56-f3", "ovs_interfaceid": "983acc56-f35e-463b-9792-e837ce96710d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:f5:cf,bridge_name='br-int',has_traffic_filtering=True,id=983acc56-f35e-463b-9792-e837ce96710d,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983acc56-f3') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e946b4a-9b93-459f-8e5e-d88612c4ec34 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:30:52 user nova-compute[72201]:   <uuid>9e946b4a-9b93-459f-8e5e-d88612c4ec34</uuid>
Aug 01 15:30:52 user nova-compute[72201]:   <name>instance-00000019</name>
Aug 01 15:30:52 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:30:52 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:30:52 user nova-compute[72201]:   <metadata>
Aug 01 15:30:52 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:30:52 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:30:52 user nova-compute[72201]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1814665883</nova:name>
Aug 01 15:30:52 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:30:52</nova:creationTime>
Aug 01 15:30:52 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:30:52 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:30:52 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:30:52 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:30:52 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:30:52 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:30:52 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:30:52 user nova-compute[72201]:       <nova:owner>
Aug 01 15:30:52 user nova-compute[72201]:         <nova:user uuid="31a432c1165e4ff4a9a10b4d71ddc513">tempest-ServerRescueNegativeTestJSON-773079660-project-member</nova:user>
Aug 01 15:30:52 user nova-compute[72201]:         <nova:project uuid="f130c48f19cf4ab7803c1169b759ccb6">tempest-ServerRescueNegativeTestJSON-773079660</nova:project>
Aug 01 15:30:52 user nova-compute[72201]:       </nova:owner>
Aug 01 15:30:52 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:30:52 user nova-compute[72201]:       <nova:ports>
Aug 01 15:30:52 user nova-compute[72201]:         <nova:port uuid="983acc56-f35e-463b-9792-e837ce96710d">
Aug 01 15:30:52 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 15:30:52 user nova-compute[72201]:         </nova:port>
Aug 01 15:30:52 user nova-compute[72201]:       </nova:ports>
Aug 01 15:30:52 user nova-compute[72201]:     </nova:instance>
Aug 01 15:30:52 user nova-compute[72201]:   </metadata>
Aug 01 15:30:52 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:30:52 user nova-compute[72201]:     <system>
Aug 01 15:30:52 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:30:52 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:30:52 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:30:52 user nova-compute[72201]:       <entry name="serial">9e946b4a-9b93-459f-8e5e-d88612c4ec34</entry>
Aug 01 15:30:52 user nova-compute[72201]:       <entry name="uuid">9e946b4a-9b93-459f-8e5e-d88612c4ec34</entry>
Aug 01 15:30:52 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:30:52 user nova-compute[72201]:     </system>
Aug 01 15:30:52 user nova-compute[72201]:   </sysinfo>
Aug 01 15:30:52 user nova-compute[72201]:   <os>
Aug 01 15:30:52 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:30:52 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:30:52 user nova-compute[72201]:   </os>
Aug 01 15:30:52 user nova-compute[72201]:   <features>
Aug 01 15:30:52 user nova-compute[72201]:     <acpi/>
Aug 01 15:30:52 user nova-compute[72201]:     <apic/>
Aug 01 15:30:52 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:30:52 user nova-compute[72201]:   </features>
Aug 01 15:30:52 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:30:52 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:30:52 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:30:52 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:30:52 user nova-compute[72201]:   </clock>
Aug 01 15:30:52 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:30:52 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:30:52 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:30:52 user nova-compute[72201]:   </cpu>
Aug 01 15:30:52 user nova-compute[72201]:   <devices>
Aug 01 15:30:52 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:30:52 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:30:52 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk.rescue"/>
Aug 01 15:30:52 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:30:52 user nova-compute[72201]:     </disk>
Aug 01 15:30:52 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:30:52 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:30:52 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk"/>
Aug 01 15:30:52 user nova-compute[72201]:       <target dev="vdb" bus="virtio"/>
Aug 01 15:30:52 user nova-compute[72201]:     </disk>
Aug 01 15:30:52 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:30:52 user nova-compute[72201]:       <mac address="fa:16:3e:28:f5:cf"/>
Aug 01 15:30:52 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:30:52 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:30:52 user nova-compute[72201]:       <target dev="tap983acc56-f3"/>
Aug 01 15:30:52 user nova-compute[72201]:     </interface>
Aug 01 15:30:52 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:30:52 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/console.log" append="off"/>
Aug 01 15:30:52 user nova-compute[72201]:     </serial>
Aug 01 15:30:52 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:30:52 user nova-compute[72201]:     <video>
Aug 01 15:30:52 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:30:52 user nova-compute[72201]:     </video>
Aug 01 15:30:52 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:30:52 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:30:52 user nova-compute[72201]:     </rng>
Aug 01 15:30:52 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:30:52 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:30:52 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:30:52 user nova-compute[72201]:     </memballoon>
Aug 01 15:30:52 user nova-compute[72201]:   </devices>
Aug 01 15:30:52 user nova-compute[72201]: </domain>
Aug 01 15:30:52 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:30:52 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Instance destroyed successfully.
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:30:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] No VIF found with MAC fa:16:3e:28:f5:cf, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:30:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:53 user nova-compute[72201]: DEBUG nova.compute.manager [req-3b9eefdf-e2d0-421c-8de5-51325f4dbfaf req-5d81a16f-591c-414e-b745-74f7c8fab2e1 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received event network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3b9eefdf-e2d0-421c-8de5-51325f4dbfaf req-5d81a16f-591c-414e-b745-74f7c8fab2e1 service nova] Acquiring lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3b9eefdf-e2d0-421c-8de5-51325f4dbfaf req-5d81a16f-591c-414e-b745-74f7c8fab2e1 service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3b9eefdf-e2d0-421c-8de5-51325f4dbfaf req-5d81a16f-591c-414e-b745-74f7c8fab2e1 service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:53 user nova-compute[72201]: DEBUG nova.compute.manager [req-3b9eefdf-e2d0-421c-8de5-51325f4dbfaf req-5d81a16f-591c-414e-b745-74f7c8fab2e1 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] No waiting events found dispatching network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:30:53 user nova-compute[72201]: WARNING nova.compute.manager [req-3b9eefdf-e2d0-421c-8de5-51325f4dbfaf req-5d81a16f-591c-414e-b745-74f7c8fab2e1 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received unexpected event network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d for instance with vm_state active and task_state rescuing.
Aug 01 15:30:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-94677dac-017f-499c-923f-9e091ab05ded req-98d60cf1-bbb4-4be5-8f8c-b74d8d8a45a8 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received event network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-94677dac-017f-499c-923f-9e091ab05ded req-98d60cf1-bbb4-4be5-8f8c-b74d8d8a45a8 service nova] Acquiring lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-94677dac-017f-499c-923f-9e091ab05ded req-98d60cf1-bbb4-4be5-8f8c-b74d8d8a45a8 service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-94677dac-017f-499c-923f-9e091ab05ded req-98d60cf1-bbb4-4be5-8f8c-b74d8d8a45a8 service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-94677dac-017f-499c-923f-9e091ab05ded req-98d60cf1-bbb4-4be5-8f8c-b74d8d8a45a8 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] No waiting events found dispatching network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:30:56 user nova-compute[72201]: WARNING nova.compute.manager [req-94677dac-017f-499c-923f-9e091ab05ded req-98d60cf1-bbb4-4be5-8f8c-b74d8d8a45a8 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received unexpected event network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d for instance with vm_state active and task_state rescuing.
Aug 01 15:30:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-94677dac-017f-499c-923f-9e091ab05ded req-98d60cf1-bbb4-4be5-8f8c-b74d8d8a45a8 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received event network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-94677dac-017f-499c-923f-9e091ab05ded req-98d60cf1-bbb4-4be5-8f8c-b74d8d8a45a8 service nova] Acquiring lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-94677dac-017f-499c-923f-9e091ab05ded req-98d60cf1-bbb4-4be5-8f8c-b74d8d8a45a8 service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-94677dac-017f-499c-923f-9e091ab05ded req-98d60cf1-bbb4-4be5-8f8c-b74d8d8a45a8 service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-94677dac-017f-499c-923f-9e091ab05ded req-98d60cf1-bbb4-4be5-8f8c-b74d8d8a45a8 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] No waiting events found dispatching network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:30:56 user nova-compute[72201]: WARNING nova.compute.manager [req-94677dac-017f-499c-923f-9e091ab05ded req-98d60cf1-bbb4-4be5-8f8c-b74d8d8a45a8 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received unexpected event network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d for instance with vm_state active and task_state rescuing.
Aug 01 15:30:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Removed pending event for 9e946b4a-9b93-459f-8e5e-d88612c4ec34 due to event {{(pid=72201) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 15:30:56 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903856.4518716, 9e946b4a-9b93-459f-8e5e-d88612c4ec34 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:30:56 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] VM Resumed (Lifecycle Event)
Aug 01 15:30:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a86c9121-6c60-4fa9-b0ae-c967ef3a474d tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:30:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:30:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:30:56 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 15:30:56 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903856.4573457, 9e946b4a-9b93-459f-8e5e-d88612c4ec34 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:30:56 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] VM Started (Lifecycle Event)
Aug 01 15:30:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-d96846e9-0f62-4fc8-8850-d588bc08b00f req-87849e27-a275-4c83-8dea-db4be7bbcba0 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Received event network-changed-bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-d96846e9-0f62-4fc8-8850-d588bc08b00f req-87849e27-a275-4c83-8dea-db4be7bbcba0 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Refreshing instance network info cache due to event network-changed-bc611803-5aa5-4b8b-961b-cd6c43317b21. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:30:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d96846e9-0f62-4fc8-8850-d588bc08b00f req-87849e27-a275-4c83-8dea-db4be7bbcba0 service nova] Acquiring lock "refresh_cache-e2ca19ea-868c-40ad-a453-f6e348cfac15" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:30:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d96846e9-0f62-4fc8-8850-d588bc08b00f req-87849e27-a275-4c83-8dea-db4be7bbcba0 service nova] Acquired lock "refresh_cache-e2ca19ea-868c-40ad-a453-f6e348cfac15" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:30:56 user nova-compute[72201]: DEBUG nova.network.neutron [req-d96846e9-0f62-4fc8-8850-d588bc08b00f req-87849e27-a275-4c83-8dea-db4be7bbcba0 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Refreshing network info cache for port bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:30:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:30:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:30:56 user nova-compute[72201]: DEBUG nova.network.neutron [req-d96846e9-0f62-4fc8-8850-d588bc08b00f req-87849e27-a275-4c83-8dea-db4be7bbcba0 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Updated VIF entry in instance network info cache for port bc611803-5aa5-4b8b-961b-cd6c43317b21. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:30:56 user nova-compute[72201]: DEBUG nova.network.neutron [req-d96846e9-0f62-4fc8-8850-d588bc08b00f req-87849e27-a275-4c83-8dea-db4be7bbcba0 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Updating instance_info_cache with network_info: [{"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:30:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d96846e9-0f62-4fc8-8850-d588bc08b00f req-87849e27-a275-4c83-8dea-db4be7bbcba0 service nova] Releasing lock "refresh_cache-e2ca19ea-868c-40ad-a453-f6e348cfac15" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:30:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:58 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Stashing vm_state: active {{(pid=72201) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 01 15:30:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:30:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:30:58 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lazy-loading 'pci_requests' on Instance uuid bd70360d-30b8-47d5-b35e-adf0d28482dd {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:30:58 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:30:58 user nova-compute[72201]: INFO nova.compute.claims [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Claim successful on node user
Aug 01 15:30:58 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lazy-loading 'resources' on Instance uuid bd70360d-30b8-47d5-b35e-adf0d28482dd {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:30:58 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lazy-loading 'pci_devices' on Instance uuid bd70360d-30b8-47d5-b35e-adf0d28482dd {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:30:58 user nova-compute[72201]: INFO nova.compute.resource_tracker [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Updating resource usage from migration 39d76218-a07b-4517-b132-4e3fb4484638
Aug 01 15:30:58 user nova-compute[72201]: DEBUG nova.compute.manager [req-58696b5d-d423-47d2-a1cb-d92589ed068b req-d96a2736-e5a8-407f-9c38-ad8579aaa3d2 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Received event network-changed-9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:30:58 user nova-compute[72201]: DEBUG nova.compute.manager [req-58696b5d-d423-47d2-a1cb-d92589ed068b req-d96a2736-e5a8-407f-9c38-ad8579aaa3d2 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Refreshing instance network info cache due to event network-changed-9640f8a6-86a4-403c-9dac-06c68368d6dd. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:30:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-58696b5d-d423-47d2-a1cb-d92589ed068b req-d96a2736-e5a8-407f-9c38-ad8579aaa3d2 service nova] Acquiring lock "refresh_cache-bd70360d-30b8-47d5-b35e-adf0d28482dd" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:30:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-58696b5d-d423-47d2-a1cb-d92589ed068b req-d96a2736-e5a8-407f-9c38-ad8579aaa3d2 service nova] Acquired lock "refresh_cache-bd70360d-30b8-47d5-b35e-adf0d28482dd" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:30:58 user nova-compute[72201]: DEBUG nova.network.neutron [req-58696b5d-d423-47d2-a1cb-d92589ed068b req-d96a2736-e5a8-407f-9c38-ad8579aaa3d2 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Refreshing network info cache for port 9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:30:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:58 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:30:58 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:30:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.614s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:30:58 user nova-compute[72201]: INFO nova.compute.manager [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Migrating
Aug 01 15:30:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:30:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:30:58 user nova-compute[72201]: INFO nova.compute.rpcapi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 01 15:30:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:30:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "refresh_cache-bd70360d-30b8-47d5-b35e-adf0d28482dd" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:30:59 user nova-compute[72201]: DEBUG nova.network.neutron [req-58696b5d-d423-47d2-a1cb-d92589ed068b req-d96a2736-e5a8-407f-9c38-ad8579aaa3d2 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Updated VIF entry in instance network info cache for port 9640f8a6-86a4-403c-9dac-06c68368d6dd. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:30:59 user nova-compute[72201]: DEBUG nova.network.neutron [req-58696b5d-d423-47d2-a1cb-d92589ed068b req-d96a2736-e5a8-407f-9c38-ad8579aaa3d2 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Updating instance_info_cache with network_info: [{"id": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "address": "fa:16:3e:9c:ca:83", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9640f8a6-86", "ovs_interfaceid": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:30:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-58696b5d-d423-47d2-a1cb-d92589ed068b req-d96a2736-e5a8-407f-9c38-ad8579aaa3d2 service nova] Releasing lock "refresh_cache-bd70360d-30b8-47d5-b35e-adf0d28482dd" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:30:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquired lock "refresh_cache-bd70360d-30b8-47d5-b35e-adf0d28482dd" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:30:59 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:30:59 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Updating instance_info_cache with network_info: [{"id": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "address": "fa:16:3e:9c:ca:83", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9640f8a6-86", "ovs_interfaceid": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:30:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Releasing lock "refresh_cache-bd70360d-30b8-47d5-b35e-adf0d28482dd" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:30:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Starting migrate_disk_and_power_off {{(pid=72201) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 01 15:30:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:30:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG nova.compute.manager [req-d1a1afd6-40fd-4dcd-9825-cf6140f6180f req-0f15efb0-62b9-441c-8279-df4beab1f8d5 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Received event network-vif-unplugged-9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d1a1afd6-40fd-4dcd-9825-cf6140f6180f req-0f15efb0-62b9-441c-8279-df4beab1f8d5 service nova] Acquiring lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d1a1afd6-40fd-4dcd-9825-cf6140f6180f req-0f15efb0-62b9-441c-8279-df4beab1f8d5 service nova] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d1a1afd6-40fd-4dcd-9825-cf6140f6180f req-0f15efb0-62b9-441c-8279-df4beab1f8d5 service nova] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG nova.compute.manager [req-d1a1afd6-40fd-4dcd-9825-cf6140f6180f req-0f15efb0-62b9-441c-8279-df4beab1f8d5 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] No waiting events found dispatching network-vif-unplugged-9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:31:00 user nova-compute[72201]: WARNING nova.compute.manager [req-d1a1afd6-40fd-4dcd-9825-cf6140f6180f req-0f15efb0-62b9-441c-8279-df4beab1f8d5 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Received unexpected event network-vif-unplugged-9640f8a6-86a4-403c-9dac-06c68368d6dd for instance with vm_state active and task_state resize_migrating.
Aug 01 15:31:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:00 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Instance destroyed successfully.
Aug 01 15:31:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-831320262',display_name='tempest-ServerActionsTestOtherA-server-831320262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-831320262',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj9M7ZGdr6vvGAAN6LlX0Yd4KFWs7o7dSiIrZzG0de25MryOgdU0IQWkOsGcYGYZLChUKVpEI60JU+ZGbYHXhk4M5ia3Yx+QGjlFCbCEmncodiyKPCipVQmd8JPh2FoTg==',key_name='tempest-keypair-1499887671',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:29:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e85c7d5f159c4ff2896b5549cf73b977',ramdisk_id='',reservation_id='r-ce52lrt8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-765053637',owner_user_name='tempest-ServerActionsTestOtherA-765053637-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:30:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ccd18b99219749fe8febdc0da8fc4388',uuid=bd70360d-30b8-47d5-b35e-adf0d28482dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "address": "fa:16:3e:9c:ca:83", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2132170896-network", "vif_mac": "fa:16:3e:9c:ca:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9640f8a6-86", "ovs_interfaceid": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converting VIF {"id": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "address": "fa:16:3e:9c:ca:83", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2132170896-network", "vif_mac": "fa:16:3e:9c:ca:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9640f8a6-86", "ovs_interfaceid": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:ca:83,bridge_name='br-int',has_traffic_filtering=True,id=9640f8a6-86a4-403c-9dac-06c68368d6dd,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9640f8a6-86') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG os_vif [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:ca:83,bridge_name='br-int',has_traffic_filtering=True,id=9640f8a6-86a4-403c-9dac-06c68368d6dd,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9640f8a6-86') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9640f8a6-86, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:00 user nova-compute[72201]: INFO os_vif [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:ca:83,bridge_name='br-int',has_traffic_filtering=True,id=9640f8a6-86a4-403c-9dac-06c68368d6dd,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9640f8a6-86')
Aug 01 15:31:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SJcMhgkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:31:00 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:31:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[680272a7-e02f-4a70-b9a6-c7232e36c393]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef571822-6113-479e-ab81-01d1b0df5dff]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:31:00 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:31:00 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:00 user nova-compute[72201]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:31:00 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:00 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:31:00 user nova-compute[72201]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:31:00 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:00 user nova-compute[72201]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:31:00 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:00 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c179510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7'): ({'sdd'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Removing single pathed devices sdd {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f65f0f-484d-4ca2-ae67-e59e77cea11e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff7c7fe-8fbb-4d4b-8b27-61530b7c8319]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Flushing IO for device /dev/sdd {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c38feaf-ec21-441d-87d1-37b1eec73641]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8ace4e-b67b-4137-b351-e51eae66f076]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] SCSI volumes sdd have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac58784-4051-4b3a-99a8-863331759899]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cef9f7-5510-4284-bc7f-8e842c790bcc]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7, portal: 172.16.0.220,3260]
Aug 01 15:31:00 user nova-compute[72201]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7, portal: 172.16.0.220,3260] successful.
Aug 01 15:31:00 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[117ae373-b0ce-4acf-b1cb-1af039ec005b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] <== disconnect_volume: return (356ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:31:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:31:01 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:31:01 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:31:01 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72201) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 15:31:01 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:31:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-02f03bdf-ec84-4a66-adc3-7ca5f6b80679 req-fec49fdd-bd07-4ff0-abc9-80bcd6189cf3 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Received event network-vif-plugged-9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:31:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-02f03bdf-ec84-4a66-adc3-7ca5f6b80679 req-fec49fdd-bd07-4ff0-abc9-80bcd6189cf3 service nova] Acquiring lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-02f03bdf-ec84-4a66-adc3-7ca5f6b80679 req-fec49fdd-bd07-4ff0-abc9-80bcd6189cf3 service nova] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-02f03bdf-ec84-4a66-adc3-7ca5f6b80679 req-fec49fdd-bd07-4ff0-abc9-80bcd6189cf3 service nova] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-02f03bdf-ec84-4a66-adc3-7ca5f6b80679 req-fec49fdd-bd07-4ff0-abc9-80bcd6189cf3 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] No waiting events found dispatching network-vif-plugged-9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:31:02 user nova-compute[72201]: WARNING nova.compute.manager [req-02f03bdf-ec84-4a66-adc3-7ca5f6b80679 req-fec49fdd-bd07-4ff0-abc9-80bcd6189cf3 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Received unexpected event network-vif-plugged-9640f8a6-86a4-403c-9dac-06c68368d6dd for instance with vm_state active and task_state resize_migrating.
Aug 01 15:31:02 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Port 9640f8a6-86a4-403c-9dac-06c68368d6dd binding to destination host user is already ACTIVE {{(pid=72201) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 15:31:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "refresh_cache-bd70360d-30b8-47d5-b35e-adf0d28482dd" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:31:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquired lock "refresh_cache-bd70360d-30b8-47d5-b35e-adf0d28482dd" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:31:02 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Updating instance_info_cache with network_info: [{"id": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "address": "fa:16:3e:9c:ca:83", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9640f8a6-86", "ovs_interfaceid": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Releasing lock "refresh_cache-bd70360d-30b8-47d5-b35e-adf0d28482dd" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG os_brick.utils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0163886-38e7-413e-9615-5cfc9d162316]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76db9da-0708-42ad-81a1-6d1ecd9b2615]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[210a0aea-425b-4259-be35-773e4975d3b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f963a5c-f25a-4324-bd29-80146258c99e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:31:03 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:31:03 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf4f38b-801f-4573-a89b-3992c33b8c58]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:31:03 user nova-compute[72201]: DEBUG os_brick.utils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:31:04 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:31:05 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:31:05 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:31:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-865b371c-59c5-4004-8469-cdc1e9327ecb" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:31:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-865b371c-59c5-4004-8469-cdc1e9327ecb" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:31:05 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:31:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:05 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Updating instance_info_cache with network_info: [{"id": "d3f16763-8835-4330-945f-ab8dc7045426", "address": "fa:16:3e:f0:07:0d", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f16763-88", "ovs_interfaceid": "d3f16763-8835-4330-945f-ab8dc7045426", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:31:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-865b371c-59c5-4004-8469-cdc1e9327ecb" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:31:05 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:31:07 user nova-compute[72201]: INFO nova.compute.manager [None req-f017fe39-f23a-4c3c-bd3c-6e42adfda423 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Unrescuing
Aug 01 15:31:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f017fe39-f23a-4c3c-bd3c-6e42adfda423 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:31:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f017fe39-f23a-4c3c-bd3c-6e42adfda423 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquired lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:31:07 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f017fe39-f23a-4c3c-bd3c-6e42adfda423 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:31:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:31:08 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:31:08 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f017fe39-f23a-4c3c-bd3c-6e42adfda423 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Updating instance_info_cache with network_info: [{"id": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "address": "fa:16:3e:49:45:f6", "network": {"id": "11d4bdb2-99b5-468c-aeb3-79328fdd2d1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58b7341ffe06448bb276bdee2d242c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf512d66-cb", "ovs_interfaceid": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:31:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f017fe39-f23a-4c3c-bd3c-6e42adfda423 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Releasing lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:31:08 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f017fe39-f23a-4c3c-bd3c-6e42adfda423 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lazy-loading 'flavor' on Instance uuid 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:31:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:08 user nova-compute[72201]: DEBUG nova.compute.manager [req-2f63e3f9-08a3-42df-a17d-235d095edaf7 req-17d9a4ee-42a8-4ceb-817f-4f6bfb591c6a service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received event network-vif-unplugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:31:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2f63e3f9-08a3-42df-a17d-235d095edaf7 req-17d9a4ee-42a8-4ceb-817f-4f6bfb591c6a service nova] Acquiring lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2f63e3f9-08a3-42df-a17d-235d095edaf7 req-17d9a4ee-42a8-4ceb-817f-4f6bfb591c6a service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2f63e3f9-08a3-42df-a17d-235d095edaf7 req-17d9a4ee-42a8-4ceb-817f-4f6bfb591c6a service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:08 user nova-compute[72201]: DEBUG nova.compute.manager [req-2f63e3f9-08a3-42df-a17d-235d095edaf7 req-17d9a4ee-42a8-4ceb-817f-4f6bfb591c6a service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] No waiting events found dispatching network-vif-unplugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:31:08 user nova-compute[72201]: WARNING nova.compute.manager [req-2f63e3f9-08a3-42df-a17d-235d095edaf7 req-17d9a4ee-42a8-4ceb-817f-4f6bfb591c6a service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received unexpected event network-vif-unplugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 for instance with vm_state rescued and task_state unrescuing.
Aug 01 15:31:08 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Instance destroyed successfully.
Aug 01 15:31:09 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:31:10 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:31:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:10 user nova-compute[72201]: DEBUG nova.compute.manager [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received event network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:31:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] Acquiring lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:10 user nova-compute[72201]: DEBUG nova.compute.manager [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] No waiting events found dispatching network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:31:10 user nova-compute[72201]: WARNING nova.compute.manager [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received unexpected event network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 for instance with vm_state rescued and task_state unrescuing.
Aug 01 15:31:10 user nova-compute[72201]: DEBUG nova.compute.manager [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received event network-changed-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:31:10 user nova-compute[72201]: DEBUG nova.compute.manager [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Refreshing instance network info cache due to event network-changed-af512d66-cb4c-4633-ba94-d8b6b3af6e87. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:31:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] Acquiring lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:31:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] Acquired lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:31:10 user nova-compute[72201]: DEBUG nova.network.neutron [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Refreshing network info cache for port af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:31:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.network.neutron [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Updated VIF entry in instance network info cache for port af512d66-cb4c-4633-ba94-d8b6b3af6e87. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.network.neutron [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Updating instance_info_cache with network_info: [{"id": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "address": "fa:16:3e:49:45:f6", "network": {"id": "11d4bdb2-99b5-468c-aeb3-79328fdd2d1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58b7341ffe06448bb276bdee2d242c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf512d66-cb", "ovs_interfaceid": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] Releasing lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.compute.manager [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received event network-changed-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.compute.manager [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Refreshing instance network info cache due to event network-changed-af512d66-cb4c-4633-ba94-d8b6b3af6e87. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] Acquiring lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] Acquired lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.network.neutron [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Refreshing network info cache for port af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Starting finish_migration {{(pid=72201) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Instance directory exists: not creating {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 15:31:11 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Creating image(s)
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Did not create local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Ensure instance console log exists: /opt/stack/data/nova/instances/bd70360d-30b8-47d5-b35e-adf0d28482dd/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Start _get_guest_xml network_info=[{"id": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "address": "fa:16:3e:9c:ca:83", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2132170896-network", "vif_mac": "fa:16:3e:9c:ca:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9640f8a6-86", "ovs_interfaceid": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SJcMhgkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'bd70360d-30b8-47d5-b35e-adf0d28482dd', 'attached_at': '2023-08-01T15:31:11.000000', 'detached_at': '', 'volume_id': 'a3fc5574-1c65-46a3-9e0b-85f222ac4cb7', 'serial': 'a3fc5574-1c65-46a3-9e0b-85f222ac4cb7'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '593a6352-6229-47ba-92a3-0cb6f3ceae45', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:31:11 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:31:11 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lazy-loading 'vcpu_model' on Instance uuid bd70360d-30b8-47d5-b35e-adf0d28482dd {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SJcMhgkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:31:11 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:31:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:31:11 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:31:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:31:11 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6b49a2-9348-4f82-a9b9-291834675db3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:31:11 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1992a48a-983d-44e8-98bb-326396a74e09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7] added
Aug 01 15:31:11 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c81db4d-17d0-4124-a09b-b596d98d49b3]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[737d2a78-0450-4330-b37e-fd40af3ac26b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SJcMhgkx {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SJcMhgkx" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cf5015-02a9-4fe6-99b8-8c9063ee128f]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SJcMhgkx'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa966c30-50ef-4acc-8511-c4fe37d92718]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dde953d-9717-4264-9c23-eb16517f11f4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:31:11 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:11 user nova-compute[72201]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:31:11 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:11 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:31:11 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:11 user nova-compute[72201]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:31:11 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:11 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:31:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fc897e-28c0-4f47-8d33-8a0ca8ec70b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7, portal: 172.16.0.220,3260]
Aug 01 15:31:12 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7, portal: 172.16.0.220,3260] successful.
Aug 01 15:31:12 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5925f016-4975-4d0a-a6ba-c6d55b02170b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8ee07d-1199-4dd2-9f50-5d3ee4e9cdf0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:31:12 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:12 user nova-compute[72201]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:31:12 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:12 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:31:12 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:31:12 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:12 user nova-compute[72201]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:31:12 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:12 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:31:12 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5514f6ed-a5bb-45dc-adcb-fcbf9c757e42]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: None {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG nova.network.neutron [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Updated VIF entry in instance network info cache for port af512d66-cb4c-4633-ba94-d8b6b3af6e87. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG nova.network.neutron [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Updating instance_info_cache with network_info: [{"id": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "address": "fa:16:3e:49:45:f6", "network": {"id": "11d4bdb2-99b5-468c-aeb3-79328fdd2d1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58b7341ffe06448bb276bdee2d242c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf512d66-cb", "ovs_interfaceid": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] Releasing lock "refresh_cache-3a2d865c-6c6c-49b1-a2d3-4afc63b10581" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received event network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] Acquiring lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] No waiting events found dispatching network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:31:12 user nova-compute[72201]: WARNING nova.compute.manager [req-44935d4e-7500-41e3-9b2d-8fe7ed1faa2f req-60dbfc53-27c3-4c89-9f22-32347d73e683 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received unexpected event network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 for instance with vm_state rescued and task_state unrescuing.
Aug 01 15:31:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Removed pending event for 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 due to event {{(pid=72201) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903872.5330029, 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:31:12 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] VM Resumed (Lifecycle Event)
Aug 01 15:31:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f017fe39-f23a-4c3c-bd3c-6e42adfda423 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:31:12 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 15:31:12 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903872.533264, 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:31:12 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] VM Started (Lifecycle Event)
Aug 01 15:31:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-12ee904f-c40d-40df-a1c8-abf612aec28c req-a5ce83ce-94ef-4a24-9dd6-fe9799be52fa service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received event network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-12ee904f-c40d-40df-a1c8-abf612aec28c req-a5ce83ce-94ef-4a24-9dd6-fe9799be52fa service nova] Acquiring lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-12ee904f-c40d-40df-a1c8-abf612aec28c req-a5ce83ce-94ef-4a24-9dd6-fe9799be52fa service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-12ee904f-c40d-40df-a1c8-abf612aec28c req-a5ce83ce-94ef-4a24-9dd6-fe9799be52fa service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-12ee904f-c40d-40df-a1c8-abf612aec28c req-a5ce83ce-94ef-4a24-9dd6-fe9799be52fa service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] No waiting events found dispatching network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:31:12 user nova-compute[72201]: WARNING nova.compute.manager [req-12ee904f-c40d-40df-a1c8-abf612aec28c req-a5ce83ce-94ef-4a24-9dd6-fe9799be52fa service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received unexpected event network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 for instance with vm_state active and task_state None.
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SJcMhgkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23832633431386438', 'path': '/dev/sdd'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832633431386438', 'path': '/dev/sdd'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-831320262',display_name='tempest-ServerActionsTestOtherA-server-831320262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-831320262',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj9M7ZGdr6vvGAAN6LlX0Yd4KFWs7o7dSiIrZzG0de25MryOgdU0IQWkOsGcYGYZLChUKVpEI60JU+ZGbYHXhk4M5ia3Yx+QGjlFCbCEmncodiyKPCipVQmd8JPh2FoTg==',key_name='tempest-keypair-1499887671',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:29:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e85c7d5f159c4ff2896b5549cf73b977',ramdisk_id='',reservation_id='r-ce52lrt8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-765053637',owner_user_name='tempest-ServerActionsTestOtherA-765053637-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:31:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ccd18b99219749fe8febdc0da8fc4388',uuid=bd70360d-30b8-47d5-b35e-adf0d28482dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "address": "fa:16:3e:9c:ca:83", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2132170896-network", "vif_mac": "fa:16:3e:9c:ca:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9640f8a6-86", "ovs_interfaceid": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converting VIF {"id": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "address": "fa:16:3e:9c:ca:83", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2132170896-network", "vif_mac": "fa:16:3e:9c:ca:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9640f8a6-86", "ovs_interfaceid": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:ca:83,bridge_name='br-int',has_traffic_filtering=True,id=9640f8a6-86a4-403c-9dac-06c68368d6dd,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9640f8a6-86') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:31:13 user nova-compute[72201]:   <uuid>bd70360d-30b8-47d5-b35e-adf0d28482dd</uuid>
Aug 01 15:31:13 user nova-compute[72201]:   <name>instance-0000001a</name>
Aug 01 15:31:13 user nova-compute[72201]:   <memory>2097152</memory>
Aug 01 15:31:13 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:31:13 user nova-compute[72201]:   <metadata>
Aug 01 15:31:13 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:31:13 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:31:13 user nova-compute[72201]:       <nova:name>tempest-ServerActionsTestOtherA-server-831320262</nova:name>
Aug 01 15:31:13 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:31:11</nova:creationTime>
Aug 01 15:31:13 user nova-compute[72201]:       <nova:flavor name="m1.small">
Aug 01 15:31:13 user nova-compute[72201]:         <nova:memory>2048</nova:memory>
Aug 01 15:31:13 user nova-compute[72201]:         <nova:disk>20</nova:disk>
Aug 01 15:31:13 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:31:13 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:31:13 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:31:13 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:31:13 user nova-compute[72201]:       <nova:owner>
Aug 01 15:31:13 user nova-compute[72201]:         <nova:user uuid="ccd18b99219749fe8febdc0da8fc4388">tempest-ServerActionsTestOtherA-765053637-project-member</nova:user>
Aug 01 15:31:13 user nova-compute[72201]:         <nova:project uuid="e85c7d5f159c4ff2896b5549cf73b977">tempest-ServerActionsTestOtherA-765053637</nova:project>
Aug 01 15:31:13 user nova-compute[72201]:       </nova:owner>
Aug 01 15:31:13 user nova-compute[72201]:       <nova:ports>
Aug 01 15:31:13 user nova-compute[72201]:         <nova:port uuid="9640f8a6-86a4-403c-9dac-06c68368d6dd">
Aug 01 15:31:13 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 15:31:13 user nova-compute[72201]:         </nova:port>
Aug 01 15:31:13 user nova-compute[72201]:       </nova:ports>
Aug 01 15:31:13 user nova-compute[72201]:     </nova:instance>
Aug 01 15:31:13 user nova-compute[72201]:   </metadata>
Aug 01 15:31:13 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:31:13 user nova-compute[72201]:     <system>
Aug 01 15:31:13 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:31:13 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:31:13 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:31:13 user nova-compute[72201]:       <entry name="serial">bd70360d-30b8-47d5-b35e-adf0d28482dd</entry>
Aug 01 15:31:13 user nova-compute[72201]:       <entry name="uuid">bd70360d-30b8-47d5-b35e-adf0d28482dd</entry>
Aug 01 15:31:13 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:31:13 user nova-compute[72201]:     </system>
Aug 01 15:31:13 user nova-compute[72201]:   </sysinfo>
Aug 01 15:31:13 user nova-compute[72201]:   <os>
Aug 01 15:31:13 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:31:13 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:31:13 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:31:13 user nova-compute[72201]:   </os>
Aug 01 15:31:13 user nova-compute[72201]:   <features>
Aug 01 15:31:13 user nova-compute[72201]:     <acpi/>
Aug 01 15:31:13 user nova-compute[72201]:     <apic/>
Aug 01 15:31:13 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:31:13 user nova-compute[72201]:   </features>
Aug 01 15:31:13 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:31:13 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:31:13 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:31:13 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:31:13 user nova-compute[72201]:   </clock>
Aug 01 15:31:13 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:31:13 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:31:13 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:31:13 user nova-compute[72201]:   </cpu>
Aug 01 15:31:13 user nova-compute[72201]:   <devices>
Aug 01 15:31:13 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:31:13 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:31:13 user nova-compute[72201]:       <source dev="/dev/sdd"/>
Aug 01 15:31:13 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:31:13 user nova-compute[72201]:       <serial>a3fc5574-1c65-46a3-9e0b-85f222ac4cb7</serial>
Aug 01 15:31:13 user nova-compute[72201]:     </disk>
Aug 01 15:31:13 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:31:13 user nova-compute[72201]:       <mac address="fa:16:3e:9c:ca:83"/>
Aug 01 15:31:13 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:31:13 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:31:13 user nova-compute[72201]:       <target dev="tap9640f8a6-86"/>
Aug 01 15:31:13 user nova-compute[72201]:     </interface>
Aug 01 15:31:13 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:31:13 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/bd70360d-30b8-47d5-b35e-adf0d28482dd/console.log" append="off"/>
Aug 01 15:31:13 user nova-compute[72201]:     </serial>
Aug 01 15:31:13 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:31:13 user nova-compute[72201]:     <video>
Aug 01 15:31:13 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:31:13 user nova-compute[72201]:     </video>
Aug 01 15:31:13 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:31:13 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:31:13 user nova-compute[72201]:     </rng>
Aug 01 15:31:13 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:31:13 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:31:13 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:31:13 user nova-compute[72201]:     </memballoon>
Aug 01 15:31:13 user nova-compute[72201]:   </devices>
Aug 01 15:31:13 user nova-compute[72201]: </domain>
Aug 01 15:31:13 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-831320262',display_name='tempest-ServerActionsTestOtherA-server-831320262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-831320262',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj9M7ZGdr6vvGAAN6LlX0Yd4KFWs7o7dSiIrZzG0de25MryOgdU0IQWkOsGcYGYZLChUKVpEI60JU+ZGbYHXhk4M5ia3Yx+QGjlFCbCEmncodiyKPCipVQmd8JPh2FoTg==',key_name='tempest-keypair-1499887671',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:29:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e85c7d5f159c4ff2896b5549cf73b977',ramdisk_id='',reservation_id='r-ce52lrt8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-765053637',owner_user_name='tempest-ServerActionsTestOtherA-765053637-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:31:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ccd18b99219749fe8febdc0da8fc4388',uuid=bd70360d-30b8-47d5-b35e-adf0d28482dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "address": "fa:16:3e:9c:ca:83", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2132170896-network", "vif_mac": "fa:16:3e:9c:ca:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9640f8a6-86", "ovs_interfaceid": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converting VIF {"id": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "address": "fa:16:3e:9c:ca:83", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2132170896-network", "vif_mac": "fa:16:3e:9c:ca:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9640f8a6-86", "ovs_interfaceid": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:ca:83,bridge_name='br-int',has_traffic_filtering=True,id=9640f8a6-86a4-403c-9dac-06c68368d6dd,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9640f8a6-86') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG os_vif [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:ca:83,bridge_name='br-int',has_traffic_filtering=True,id=9640f8a6-86a4-403c-9dac-06c68368d6dd,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9640f8a6-86') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9640f8a6-86, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9640f8a6-86, col_values=(('external_ids', {'iface-id': '9640f8a6-86a4-403c-9dac-06c68368d6dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:ca:83', 'vm-uuid': 'bd70360d-30b8-47d5-b35e-adf0d28482dd'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:13 user nova-compute[72201]: INFO os_vif [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:ca:83,bridge_name='br-int',has_traffic_filtering=True,id=9640f8a6-86a4-403c-9dac-06c68368d6dd,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9640f8a6-86')
Aug 01 15:31:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] No VIF found with MAC fa:16:3e:9c:ca:83, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:31:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:14 user nova-compute[72201]: DEBUG nova.compute.manager [req-fd90fb8a-9694-4092-9bbf-2a7f4d1af8a0 req-588562f0-aadc-4ba9-a8d1-b94a05ef1f74 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Received event network-vif-plugged-9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:31:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-fd90fb8a-9694-4092-9bbf-2a7f4d1af8a0 req-588562f0-aadc-4ba9-a8d1-b94a05ef1f74 service nova] Acquiring lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-fd90fb8a-9694-4092-9bbf-2a7f4d1af8a0 req-588562f0-aadc-4ba9-a8d1-b94a05ef1f74 service nova] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-fd90fb8a-9694-4092-9bbf-2a7f4d1af8a0 req-588562f0-aadc-4ba9-a8d1-b94a05ef1f74 service nova] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:14 user nova-compute[72201]: DEBUG nova.compute.manager [req-fd90fb8a-9694-4092-9bbf-2a7f4d1af8a0 req-588562f0-aadc-4ba9-a8d1-b94a05ef1f74 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] No waiting events found dispatching network-vif-plugged-9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:31:14 user nova-compute[72201]: WARNING nova.compute.manager [req-fd90fb8a-9694-4092-9bbf-2a7f4d1af8a0 req-588562f0-aadc-4ba9-a8d1-b94a05ef1f74 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Received unexpected event network-vif-plugged-9640f8a6-86a4-403c-9dac-06c68368d6dd for instance with vm_state active and task_state resize_finish.
Aug 01 15:31:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:31:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:15 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903860.578051, bd70360d-30b8-47d5-b35e-adf0d28482dd => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:31:15 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] VM Stopped (Lifecycle Event)
Aug 01 15:31:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:15 user nova-compute[72201]: DEBUG nova.compute.manager [None req-73584fcc-8ee8-4921-b4fe-4fb3967f62ea None None] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:31:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:31:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903876.742185, bd70360d-30b8-47d5-b35e-adf0d28482dd => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:31:16 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] VM Resumed (Lifecycle Event)
Aug 01 15:31:16 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:31:16 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Instance running successfully.
Aug 01 15:31:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Failed to set time: agent not configured {{(pid=72201) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ad7a90a2-0f56-4b30-8f21-9f9fc46c6c6b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] finish_migration finished successfully. {{(pid=72201) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:16 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 15:31:16 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903876.7460809, bd70360d-30b8-47d5-b35e-adf0d28482dd => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:31:16 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] VM Started (Lifecycle Event)
Aug 01 15:31:16 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:31:16 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 15:31:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-c9367434-ac05-44b7-8b68-62b95b53e095 req-51f54a78-df28-4c66-b976-5238d699b31f service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Received event network-vif-plugged-9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c9367434-ac05-44b7-8b68-62b95b53e095 req-51f54a78-df28-4c66-b976-5238d699b31f service nova] Acquiring lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c9367434-ac05-44b7-8b68-62b95b53e095 req-51f54a78-df28-4c66-b976-5238d699b31f service nova] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c9367434-ac05-44b7-8b68-62b95b53e095 req-51f54a78-df28-4c66-b976-5238d699b31f service nova] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-c9367434-ac05-44b7-8b68-62b95b53e095 req-51f54a78-df28-4c66-b976-5238d699b31f service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] No waiting events found dispatching network-vif-plugged-9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:31:16 user nova-compute[72201]: WARNING nova.compute.manager [req-c9367434-ac05-44b7-8b68-62b95b53e095 req-51f54a78-df28-4c66-b976-5238d699b31f service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Received unexpected event network-vif-plugged-9640f8a6-86a4-403c-9dac-06c68368d6dd for instance with vm_state active and task_state resize_finish.
Aug 01 15:31:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:17 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:31:17 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:31:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=6490MB free_disk=25.03994369506836GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Applying migration context for instance bd70360d-30b8-47d5-b35e-adf0d28482dd as it has an incoming, in-progress migration 39d76218-a07b-4517-b132-4e3fb4484638. Migration status is finished {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 15:31:17 user nova-compute[72201]: INFO nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Updating resource usage from migration 39d76218-a07b-4517-b132-4e3fb4484638
Aug 01 15:31:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance b64f1cfb-64f2-4493-8721-fc63fcd93bb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e2ca19ea-868c-40ad-a453-f6e348cfac15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 0f059ccc-f609-4cf3-a644-c3d1305ae26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 865b371c-59c5-4004-8469-cdc1e9327ecb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 14e890ca-dc2a-4d89-a497-d55805d0c42e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 4d307a58-226b-40dd-a548-e854cf761f57 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 9530577b-69a6-45bc-a33b-1dc60d69a16f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance ed5f91f1-b3fd-4737-8ed6-fca13617bd6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 9e946b4a-9b93-459f-8e5e-d88612c4ec34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance a90b8dec-8529-4658-bf18-c5047c17c329 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 79c02f2d-a143-4522-9054-369da11b54ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Migration 39d76218-a07b-4517-b132-4e3fb4484638 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance bd70360d-30b8-47d5-b35e-adf0d28482dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=10240MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:31:17 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing inventories for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 15:31:18 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating ProviderTree inventory for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 15:31:18 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating inventory in ProviderTree for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 15:31:18 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing aggregate associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, aggregates: None {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 15:31:18 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing trait associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 15:31:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:18 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:31:18 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:31:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:31:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.855s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:18 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:31:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 15:31:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] There are 0 instances to clean {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 15:31:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-3740e287-2bcd-4e20-83aa-1edd3de7adce req-e1d0dc11-256b-4c8d-8289-09f38ece07c9 service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Received event network-changed-90984cd0-4fa8-4f64-bcdb-f3551a73d91b {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:31:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-3740e287-2bcd-4e20-83aa-1edd3de7adce req-e1d0dc11-256b-4c8d-8289-09f38ece07c9 service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Refreshing instance network info cache due to event network-changed-90984cd0-4fa8-4f64-bcdb-f3551a73d91b. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:31:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3740e287-2bcd-4e20-83aa-1edd3de7adce req-e1d0dc11-256b-4c8d-8289-09f38ece07c9 service nova] Acquiring lock "refresh_cache-2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:31:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3740e287-2bcd-4e20-83aa-1edd3de7adce req-e1d0dc11-256b-4c8d-8289-09f38ece07c9 service nova] Acquired lock "refresh_cache-2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:31:25 user nova-compute[72201]: DEBUG nova.network.neutron [req-3740e287-2bcd-4e20-83aa-1edd3de7adce req-e1d0dc11-256b-4c8d-8289-09f38ece07c9 service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Refreshing network info cache for port 90984cd0-4fa8-4f64-bcdb-f3551a73d91b {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG nova.network.neutron [req-3740e287-2bcd-4e20-83aa-1edd3de7adce req-e1d0dc11-256b-4c8d-8289-09f38ece07c9 service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Updated VIF entry in instance network info cache for port 90984cd0-4fa8-4f64-bcdb-f3551a73d91b. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG nova.network.neutron [req-3740e287-2bcd-4e20-83aa-1edd3de7adce req-e1d0dc11-256b-4c8d-8289-09f38ece07c9 service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Updating instance_info_cache with network_info: [{"id": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "address": "fa:16:3e:e5:db:9d", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90984cd0-4f", "ovs_interfaceid": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG nova.objects.instance [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lazy-loading 'flavor' on Instance uuid 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3740e287-2bcd-4e20-83aa-1edd3de7adce req-e1d0dc11-256b-4c8d-8289-09f38ece07c9 service nova] Releasing lock "refresh_cache-2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:26 user nova-compute[72201]: INFO nova.compute.manager [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Attaching volume e3cb651d-3535-48ac-97db-d6d27f42caf9 to /dev/vdb
Aug 01 15:31:26 user nova-compute[72201]: DEBUG os_brick.utils [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf87d5a-59b2-48a8-908d-9f857a448b14]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb0dcae-fa44-4c2d-aacc-4f6bc0bb0ad6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c720707-5699-41e2-b933-a53388f04813]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a6d4ee-b7ab-4247-9548-cc035a47e746]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:31:26 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:31:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f0a725-dbd6-43c8-85f2-3c0c85b96ece]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG os_brick.utils [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:31:26 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Updating existing volume attachment record: b13076f4-e8a7-4c35-acbf-fa900af20bbd {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:31:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "4d307a58-226b-40dd-a548-e854cf761f57" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "4d307a58-226b-40dd-a548-e854cf761f57" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "4d307a58-226b-40dd-a548-e854cf761f57-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:29 user nova-compute[72201]: INFO nova.compute.manager [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Terminating instance
Aug 01 15:31:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:31:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-a58c6ee7-57a6-455c-9e6d-83730b3127e5 req-2eafe9b0-3e6f-425b-b522-d6d0ccca96db service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received event network-vif-unplugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:31:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a58c6ee7-57a6-455c-9e6d-83730b3127e5 req-2eafe9b0-3e6f-425b-b522-d6d0ccca96db service nova] Acquiring lock "4d307a58-226b-40dd-a548-e854cf761f57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a58c6ee7-57a6-455c-9e6d-83730b3127e5 req-2eafe9b0-3e6f-425b-b522-d6d0ccca96db service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a58c6ee7-57a6-455c-9e6d-83730b3127e5 req-2eafe9b0-3e6f-425b-b522-d6d0ccca96db service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-a58c6ee7-57a6-455c-9e6d-83730b3127e5 req-2eafe9b0-3e6f-425b-b522-d6d0ccca96db service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] No waiting events found dispatching network-vif-unplugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:31:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-a58c6ee7-57a6-455c-9e6d-83730b3127e5 req-2eafe9b0-3e6f-425b-b522-d6d0ccca96db service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received event network-vif-unplugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:31:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:29 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Instance destroyed successfully.
Aug 01 15:31:29 user nova-compute[72201]: DEBUG nova.objects.instance [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lazy-loading 'resources' on Instance uuid 4d307a58-226b-40dd-a548-e854cf761f57 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T15:27:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1642919789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1833175817',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqQ3JyX5grzt34vgysHqxBFLfCGjR43NVcbWJ9AgvjUJAkeBHgFdLOk4UNppE+XbYa1pHxYkJwB0eE/x04yybsP4ZAiP/yhpagpnjq+IWr2x3Qlg+8KzJgt+RkxU443Og==',key_name='tempest-keypair-714015429',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:30:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0a434898181465ea2df89c7b1e42597',ramdisk_id='',reservation_id='r-0et8cou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1609612653',owner_user_name='tempest-ServerActionsV293TestJSON-1609612653-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32967fa82739495685f336d7ace68000',uuid=4d307a58-226b-40dd-a548-e854cf761f57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "address": "fa:16:3e:ad:58:90", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb5fe53-25", "ovs_interfaceid": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Converting VIF {"id": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "address": "fa:16:3e:ad:58:90", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb5fe53-25", "ovs_interfaceid": "1eb5fe53-2534-45e8-a39b-1eebaa30159a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:58:90,bridge_name='br-int',has_traffic_filtering=True,id=1eb5fe53-2534-45e8-a39b-1eebaa30159a,network=Network(968d4faa-613e-4954-86cc-3df6b86a2491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb5fe53-25') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG os_vif [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:58:90,bridge_name='br-int',has_traffic_filtering=True,id=1eb5fe53-2534-45e8-a39b-1eebaa30159a,network=Network(968d4faa-613e-4954-86cc-3df6b86a2491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb5fe53-25') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1eb5fe53-25, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:31:30 user nova-compute[72201]: INFO os_vif [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:58:90,bridge_name='br-int',has_traffic_filtering=True,id=1eb5fe53-2534-45e8-a39b-1eebaa30159a,network=Network(968d4faa-613e-4954-86cc-3df6b86a2491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb5fe53-25')
Aug 01 15:31:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkrBcZdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:31:30 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:31:30 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43c3474-c1b3-4627-aae3-e4f046b6ca47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[be26133f-94b0-4090-b2c9-f6fbaeb1759d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:31:30 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:30 user nova-compute[72201]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:31:30 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:30 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:31:30 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:31:30 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:30 user nova-compute[72201]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 (non-flash)
Aug 01 15:31:30 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:30 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:31:30 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c65f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926'): ({'sde'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Removing single pathed devices sde {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c343ab9-8f3b-4069-a16e-0e2a3b9cb53d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5564db7-b2c8-47bc-97cc-0679124ac98b]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Flushing IO for device /dev/sde {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b953acea-1c66-4bb5-b17e-4ae1c69e46b8]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b257e014-7a0c-4739-90f1-fb6c222af3a5]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] SCSI volumes sde have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23030386464363935', '/dev/disk/by-id/scsi-1SCST_BIO48e81c59-008dd695abf45332', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_48e81c59') {{(pid=83290) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 15:31:30 user nova-compute[72201]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23030386464363935
Aug 01 15:31:30 user nova-compute[72201]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO48e81c59-008dd695abf45332
Aug 01 15:31:30 user nova-compute[72201]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_48e81c59
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dee512-cb6a-4ef2-9979-b43dbb2b1c9d]: (4, None) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb897c7e-e044-403a-a0f8-3a212f7974cc]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbf4d16-35ec-4bde-8c55-87e93b99a863]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926, portal: 172.16.0.220,3260]
Aug 01 15:31:30 user nova-compute[72201]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926, portal: 172.16.0.220,3260] successful.
Aug 01 15:31:30 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:002775d0-efbb-42ab-aa46-9e065adaa926 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ca84d5-c3e8-4ad2-8138-c376c9667246]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] <== disconnect_volume: return (312ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:31:30 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Deleting instance files /opt/stack/data/nova/instances/4d307a58-226b-40dd-a548-e854cf761f57_del
Aug 01 15:31:30 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Deletion of /opt/stack/data/nova/instances/4d307a58-226b-40dd-a548-e854cf761f57_del complete
Aug 01 15:31:30 user nova-compute[72201]: INFO nova.compute.manager [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 01 15:31:30 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:31:30 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:31:31 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:31:31 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Took 1.00 seconds to deallocate network for instance.
Aug 01 15:31:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-99c03a8b-5d5e-4537-8077-b78d0c0d6802 req-b1f07dbb-93b9-42eb-80fc-3f070cf2e29e service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received event network-vif-deleted-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:31:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-8936f290-1385-4498-a7cd-333e8d0599ec req-c068b5b9-90d4-46d4-a34e-bc09084bb58e service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received event network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:31:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8936f290-1385-4498-a7cd-333e8d0599ec req-c068b5b9-90d4-46d4-a34e-bc09084bb58e service nova] Acquiring lock "4d307a58-226b-40dd-a548-e854cf761f57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8936f290-1385-4498-a7cd-333e8d0599ec req-c068b5b9-90d4-46d4-a34e-bc09084bb58e service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8936f290-1385-4498-a7cd-333e8d0599ec req-c068b5b9-90d4-46d4-a34e-bc09084bb58e service nova] Lock "4d307a58-226b-40dd-a548-e854cf761f57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-8936f290-1385-4498-a7cd-333e8d0599ec req-c068b5b9-90d4-46d4-a34e-bc09084bb58e service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] No waiting events found dispatching network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:31:31 user nova-compute[72201]: WARNING nova.compute.manager [req-8936f290-1385-4498-a7cd-333e8d0599ec req-c068b5b9-90d4-46d4-a34e-bc09084bb58e service nova] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Received unexpected event network-vif-plugged-1eb5fe53-2534-45e8-a39b-1eebaa30159a for instance with vm_state active and task_state deleting.
Aug 01 15:31:32 user nova-compute[72201]: INFO nova.compute.manager [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Took 0.79 seconds to detach 1 volumes for instance.
Aug 01 15:31:32 user nova-compute[72201]: DEBUG nova.compute.manager [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Deleting volume: 002775d0-efbb-42ab-aa46-9e065adaa926 {{(pid=72201) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 15:31:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:32 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:31:32 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:31:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.480s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:32 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Deleted allocations for instance 4d307a58-226b-40dd-a548-e854cf761f57
Aug 01 15:31:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5e72e3cc-ae20-4a85-be56-bbb59ba81573 tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "4d307a58-226b-40dd-a548-e854cf761f57" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.796s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vEawomRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:31:34 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:31:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:31:34 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:31:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:31:34 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3103b38-37f8-496f-a730-f95a58a121e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:31:34 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1144163-55de-4789-a3ee-d478e337d4cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9] added
Aug 01 15:31:34 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[15243af5-22e4-48c6-8602-cbdcf1d4c46e]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c11c57d-a9b7-43f9-8bd4-e6275ed1ea7a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vEawomRs {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vEawomRs" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06920be-a7c2-422a-8fc9-ce132a454260]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vEawomRs'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.060s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3663924b-b17b-4910-b18d-337bd27e86a8]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0adf3dc-13f2-42b7-a946-ce28a11becb2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:31:34 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:34 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:34 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:31:34 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:31:34 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:34 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:34 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:31:34 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38391e9-bcc3-4b1a-a014-fb58ae085192]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9, portal: 172.16.0.220,3260]
Aug 01 15:31:34 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9, portal: 172.16.0.220,3260] successful.
Aug 01 15:31:34 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[779ac876-8e86-4ab7-945b-56a5d8c1df02]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e852511d-0fec-4781-9c96-14af1051f862]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:31:34 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:34 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:34 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:31:34 user nova-compute[72201]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 (non-flash)
Aug 01 15:31:34 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:31:34 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:34 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:34 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:31:34 user nova-compute[72201]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 (non-flash)
Aug 01 15:31:34 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:31:34 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:31:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:35 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4add7b82-8274-4f8e-b69a-227c62531e67]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:35 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:31:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vEawomRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:31:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:36 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:31:36 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '26632396263343464', 'path': '/dev/sde'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:31:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632396263343464', 'path': '/dev/sde'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:31:36 user nova-compute[72201]: DEBUG nova.objects.instance [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lazy-loading 'flavor' on Instance uuid 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:31:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:31:36 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:31:36 user nova-compute[72201]:   <source dev="/dev/sde"/>
Aug 01 15:31:36 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:31:36 user nova-compute[72201]:   <serial>e3cb651d-3535-48ac-97db-d6d27f42caf9</serial>
Aug 01 15:31:36 user nova-compute[72201]: </disk>
Aug 01 15:31:36 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:31:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:31:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:31:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] No VIF found with MAC fa:16:3e:e5:db:9d, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:31:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-309820d4-f661-4cd4-b24d-ac73740c22a1 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.286s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:38 user nova-compute[72201]: INFO nova.compute.manager [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Detaching volume e3cb651d-3535-48ac-97db-d6d27f42caf9
Aug 01 15:31:38 user nova-compute[72201]: INFO nova.virt.block_device [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Attempting to driver detach volume e3cb651d-3535-48ac-97db-d6d27f42caf9 from mountpoint /dev/vdb
Aug 01 15:31:38 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Attempting to detach device vdb from instance 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:31:38 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:31:38 user nova-compute[72201]:   <source dev="/dev/sde"/>
Aug 01 15:31:38 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:31:38 user nova-compute[72201]:   <serial>e3cb651d-3535-48ac-97db-d6d27f42caf9</serial>
Aug 01 15:31:38 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:31:38 user nova-compute[72201]: </disk>
Aug 01 15:31:38 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:31:38 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Successfully detached device vdb from instance 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2 from the persistent domain config.
Aug 01 15:31:38 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:31:38 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:31:38 user nova-compute[72201]:   <source dev="/dev/sde"/>
Aug 01 15:31:38 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:31:38 user nova-compute[72201]:   <serial>e3cb651d-3535-48ac-97db-d6d27f42caf9</serial>
Aug 01 15:31:38 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:31:38 user nova-compute[72201]: </disk>
Aug 01 15:31:38 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690903898.8476458, 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:31:38 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Successfully detached device vdb from instance 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2 from the live domain config.
Aug 01 15:31:38 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vEawomRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:31:38 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:31:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[627244c3-a76b-481f-bd79-70a36ed29504]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80b4c7d-ba6b-4683-9bd1-39abb599dfed]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:31:38 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:38 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:38 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:31:38 user nova-compute[72201]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 (non-flash)
Aug 01 15:31:38 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:31:38 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:38 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:38 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:31:38 user nova-compute[72201]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 (non-flash)
Aug 01 15:31:38 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc54428e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9'): ({'sde'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Removing single pathed devices sde {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11b4d72-3a27-42ff-a776-ec8437b871fd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c5c912-4b92-4f0d-a0cf-7504e56c212f]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Flushing IO for device /dev/sde {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b482ed7-7c3e-4763-849d-49c3a9dfb8bf]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:31:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:39 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3151de66-c5b5-4926-bc1c-da50d8de89ff]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:39 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:31:39 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] SCSI volumes sde have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:31:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:31:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:39 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0b07e3-de43-492c-a4de-fdaa46b28bf9]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:39 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9ad4fa-72bc-4c2b-9370-0d067bdb1675]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9, portal: 172.16.0.220,3260]
Aug 01 15:31:39 user nova-compute[72201]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9, portal: 172.16.0.220,3260] successful.
Aug 01 15:31:39 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3cb651d-3535-48ac-97db-d6d27f42caf9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:39 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fd96d1-a4ff-4056-8719-7e435ed29670]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:31:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] <== disconnect_volume: return (297ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:31:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:31:40 user nova-compute[72201]: DEBUG nova.objects.instance [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lazy-loading 'flavor' on Instance uuid 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:31:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0d4c636c-bc80-42dc-9c5c-09a044ad590c tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.813s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:41 user nova-compute[72201]: INFO nova.compute.manager [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Detaching volume 8f263670-c9fb-4506-980a-810ff56314a0
Aug 01 15:31:41 user nova-compute[72201]: INFO nova.virt.block_device [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Attempting to driver detach volume 8f263670-c9fb-4506-980a-810ff56314a0 from mountpoint /dev/vdb
Aug 01 15:31:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Attempting to detach device vdb from instance 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:31:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:31:41 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:31:41 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 15:31:41 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:31:41 user nova-compute[72201]:   <serial>8f263670-c9fb-4506-980a-810ff56314a0</serial>
Aug 01 15:31:41 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:31:41 user nova-compute[72201]: </disk>
Aug 01 15:31:41 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:31:41 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Successfully detached device vdb from instance 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 from the persistent domain config.
Aug 01 15:31:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:31:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:31:41 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:31:41 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 15:31:41 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:31:41 user nova-compute[72201]:   <serial>8f263670-c9fb-4506-980a-810ff56314a0</serial>
Aug 01 15:31:41 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:31:41 user nova-compute[72201]: </disk>
Aug 01 15:31:41 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:31:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690903901.9917665, 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:31:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:31:41 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Successfully detached device vdb from instance 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 from the live domain config.
Aug 01 15:31:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLisTgOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:31:42 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:31:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2591c96f-a858-43b5-93d4-12ee205261d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[30154027-e455-42a5-be8d-88a9ebc2b412]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:31:42 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:42 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:42 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:31:42 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 (non-flash)
Aug 01 15:31:42 user nova-compute[72201]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:42 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:42 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:31:42 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5442191b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0'): ({'sdc'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Removing single pathed devices sdc {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c13d0e-4742-49d9-aa5c-19f39b1bfcb5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[568bae1a-f83d-4d36-a832-b9f409e14bb7]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Flushing IO for device /dev/sdc {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6433b27-cfdb-4a78-be7e-56c47aed5abd]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2ef2b3-3ae1-46a5-a744-07fb8a317cf4]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[65aedeb4-c03f-4cae-abf5-4d97b550e946]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[955931f2-f8be-43ee-8af9-cab77b9cd048]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0, portal: 172.16.0.220,3260]
Aug 01 15:31:42 user nova-compute[72201]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0, portal: 172.16.0.220,3260] successful.
Aug 01 15:31:42 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f263670-c9fb-4506-980a-810ff56314a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca27c367-19d2-4eb0-9cf5-f3d76c932180]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] <== disconnect_volume: return (298ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:31:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG nova.objects.instance [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lazy-loading 'flavor' on Instance uuid 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-531552b9-b271-4d59-8244-b29a4103b0ad tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.705s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "9530577b-69a6-45bc-a33b-1dc60d69a16f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lazy-loading 'flavor' on Instance uuid 9530577b-69a6-45bc-a33b-1dc60d69a16f {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "9530577b-69a6-45bc-a33b-1dc60d69a16f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:43 user nova-compute[72201]: INFO nova.compute.manager [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Attaching volume eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 to /dev/vdb
Aug 01 15:31:43 user nova-compute[72201]: DEBUG os_brick.utils [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d26e575-d8fd-4d4c-b32f-f90e80588ef7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8164dbf8-f460-4184-9f8a-27eea9baec53]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5bfcaf-1464-480a-abb9-600b743c780c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61b208c-bed3-4645-b0d2-759a79e90c4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:31:43 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:31:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[32788806-f1d7-4e74-a067-9fdd1bf9a421]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG os_brick.utils [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Updating existing volume attachment record: e852cf5c-dd39-46a4-804e-3cf389ce4d2d {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:31:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:44 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903889.980741, 4d307a58-226b-40dd-a548-e854cf761f57 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:31:44 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] VM Stopped (Lifecycle Event)
Aug 01 15:31:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-525f1299-d24b-49dc-ba2f-43267c9da26b None None] [instance: 4d307a58-226b-40dd-a548-e854cf761f57] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:31:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:31:50 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwmPABNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:31:50 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:31:50 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:31:50 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:31:50 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:31:50 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:31:50 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:31:50 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:31:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:50 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bdac23-aed4-458c-8ecb-6e52ff09ad8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:50 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:31:50 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0daa9e-0a97-473c-a8bd-5244a0387991]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7] added
Aug 01 15:31:51 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[339af16c-f563-499b-b343-a93ca984b0bf]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9d92dd-9eb0-49f4-858d-0420141151f3]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwmPABNE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwmPABNE" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebfbf5c-a74d-4fdb-83fd-81a37538fe28]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jwmPABNE'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a9d388-9c6c-40a3-aa7a-4053edc88246]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG nova.compute.manager [req-edd4a03b-aecc-4db2-abc5-6ab56e9a98f6 req-a779ab70-4ca6-464f-99f8-6d677df9cdb9 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Received event network-changed-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG nova.compute.manager [req-edd4a03b-aecc-4db2-abc5-6ab56e9a98f6 req-a779ab70-4ca6-464f-99f8-6d677df9cdb9 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Refreshing instance network info cache due to event network-changed-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-edd4a03b-aecc-4db2-abc5-6ab56e9a98f6 req-a779ab70-4ca6-464f-99f8-6d677df9cdb9 service nova] Acquiring lock "refresh_cache-eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-edd4a03b-aecc-4db2-abc5-6ab56e9a98f6 req-a779ab70-4ca6-464f-99f8-6d677df9cdb9 service nova] Acquired lock "refresh_cache-eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG nova.network.neutron [req-edd4a03b-aecc-4db2-abc5-6ab56e9a98f6 req-a779ab70-4ca6-464f-99f8-6d677df9cdb9 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Refreshing network info cache for port 001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3fe3ff-cde1-4f83-acf3-9d4e82617c8c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:51 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:51 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:31:51 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:51 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:51 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:31:51 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7abb6e-57d4-4d79-b480-40ce9e764a40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260]
Aug 01 15:31:51 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260] successful.
Aug 01 15:31:51 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dabf6ce-9943-4317-a156-edd9bd28d265]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa730023-8361-48d2-9e46-5c5ac217bf45]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:51 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:51 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:31:51 user nova-compute[72201]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:31:51 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:51 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:51 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:31:51 user nova-compute[72201]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:31:51 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3c4049-972a-43bc-b281-4cef741b7f5a]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwmPABNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG nova.network.neutron [req-edd4a03b-aecc-4db2-abc5-6ab56e9a98f6 req-a779ab70-4ca6-464f-99f8-6d677df9cdb9 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Updated VIF entry in instance network info cache for port 001b32aa-da69-4d16-8f4c-ab2a0a5b91d8. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG nova.network.neutron [req-edd4a03b-aecc-4db2-abc5-6ab56e9a98f6 req-a779ab70-4ca6-464f-99f8-6d677df9cdb9 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Updating instance_info_cache with network_info: [{"id": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "address": "fa:16:3e:b2:68:3a", "network": {"id": "0a5cd34a-6838-4b6e-b44b-5d561a6a1573", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-719005822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fa68dc043d456f85c918466114934f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001b32aa-da", "ovs_interfaceid": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-edd4a03b-aecc-4db2-abc5-6ab56e9a98f6 req-a779ab70-4ca6-464f-99f8-6d677df9cdb9 service nova] Releasing lock "refresh_cache-eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquiring lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG nova.objects.instance [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lazy-loading 'flavor' on Instance uuid eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquiring lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:51 user nova-compute[72201]: INFO nova.compute.manager [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Attaching volume 427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 to /dev/vdb
Aug 01 15:31:51 user nova-compute[72201]: DEBUG os_brick.utils [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f563ca0-1703-4f78-b31f-893a9b51f3bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf201aa-bef3-4e60-8833-1104ddc2e5e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[211db9fc-47b8-4762-9c17-5361fab2fcc5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd93d862-d7b2-47a6-b736-83bbbdadabb2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:31:52 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:31:52 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6562e9f4-8cf9-4c81-8fd9-594e3c04019b]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG os_brick.utils [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Updating existing volume attachment record: 8740ac3d-4609-4127-ab81-0f579dc2538d {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26233306335393138', 'path': '/dev/sdc'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233306335393138', 'path': '/dev/sdc'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lazy-loading 'flavor' on Instance uuid 9530577b-69a6-45bc-a33b-1dc60d69a16f {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:31:52 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:31:52 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 15:31:52 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:31:52 user nova-compute[72201]:   <serial>eaeddea5-fbb6-4b61-9a48-07c49f1b82b7</serial>
Aug 01 15:31:52 user nova-compute[72201]: </disk>
Aug 01 15:31:52 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] No VIF found with MAC fa:16:3e:78:0d:a8, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:31:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ba500e55-b360-4576-9686-0a9f669d4b5d tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.424s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Stashing vm_state: active {{(pid=72201) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 01 15:31:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:54 user nova-compute[72201]: DEBUG nova.objects.instance [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lazy-loading 'pci_requests' on Instance uuid 9530577b-69a6-45bc-a33b-1dc60d69a16f {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:31:54 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:31:54 user nova-compute[72201]: INFO nova.compute.claims [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Claim successful on node user
Aug 01 15:31:54 user nova-compute[72201]: DEBUG nova.objects.instance [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lazy-loading 'resources' on Instance uuid 9530577b-69a6-45bc-a33b-1dc60d69a16f {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:31:54 user nova-compute[72201]: DEBUG nova.objects.instance [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lazy-loading 'pci_devices' on Instance uuid 9530577b-69a6-45bc-a33b-1dc60d69a16f {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:31:54 user nova-compute[72201]: INFO nova.compute.resource_tracker [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Updating resource usage from migration 7d266d84-6760-4fef-9ee0-849b99a23ad5
Aug 01 15:31:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:55 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:31:55 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:31:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.622s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:55 user nova-compute[72201]: INFO nova.compute.manager [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Migrating
Aug 01 15:31:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:31:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquired lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:31:55 user nova-compute[72201]: DEBUG nova.network.neutron [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:31:55 user nova-compute[72201]: DEBUG nova.network.neutron [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Updating instance_info_cache with network_info: [{"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:31:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Releasing lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:31:55 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Starting migrate_disk_and_power_off {{(pid=72201) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-c3bbba68-45ec-4061-a5fc-8d4d3fb535a4 req-dc59e753-adaa-4b02-9631-d5b9df5aedbb service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received event network-vif-unplugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c3bbba68-45ec-4061-a5fc-8d4d3fb535a4 req-dc59e753-adaa-4b02-9631-d5b9df5aedbb service nova] Acquiring lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c3bbba68-45ec-4061-a5fc-8d4d3fb535a4 req-dc59e753-adaa-4b02-9631-d5b9df5aedbb service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c3bbba68-45ec-4061-a5fc-8d4d3fb535a4 req-dc59e753-adaa-4b02-9631-d5b9df5aedbb service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-c3bbba68-45ec-4061-a5fc-8d4d3fb535a4 req-dc59e753-adaa-4b02-9631-d5b9df5aedbb service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] No waiting events found dispatching network-vif-unplugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:31:56 user nova-compute[72201]: WARNING nova.compute.manager [req-c3bbba68-45ec-4061-a5fc-8d4d3fb535a4 req-dc59e753-adaa-4b02-9631-d5b9df5aedbb service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received unexpected event network-vif-unplugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f for instance with vm_state active and task_state resize_migrating.
Aug 01 15:31:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:56 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Instance destroyed successfully.
Aug 01 15:31:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:27:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1658925189',display_name='tempest-ServerActionsTestOtherB-server-1658925189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1658925189',id=23,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJArwB9vrejGtK4OyRlF/OPoTmPfhsQE57Hge1qGzDjlRPweDSIgEPC9CjlFjLzOgL7v2M+GdTat2K+6ohuaRgnBN7sGvF/1T+/fwnocb98Oa2hVXX8HgqjMMybuv12ZQ==',key_name='tempest-keypair-162505840',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:28:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a7d07e2a1943449baeb9ca49a3d1326f',ramdisk_id='',reservation_id='r-0d5v5zbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2096061393',owner_user_name='tempest-ServerActionsTestOtherB-2096061393-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:31:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa902dd334b04d4cbf0ee4eb1eb582ff',uuid=9530577b-69a6-45bc-a33b-1dc60d69a16f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-988219649-network", "vif_mac": "fa:16:3e:78:0d:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Converting VIF {"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-988219649-network", "vif_mac": "fa:16:3e:78:0d:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:0d:a8,bridge_name='br-int',has_traffic_filtering=True,id=2cccc4c0-1ece-49a9-9e19-065c8fe55d9f,network=Network(bbd9214a-e302-4a4a-9395-f3e70e0cc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cccc4c0-1e') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG os_vif [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:0d:a8,bridge_name='br-int',has_traffic_filtering=True,id=2cccc4c0-1ece-49a9-9e19-065c8fe55d9f,network=Network(bbd9214a-e302-4a4a-9395-f3e70e0cc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cccc4c0-1e') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cccc4c0-1e, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:56 user nova-compute[72201]: INFO os_vif [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:0d:a8,bridge_name='br-int',has_traffic_filtering=True,id=2cccc4c0-1ece-49a9-9e19-065c8fe55d9f,network=Network(bbd9214a-e302-4a4a-9395-f3e70e0cc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cccc4c0-1e')
Aug 01 15:31:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwmPABNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:31:56 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:31:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e28faa-33d0-473f-8acd-bc83bbec6ef9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[92617877-52c9-4bb1-b6b8-f46f13f30997]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:56 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:56 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:31:56 user nova-compute[72201]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:31:56 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:31:56 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:31:56 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:31:56 user nova-compute[72201]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:31:56 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc52c701c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7'): ({'sdc'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Removing single pathed devices sdc {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a229552f-5758-49cb-8388-03987c93dc2d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd1cf4b-4051-49b2-85b7-6c66b824bceb]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Flushing IO for device /dev/sdc {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7734d6b7-d5c4-4d65-b75f-a3025e5ae095]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[14067aa9-d327-4260-ab13-1b46f2ddf97f]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2350e8-2c34-4224-9420-1cd9815992df]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8516a033-4334-402d-a436-247b1a006875]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260]
Aug 01 15:31:57 user nova-compute[72201]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260] successful.
Aug 01 15:31:57 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e998a0-a91d-44e5-ba2b-7ab27196e377]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:31:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:31:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] <== disconnect_volume: return (293ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:31:57 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:31:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:57 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:31:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f_resize/disk /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] CMD "cp -r /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f_resize/disk /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk" returned: 0 in 0.309s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f_resize/disk.info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk.info {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] CMD "cp -r /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f_resize/disk.info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk.info" returned: 0 in 0.034s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:58 user nova-compute[72201]: DEBUG nova.compute.manager [req-77a7ee96-d006-45b2-8ebd-03a1c0bc113a req-e5114e5b-7eac-4ec2-8247-28dd97f36020 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received event network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:31:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-77a7ee96-d006-45b2-8ebd-03a1c0bc113a req-e5114e5b-7eac-4ec2-8247-28dd97f36020 service nova] Acquiring lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-77a7ee96-d006-45b2-8ebd-03a1c0bc113a req-e5114e5b-7eac-4ec2-8247-28dd97f36020 service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-77a7ee96-d006-45b2-8ebd-03a1c0bc113a req-e5114e5b-7eac-4ec2-8247-28dd97f36020 service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:58 user nova-compute[72201]: DEBUG nova.compute.manager [req-77a7ee96-d006-45b2-8ebd-03a1c0bc113a req-e5114e5b-7eac-4ec2-8247-28dd97f36020 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] No waiting events found dispatching network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:31:58 user nova-compute[72201]: WARNING nova.compute.manager [req-77a7ee96-d006-45b2-8ebd-03a1c0bc113a req-e5114e5b-7eac-4ec2-8247-28dd97f36020 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received unexpected event network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f for instance with vm_state active and task_state resize_migrating.
Aug 01 15:31:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:31:58 user nova-compute[72201]: DEBUG nova.network.neutron [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Port 2cccc4c0-1ece-49a9-9e19-065c8fe55d9f binding to destination host user is already ACTIVE {{(pid=72201) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 15:31:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:31:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:31:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:31:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:31:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquired lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:31:58 user nova-compute[72201]: DEBUG nova.network.neutron [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG nova.network.neutron [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Updating instance_info_cache with network_info: [{"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Releasing lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG os_brick.utils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c6d0bd-6a75-42bc-94a1-b801560a0d4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4a235d-90ae-414c-9a15-384976b52bea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed11bc3-9514-4a92-9ec9-3dfa79444fbb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76a7a29-9277-4ae3-81e0-132a73225c8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:31:59 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:31:59 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[106331a6-c252-442a-a1b5-f2c07c737276]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:31:59 user nova-compute[72201]: DEBUG os_brick.utils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JwCIDdut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:32:00 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:32:00 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:32:00 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fdf2ed-9112-4eed-b28e-58c3ce98df04]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:32:00 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c261c55-b1c8-4865-836d-e3c610891fca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9] added
Aug 01 15:32:00 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[93988c1d-b387-4d50-a78e-733802733a05]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[392f54fe-fbb7-4c4d-9b37-93afae7ff2c8]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JwCIDdut {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JwCIDdut" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc61390b-f7cc-4a9a-8f3c-dbf8a0370235]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JwCIDdut'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b505d0e5-0c42-4432-89ae-194c6a459594]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7b58b5-197e-4fe6-a400-39a31b26ed00]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:32:00 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:00 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:00 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:32:00 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:00 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:00 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ab411d-7b30-4eed-8b7f-d6b4f7977d12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9, portal: 172.16.0.220,3260]
Aug 01 15:32:00 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9, portal: 172.16.0.220,3260] successful.
Aug 01 15:32:00 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cede07b-3224-445a-a54a-f2ae09d1633a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8862c208-5809-4511-9c90-2c94c23c5bfe]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:32:00 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:00 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:00 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:00 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:32:00 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:00 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:00 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:00 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[966fb4b0-58da-4b7f-8620-e19418d70626]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:32:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JwCIDdut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:32:01 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:32:01 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23137643437613039', 'path': '/dev/sdc'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:32:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137643437613039', 'path': '/dev/sdc'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:32:01 user nova-compute[72201]: DEBUG nova.objects.instance [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lazy-loading 'flavor' on Instance uuid eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:32:01 user nova-compute[72201]: DEBUG nova.compute.manager [req-84a23da3-ef15-4314-a23d-0c42a61fb5d2 req-d40adf9a-443d-41fa-84d7-527f5bb8044c service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Received event network-changed-14be95c0-4142-4241-89d8-2a084782c959 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:32:01 user nova-compute[72201]: DEBUG nova.compute.manager [req-84a23da3-ef15-4314-a23d-0c42a61fb5d2 req-d40adf9a-443d-41fa-84d7-527f5bb8044c service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Refreshing instance network info cache due to event network-changed-14be95c0-4142-4241-89d8-2a084782c959. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:32:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-84a23da3-ef15-4314-a23d-0c42a61fb5d2 req-d40adf9a-443d-41fa-84d7-527f5bb8044c service nova] Acquiring lock "refresh_cache-a90b8dec-8529-4658-bf18-c5047c17c329" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:32:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-84a23da3-ef15-4314-a23d-0c42a61fb5d2 req-d40adf9a-443d-41fa-84d7-527f5bb8044c service nova] Acquired lock "refresh_cache-a90b8dec-8529-4658-bf18-c5047c17c329" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:32:01 user nova-compute[72201]: DEBUG nova.network.neutron [req-84a23da3-ef15-4314-a23d-0c42a61fb5d2 req-d40adf9a-443d-41fa-84d7-527f5bb8044c service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Refreshing network info cache for port 14be95c0-4142-4241-89d8-2a084782c959 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:32:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:32:01 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:32:01 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 15:32:01 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:32:01 user nova-compute[72201]:   <serial>427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9</serial>
Aug 01 15:32:01 user nova-compute[72201]: </disk>
Aug 01 15:32:01 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:32:02 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:32:02 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:32:02 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] No VIF found with MAC fa:16:3e:b2:68:3a, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:32:02 user nova-compute[72201]: DEBUG nova.network.neutron [req-84a23da3-ef15-4314-a23d-0c42a61fb5d2 req-d40adf9a-443d-41fa-84d7-527f5bb8044c service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Updated VIF entry in instance network info cache for port 14be95c0-4142-4241-89d8-2a084782c959. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:32:02 user nova-compute[72201]: DEBUG nova.network.neutron [req-84a23da3-ef15-4314-a23d-0c42a61fb5d2 req-d40adf9a-443d-41fa-84d7-527f5bb8044c service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Updating instance_info_cache with network_info: [{"id": "14be95c0-4142-4241-89d8-2a084782c959", "address": "fa:16:3e:b5:d0:21", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14be95c0-41", "ovs_interfaceid": "14be95c0-4142-4241-89d8-2a084782c959", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:32:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-84a23da3-ef15-4314-a23d-0c42a61fb5d2 req-d40adf9a-443d-41fa-84d7-527f5bb8044c service nova] Releasing lock "refresh_cache-a90b8dec-8529-4658-bf18-c5047c17c329" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:32:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5e674e21-a4df-411e-ba2e-e9c1b8bf5401 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.508s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquiring lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG nova.objects.instance [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lazy-loading 'flavor' on Instance uuid eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquiring lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:05 user nova-compute[72201]: INFO nova.compute.manager [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Attaching volume 7be10844-84c6-4bb7-bfec-3fe85706866c to /dev/vdc
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "a90b8dec-8529-4658-bf18-c5047c17c329" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "a90b8dec-8529-4658-bf18-c5047c17c329" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG nova.objects.instance [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lazy-loading 'flavor' on Instance uuid a90b8dec-8529-4658-bf18-c5047c17c329 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG os_brick.utils [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b13e28-6e25-4d4a-9b11-4e3c08b5444b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "a90b8dec-8529-4658-bf18-c5047c17c329" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d847f476-405d-4296-9556-1b8f716647fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94a2287-233c-405f-a2ab-8fd91ef8dbd3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be95fab-5056-4ded-a1ca-afffa50262a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-a7438d30-f59d-45be-a4ef-efa27344fc58 req-7d276b9f-3c11-4c6a-ac27-d00bdfc58942 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received event network-changed-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-a7438d30-f59d-45be-a4ef-efa27344fc58 req-7d276b9f-3c11-4c6a-ac27-d00bdfc58942 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Refreshing instance network info cache due to event network-changed-964ce05e-779d-4ccd-a19a-9c6832a9db28. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a7438d30-f59d-45be-a4ef-efa27344fc58 req-7d276b9f-3c11-4c6a-ac27-d00bdfc58942 service nova] Acquiring lock "refresh_cache-ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a7438d30-f59d-45be-a4ef-efa27344fc58 req-7d276b9f-3c11-4c6a-ac27-d00bdfc58942 service nova] Acquired lock "refresh_cache-ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG nova.network.neutron [req-a7438d30-f59d-45be-a4ef-efa27344fc58 req-7d276b9f-3c11-4c6a-ac27-d00bdfc58942 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Refreshing network info cache for port 964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:32:05 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a672c3-a2e2-44c4-ae24-b4e5ab0c0325]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG os_brick.utils [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Updating existing volume attachment record: 7ba1f1b1-81c4-40dc-b70a-13256396bb41 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "a90b8dec-8529-4658-bf18-c5047c17c329" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "a90b8dec-8529-4658-bf18-c5047c17c329" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:05 user nova-compute[72201]: INFO nova.compute.manager [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Attaching volume 4c21f030-d354-4c73-b995-3ea3775c925a to /dev/vdb
Aug 01 15:32:06 user nova-compute[72201]: DEBUG os_brick.utils [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80ac052-ef5c-4043-b870-e013109511b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd123ee-46d9-44ed-87e8-8486dbf0a750]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe11007-2964-4e96-a54f-c81fd40fbe68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7183ee5b-e964-42fb-820d-b5484be6b12a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:32:06 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:32:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca50725-4a89-4b6b-9207-9a8390a9f398]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG os_brick.utils [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Updating existing volume attachment record: 74dec067-1c01-4b39-b50b-e9b1df92dc3c {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG nova.network.neutron [req-a7438d30-f59d-45be-a4ef-efa27344fc58 req-7d276b9f-3c11-4c6a-ac27-d00bdfc58942 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Updated VIF entry in instance network info cache for port 964ce05e-779d-4ccd-a19a-9c6832a9db28. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG nova.network.neutron [req-a7438d30-f59d-45be-a4ef-efa27344fc58 req-7d276b9f-3c11-4c6a-ac27-d00bdfc58942 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Updating instance_info_cache with network_info: [{"id": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "address": "fa:16:3e:89:dd:94", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964ce05e-77", "ovs_interfaceid": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a7438d30-f59d-45be-a4ef-efa27344fc58 req-7d276b9f-3c11-4c6a-ac27-d00bdfc58942 service nova] Releasing lock "refresh_cache-ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-14e890ca-dc2a-4d89-a497-d55805d0c42e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-14e890ca-dc2a-4d89-a497-d55805d0c42e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:32:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-ca51f69e-0309-49de-a9ec-f742b978923d req-3b7cd5c7-91b2-4575-bd52-01775dfc5b0e service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received event network-changed-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:32:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-ca51f69e-0309-49de-a9ec-f742b978923d req-3b7cd5c7-91b2-4575-bd52-01775dfc5b0e service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Refreshing instance network info cache due to event network-changed-964ce05e-779d-4ccd-a19a-9c6832a9db28. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:32:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ca51f69e-0309-49de-a9ec-f742b978923d req-3b7cd5c7-91b2-4575-bd52-01775dfc5b0e service nova] Acquiring lock "refresh_cache-ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:32:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ca51f69e-0309-49de-a9ec-f742b978923d req-3b7cd5c7-91b2-4575-bd52-01775dfc5b0e service nova] Acquired lock "refresh_cache-ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:32:07 user nova-compute[72201]: DEBUG nova.network.neutron [req-ca51f69e-0309-49de-a9ec-f742b978923d req-3b7cd5c7-91b2-4575-bd52-01775dfc5b0e service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Refreshing network info cache for port 964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:32:07 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Updating instance_info_cache with network_info: [{"id": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "address": "fa:16:3e:af:9c:2f", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9067d464-76", "ovs_interfaceid": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:32:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-14e890ca-dc2a-4d89-a497-d55805d0c42e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:32:07 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:32:07 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:32:07 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Starting finish_migration {{(pid=72201) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Instance directory exists: not creating {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 15:32:08 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Creating image(s)
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.objects.instance [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9530577b-69a6-45bc-a33b-1dc60d69a16f {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:08 user nova-compute[72201]: INFO nova.compute.manager [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Detaching volume 5029d699-a8e1-47e1-baf9-1ca8c0d05aee
Aug 01 15:32:08 user nova-compute[72201]: INFO nova.virt.block_device [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Attempting to driver detach volume 5029d699-a8e1-47e1-baf9-1ca8c0d05aee from mountpoint /dev/vdb
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk. size=21474836480 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Attempting to detach device vdb from instance ed5f91f1-b3fd-4737-8ed6-fca13617bd6e from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:32:08 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:32:08 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 15:32:08 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:32:08 user nova-compute[72201]:   <serial>5029d699-a8e1-47e1-baf9-1ca8c0d05aee</serial>
Aug 01 15:32:08 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:32:08 user nova-compute[72201]: </disk>
Aug 01 15:32:08 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:32:08 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Successfully detached device vdb from instance ed5f91f1-b3fd-4737-8ed6-fca13617bd6e from the persistent domain config.
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ed5f91f1-b3fd-4737-8ed6-fca13617bd6e from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:32:08 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:32:08 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 15:32:08 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:32:08 user nova-compute[72201]:   <serial>5029d699-a8e1-47e1-baf9-1ca8c0d05aee</serial>
Aug 01 15:32:08 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:32:08 user nova-compute[72201]: </disk>
Aug 01 15:32:08 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk 21474836480 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk 21474836480" returned: 0 in 0.051s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Did not create local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Ensure instance console log exists: /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Start _get_guest_xml network_info=[{"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-988219649-network", "vif_mac": "fa:16:3e:78:0d:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwmPABNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '9530577b-69a6-45bc-a33b-1dc60d69a16f', 'attached_at': '2023-08-01T15:32:08.000000', 'detached_at': '', 'volume_id': 'eaeddea5-fbb6-4b61-9a48-07c49f1b82b7', 'serial': 'eaeddea5-fbb6-4b61-9a48-07c49f1b82b7'}, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'a46c9d74-b471-4b6c-ab34-90daa5f4af63', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:32:08 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:32:08 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.objects.instance [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9530577b-69a6-45bc-a33b-1dc60d69a16f {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwmPABNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:32:08 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:32:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:32:08 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:32:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:32:08 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[22446be5-d3d5-4421-b960-0600760e3c4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:32:08 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b62f2b9-064f-42e0-8304-3b131bbde6ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7] added
Aug 01 15:32:08 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9136da-450c-4ad3-9066-d5de71d82874]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[630cff2d-4732-4444-901c-5686bb7fd472]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwmPABNE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwmPABNE" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b9a4e9-92c3-4782-a734-9a67efa41032]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jwmPABNE'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe7128a-0470-4165-8478-f6e773b8c3f6]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c064ebf0-5b52-4319-b67a-af4c2b2d06c8]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:32:08 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:08 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:08 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:08 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:32:08 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:08 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:08 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:08 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:32:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690903929.0175016, ed5f91f1-b3fd-4737-8ed6-fca13617bd6e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ed5f91f1-b3fd-4737-8ed6-fca13617bd6e {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:32:09 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Successfully detached device vdb from instance ed5f91f1-b3fd-4737-8ed6-fca13617bd6e from the live domain config.
Aug 01 15:32:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCKQTRfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:32:09 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:32:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad87b5f-6089-47dd-956c-ae3329fd51d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260]
Aug 01 15:32:09 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260] successful.
Aug 01 15:32:09 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae7d572-8f56-493f-a055-d10a2ede1215]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG nova.network.neutron [req-ca51f69e-0309-49de-a9ec-f742b978923d req-3b7cd5c7-91b2-4575-bd52-01775dfc5b0e service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Updated VIF entry in instance network info cache for port 964ce05e-779d-4ccd-a19a-9c6832a9db28. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG nova.network.neutron [req-ca51f69e-0309-49de-a9ec-f742b978923d req-3b7cd5c7-91b2-4575-bd52-01775dfc5b0e service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Updating instance_info_cache with network_info: [{"id": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "address": "fa:16:3e:89:dd:94", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964ce05e-77", "ovs_interfaceid": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc69336-f585-47e4-9573-7ad0b26decbf]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:32:09 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:09 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:09 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:09 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:32:09 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:32:09 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:09 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:09 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:09 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:32:09 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ca51f69e-0309-49de-a9ec-f742b978923d req-3b7cd5c7-91b2-4575-bd52-01775dfc5b0e service nova] Releasing lock "refresh_cache-ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25f43a7-8bd7-4c1e-92e3-53da1f93b1a2]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:32:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwmPABNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26233306335393138', 'path': '/dev/sde'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233306335393138', 'path': '/dev/sde'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.102s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be306dd-2dbb-4e6b-b106-48f0feac76a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:27:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1658925189',display_name='tempest-ServerActionsTestOtherB-server-1658925189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1658925189',id=23,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJArwB9vrejGtK4OyRlF/OPoTmPfhsQE57Hge1qGzDjlRPweDSIgEPC9CjlFjLzOgL7v2M+GdTat2K+6ohuaRgnBN7sGvF/1T+/fwnocb98Oa2hVXX8HgqjMMybuv12ZQ==',key_name='tempest-keypair-162505840',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:28:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a7d07e2a1943449baeb9ca49a3d1326f',ramdisk_id='',reservation_id='r-0d5v5zbb',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2096061393',owner_user_name='tempest-ServerActionsTestOtherB-2096061393-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:31:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa902dd334b04d4cbf0ee4eb1eb582ff',uuid=9530577b-69a6-45bc-a33b-1dc60d69a16f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-988219649-network", "vif_mac": "fa:16:3e:78:0d:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Converting VIF {"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-988219649-network", "vif_mac": "fa:16:3e:78:0d:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:0d:a8,bridge_name='br-int',has_traffic_filtering=True,id=2cccc4c0-1ece-49a9-9e19-065c8fe55d9f,network=Network(bbd9214a-e302-4a4a-9395-f3e70e0cc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cccc4c0-1e') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:32:10 user nova-compute[72201]:   <uuid>9530577b-69a6-45bc-a33b-1dc60d69a16f</uuid>
Aug 01 15:32:10 user nova-compute[72201]:   <name>instance-00000017</name>
Aug 01 15:32:10 user nova-compute[72201]:   <memory>2097152</memory>
Aug 01 15:32:10 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:32:10 user nova-compute[72201]:   <metadata>
Aug 01 15:32:10 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:32:10 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:32:10 user nova-compute[72201]:       <nova:name>tempest-ServerActionsTestOtherB-server-1658925189</nova:name>
Aug 01 15:32:10 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:32:08</nova:creationTime>
Aug 01 15:32:10 user nova-compute[72201]:       <nova:flavor name="m1.small">
Aug 01 15:32:10 user nova-compute[72201]:         <nova:memory>2048</nova:memory>
Aug 01 15:32:10 user nova-compute[72201]:         <nova:disk>20</nova:disk>
Aug 01 15:32:10 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:32:10 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:32:10 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:32:10 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:32:10 user nova-compute[72201]:       <nova:owner>
Aug 01 15:32:10 user nova-compute[72201]:         <nova:user uuid="fa902dd334b04d4cbf0ee4eb1eb582ff">tempest-ServerActionsTestOtherB-2096061393-project-member</nova:user>
Aug 01 15:32:10 user nova-compute[72201]:         <nova:project uuid="a7d07e2a1943449baeb9ca49a3d1326f">tempest-ServerActionsTestOtherB-2096061393</nova:project>
Aug 01 15:32:10 user nova-compute[72201]:       </nova:owner>
Aug 01 15:32:10 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:32:10 user nova-compute[72201]:       <nova:ports>
Aug 01 15:32:10 user nova-compute[72201]:         <nova:port uuid="2cccc4c0-1ece-49a9-9e19-065c8fe55d9f">
Aug 01 15:32:10 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 15:32:10 user nova-compute[72201]:         </nova:port>
Aug 01 15:32:10 user nova-compute[72201]:       </nova:ports>
Aug 01 15:32:10 user nova-compute[72201]:     </nova:instance>
Aug 01 15:32:10 user nova-compute[72201]:   </metadata>
Aug 01 15:32:10 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:32:10 user nova-compute[72201]:     <system>
Aug 01 15:32:10 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:32:10 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:32:10 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:32:10 user nova-compute[72201]:       <entry name="serial">9530577b-69a6-45bc-a33b-1dc60d69a16f</entry>
Aug 01 15:32:10 user nova-compute[72201]:       <entry name="uuid">9530577b-69a6-45bc-a33b-1dc60d69a16f</entry>
Aug 01 15:32:10 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:32:10 user nova-compute[72201]:     </system>
Aug 01 15:32:10 user nova-compute[72201]:   </sysinfo>
Aug 01 15:32:10 user nova-compute[72201]:   <os>
Aug 01 15:32:10 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:32:10 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:32:10 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:32:10 user nova-compute[72201]:   </os>
Aug 01 15:32:10 user nova-compute[72201]:   <features>
Aug 01 15:32:10 user nova-compute[72201]:     <acpi/>
Aug 01 15:32:10 user nova-compute[72201]:     <apic/>
Aug 01 15:32:10 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:32:10 user nova-compute[72201]:   </features>
Aug 01 15:32:10 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:32:10 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:32:10 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:32:10 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:32:10 user nova-compute[72201]:   </clock>
Aug 01 15:32:10 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:32:10 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:32:10 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:32:10 user nova-compute[72201]:   </cpu>
Aug 01 15:32:10 user nova-compute[72201]:   <devices>
Aug 01 15:32:10 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:32:10 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:32:10 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk"/>
Aug 01 15:32:10 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:32:10 user nova-compute[72201]:     </disk>
Aug 01 15:32:10 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:32:10 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:32:10 user nova-compute[72201]:       <source dev="/dev/sde"/>
Aug 01 15:32:10 user nova-compute[72201]:       <target dev="vdb" bus="virtio"/>
Aug 01 15:32:10 user nova-compute[72201]:       <serial>eaeddea5-fbb6-4b61-9a48-07c49f1b82b7</serial>
Aug 01 15:32:10 user nova-compute[72201]:     </disk>
Aug 01 15:32:10 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:32:10 user nova-compute[72201]:       <mac address="fa:16:3e:78:0d:a8"/>
Aug 01 15:32:10 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:32:10 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:32:10 user nova-compute[72201]:       <target dev="tap2cccc4c0-1e"/>
Aug 01 15:32:10 user nova-compute[72201]:     </interface>
Aug 01 15:32:10 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:32:10 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/console.log" append="off"/>
Aug 01 15:32:10 user nova-compute[72201]:     </serial>
Aug 01 15:32:10 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:32:10 user nova-compute[72201]:     <video>
Aug 01 15:32:10 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:32:10 user nova-compute[72201]:     </video>
Aug 01 15:32:10 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:32:10 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:32:10 user nova-compute[72201]:     </rng>
Aug 01 15:32:10 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:32:10 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:32:10 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:32:10 user nova-compute[72201]:     </memballoon>
Aug 01 15:32:10 user nova-compute[72201]:   </devices>
Aug 01 15:32:10 user nova-compute[72201]: </domain>
Aug 01 15:32:10 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:27:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1658925189',display_name='tempest-ServerActionsTestOtherB-server-1658925189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1658925189',id=23,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJArwB9vrejGtK4OyRlF/OPoTmPfhsQE57Hge1qGzDjlRPweDSIgEPC9CjlFjLzOgL7v2M+GdTat2K+6ohuaRgnBN7sGvF/1T+/fwnocb98Oa2hVXX8HgqjMMybuv12ZQ==',key_name='tempest-keypair-162505840',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:28:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a7d07e2a1943449baeb9ca49a3d1326f',ramdisk_id='',reservation_id='r-0d5v5zbb',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2096061393',owner_user_name='tempest-ServerActionsTestOtherB-2096061393-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:31:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa902dd334b04d4cbf0ee4eb1eb582ff',uuid=9530577b-69a6-45bc-a33b-1dc60d69a16f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-988219649-network", "vif_mac": "fa:16:3e:78:0d:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Converting VIF {"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-988219649-network", "vif_mac": "fa:16:3e:78:0d:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:0d:a8,bridge_name='br-int',has_traffic_filtering=True,id=2cccc4c0-1ece-49a9-9e19-065c8fe55d9f,network=Network(bbd9214a-e302-4a4a-9395-f3e70e0cc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cccc4c0-1e') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG os_vif [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:0d:a8,bridge_name='br-int',has_traffic_filtering=True,id=2cccc4c0-1ece-49a9-9e19-065c8fe55d9f,network=Network(bbd9214a-e302-4a4a-9395-f3e70e0cc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cccc4c0-1e') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cccc4c0-1e, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2cccc4c0-1e, col_values=(('external_ids', {'iface-id': '2cccc4c0-1ece-49a9-9e19-065c8fe55d9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:0d:a8', 'vm-uuid': '9530577b-69a6-45bc-a33b-1dc60d69a16f'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[20faab36-f0a9-491d-9983-61cb2e50b932]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:32:10 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:10 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:10 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:10 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:32:10 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee (non-flash)
Aug 01 15:32:10 user nova-compute[72201]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:10 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:10 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:10 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:32:10 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c345a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee'): ({'sdb'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Removing single pathed devices sdb {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:10 user nova-compute[72201]: INFO os_vif [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:0d:a8,bridge_name='br-int',has_traffic_filtering=True,id=2cccc4c0-1ece-49a9-9e19-065c8fe55d9f,network=Network(bbd9214a-e302-4a4a-9395-f3e70e0cc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cccc4c0-1e')
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc10abd-4c84-489e-afb7-e27450dc93ba]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e77029-ef82-414b-b9e8-d71058962402]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Flushing IO for device /dev/sdb {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d69c79-001a-4faf-9568-f6c00947a9f7]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] No VIF found with MAC fa:16:3e:78:0d:a8, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a655a4b-badb-4da5-bb12-595257d4741b]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f011b20a-60b0-4337-bd35-d4778bac159c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2b9365-cb00-4a79-90fc-2414a28644a7]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee, portal: 172.16.0.220,3260]
Aug 01 15:32:10 user nova-compute[72201]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee, portal: 172.16.0.220,3260] successful.
Aug 01 15:32:10 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5029d699-a8e1-47e1-baf9-1ca8c0d05aee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[008959c5-d086-4e76-8ad1-127940e7b0c7]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] <== disconnect_volume: return (1408ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:32:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:32:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:11 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903916.7726607, 9530577b-69a6-45bc-a33b-1dc60d69a16f => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:32:11 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] VM Stopped (Lifecycle Event)
Aug 01 15:32:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3ca3943a-6929-4da4-838a-742b29bbd9c0 None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:32:11 user nova-compute[72201]: DEBUG nova.compute.manager [req-05ed11ec-7ae8-4bbf-a3fc-ce572522787a req-49d21652-ab41-4e43-a3b6-c52d6380386b service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received event network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:32:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-05ed11ec-7ae8-4bbf-a3fc-ce572522787a req-49d21652-ab41-4e43-a3b6-c52d6380386b service nova] Acquiring lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-05ed11ec-7ae8-4bbf-a3fc-ce572522787a req-49d21652-ab41-4e43-a3b6-c52d6380386b service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-05ed11ec-7ae8-4bbf-a3fc-ce572522787a req-49d21652-ab41-4e43-a3b6-c52d6380386b service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:11 user nova-compute[72201]: DEBUG nova.compute.manager [req-05ed11ec-7ae8-4bbf-a3fc-ce572522787a req-49d21652-ab41-4e43-a3b6-c52d6380386b service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] No waiting events found dispatching network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:32:11 user nova-compute[72201]: WARNING nova.compute.manager [req-05ed11ec-7ae8-4bbf-a3fc-ce572522787a req-49d21652-ab41-4e43-a3b6-c52d6380386b service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received unexpected event network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f for instance with vm_state active and task_state resize_finish.
Aug 01 15:32:12 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:32:12 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:32:12 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:32:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:12 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:32:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903933.7311194, 9530577b-69a6-45bc-a33b-1dc60d69a16f => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:32:13 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] VM Resumed (Lifecycle Event)
Aug 01 15:32:13 user nova-compute[72201]: DEBUG nova.compute.manager [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:32:13 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Instance running successfully.
Aug 01 15:32:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Failed to set time: agent not configured {{(pid=72201) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-aa0c82ca-7ee6-4627-a7d8-14dbd01ab976 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] finish_migration finished successfully. {{(pid=72201) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:32:13 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 15:32:13 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903933.735868, 9530577b-69a6-45bc-a33b-1dc60d69a16f => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:32:13 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] VM Started (Lifecycle Event)
Aug 01 15:32:13 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:32:13 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 15:32:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTOfrhmN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:32:13 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:32:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:32:13 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:32:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:32:13 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:32:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5330d4de-e77d-4f39-8f17-05268816546a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:32:13 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f64d144-0332-4d7c-bc4e-c168b0cfa462]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c] added
Aug 01 15:32:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG nova.compute.manager [req-1e5d09b6-a18a-49b3-934d-d53408accd73 req-ad1a7ebc-0ae5-4863-8a80-dd1e7793e702 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received event network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1e5d09b6-a18a-49b3-934d-d53408accd73 req-ad1a7ebc-0ae5-4863-8a80-dd1e7793e702 service nova] Acquiring lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1e5d09b6-a18a-49b3-934d-d53408accd73 req-ad1a7ebc-0ae5-4863-8a80-dd1e7793e702 service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1e5d09b6-a18a-49b3-934d-d53408accd73 req-ad1a7ebc-0ae5-4863-8a80-dd1e7793e702 service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG nova.compute.manager [req-1e5d09b6-a18a-49b3-934d-d53408accd73 req-ad1a7ebc-0ae5-4863-8a80-dd1e7793e702 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] No waiting events found dispatching network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:32:13 user nova-compute[72201]: WARNING nova.compute.manager [req-1e5d09b6-a18a-49b3-934d-d53408accd73 req-ad1a7ebc-0ae5-4863-8a80-dd1e7793e702 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received unexpected event network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f for instance with vm_state active and task_state resize_finish.
Aug 01 15:32:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[012438d3-a2ba-43a0-9382-4c30905f99fc]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa4c0f6-bcc2-4030-9c4a-975639d3057e]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTOfrhmN {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTOfrhmN" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f18ce85-1538-494f-b2af-70f572d04267]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lTOfrhmN'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d73f86b-7880-4af6-b47e-ea49d3a3baba]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36a8865-e973-4492-ad2c-afeb82b4819a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:14 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:14 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:14 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:32:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:14 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:14 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:14 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:32:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63c28f5-200b-4124-8835-5ba693a33cc3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c, portal: 172.16.0.220,3260]
Aug 01 15:32:14 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c, portal: 172.16.0.220,3260] successful.
Aug 01 15:32:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2000b32-8fce-4975-93d1-c6276801eee0]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec483db9-cf4c-42ee-81ea-1c6d4fec049b]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:14 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:14 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:14 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:32:14 user nova-compute[72201]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c (non-flash)
Aug 01 15:32:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:14 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:14 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:14 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:32:14 user nova-compute[72201]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c (non-flash)
Aug 01 15:32:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.470s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[77436b37-c4e8-465b-ae39-56cab4ee0804]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: None {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:32:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTOfrhmN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.507s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] <== connect_volume: return (1509ms) {'type': 'block', 'scsi_wwn': '23165353738623062', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165353738623062', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG nova.objects.instance [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lazy-loading 'flavor' on Instance uuid eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:32:15 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:32:15 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 15:32:15 user nova-compute[72201]:   <target dev="vdc" bus="virtio"/>
Aug 01 15:32:15 user nova-compute[72201]:   <serial>7be10844-84c6-4bb7-bfec-3fe85706866c</serial>
Aug 01 15:32:15 user nova-compute[72201]: </disk>
Aug 01 15:32:15 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] No VIF found with MAC fa:16:3e:b2:68:3a, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bf5e43e8-d5cc-4b43-a8d1-7b65efacc1fa tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.451s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquiring lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:16 user nova-compute[72201]: INFO nova.compute.manager [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Detaching volume 7be10844-84c6-4bb7-bfec-3fe85706866c
Aug 01 15:32:16 user nova-compute[72201]: INFO nova.virt.block_device [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Attempting to driver detach volume 7be10844-84c6-4bb7-bfec-3fe85706866c from mountpoint /dev/vdc
Aug 01 15:32:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Attempting to detach device vdc from instance eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:32:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:32:16 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:32:16 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 15:32:16 user nova-compute[72201]:   <target dev="vdc" bus="virtio"/>
Aug 01 15:32:16 user nova-compute[72201]:   <serial>7be10844-84c6-4bb7-bfec-3fe85706866c</serial>
Aug 01 15:32:16 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 15:32:16 user nova-compute[72201]: </disk>
Aug 01 15:32:16 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:32:16 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Successfully detached device vdc from instance eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 from the persistent domain config.
Aug 01 15:32:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:32:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:32:16 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:32:16 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 15:32:16 user nova-compute[72201]:   <target dev="vdc" bus="virtio"/>
Aug 01 15:32:16 user nova-compute[72201]:   <serial>7be10844-84c6-4bb7-bfec-3fe85706866c</serial>
Aug 01 15:32:16 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 15:32:16 user nova-compute[72201]: </disk>
Aug 01 15:32:16 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:32:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:32:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:32:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:16 user nova-compute[72201]: DEBUG nova.objects.instance [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lazy-loading 'flavor' on Instance uuid ed5f91f1-b3fd-4737-8ed6-fca13617bd6e {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:32:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-93622565-cffa-4989-ab0b-2ee3433a7ec6 tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.485s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UqnpzBdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:32:17 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:32:17 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:32:17 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f40e325-5c3b-4a06-bb16-0b0e7a7d13ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:32:17 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[847f2e51-4b37-44ae-9260-137d7745dea8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a] added
Aug 01 15:32:17 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690903937.1449616, eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9013fc66-93d8-49e6-aa48-da457043954b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:32:17 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Successfully detached device vdc from instance eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 from the live domain config.
Aug 01 15:32:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTOfrhmN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:32:17 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7500787-5aa9-4c50-9fbb-bf7d33d54365]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UqnpzBdr {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UqnpzBdr" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0549e8-63fa-4182-8a8c-ab0ad93f36bd]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UqnpzBdr'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[25548061-8786-4623-8d6b-8470b7b0dfcc]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d884cc-459c-427b-b14b-9d6e50d0fd72]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:17 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:17 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:17 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:32:17 user nova-compute[72201]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c (non-flash)
Aug 01 15:32:17 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:17 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:17 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:17 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:32:17 user nova-compute[72201]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c (non-flash)
Aug 01 15:32:17 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff7945b-df23-4750-a11a-a84d399abd8f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a, portal: 172.16.0.220,3260]
Aug 01 15:32:17 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a, portal: 172.16.0.220,3260] successful.
Aug 01 15:32:17 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc88e9d-23cf-4bd3-a1c7-6f28927663d9]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f004e6-cae2-4f50-9fc0-b635d1ff7135]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:17 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:17 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:17 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:32:17 user nova-compute[72201]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c (non-flash)
Aug 01 15:32:17 user nova-compute[72201]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a (non-flash)
Aug 01 15:32:17 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:17 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:17 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:17 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:32:17 user nova-compute[72201]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c (non-flash)
Aug 01 15:32:17 user nova-compute[72201]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a (non-flash)
Aug 01 15:32:17 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b5f57b-5f3d-4a3d-bd29-73165dec23b1]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UqnpzBdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.760s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] <== connect_volume: return (1762ms) {'type': 'block', 'scsi_wwn': '26232383337633466', 'path': '/dev/sdg'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232383337633466', 'path': '/dev/sdg'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.649s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:18 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:32:18 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:32:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=6561MB free_disk=25.006778717041016GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG nova.objects.instance [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lazy-loading 'flavor' on Instance uuid a90b8dec-8529-4658-bf18-c5047c17c329 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d187bfdf-91d9-4cf3-93b2-63b015912067]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:32:18 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:32:18 user nova-compute[72201]:   <source dev="/dev/sdg"/>
Aug 01 15:32:18 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:32:18 user nova-compute[72201]:   <serial>4c21f030-d354-4c73-b995-3ea3775c925a</serial>
Aug 01 15:32:18 user nova-compute[72201]: </disk>
Aug 01 15:32:18 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[324666cb-7cf8-4013-81d4-2f30a626a1a9]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:18 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:18 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:18 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:32:18 user nova-compute[72201]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c (non-flash)
Aug 01 15:32:18 user nova-compute[72201]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a (non-flash)
Aug 01 15:32:18 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:18 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:18 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:18 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:32:18 user nova-compute[72201]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c (non-flash)
Aug 01 15:32:18 user nova-compute[72201]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a (non-flash)
Aug 01 15:32:18 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c65f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c'): ({'sdb'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Removing single pathed devices sdb {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88f4952-0a12-4462-b011-a700232f0d24]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c6f06c-1322-413e-8b1a-c4bdff92abd2]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Flushing IO for device /dev/sdb {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50769ed-ab2e-485e-87f5-0a77136f4b8c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:32:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[166ab6d0-5661-4b48-a4e3-0b005db0370d]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Applying migration context for instance bd70360d-30b8-47d5-b35e-adf0d28482dd as it has an incoming, in-progress migration 39d76218-a07b-4517-b132-4e3fb4484638. Migration status is finished {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Applying migration context for instance 9530577b-69a6-45bc-a33b-1dc60d69a16f as it has an incoming, in-progress migration 7d266d84-6760-4fef-9ee0-849b99a23ad5. Migration status is finished {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 15:32:19 user nova-compute[72201]: INFO nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Updating resource usage from migration 39d76218-a07b-4517-b132-4e3fb4484638
Aug 01 15:32:19 user nova-compute[72201]: INFO nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Updating resource usage from migration 7d266d84-6760-4fef-9ee0-849b99a23ad5
Aug 01 15:32:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36ee84c-39d9-4a0b-938a-82e0a22d11da]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance b64f1cfb-64f2-4493-8721-fc63fcd93bb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e2ca19ea-868c-40ad-a453-f6e348cfac15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 0f059ccc-f609-4cf3-a644-c3d1305ae26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 865b371c-59c5-4004-8469-cdc1e9327ecb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 14e890ca-dc2a-4d89-a497-d55805d0c42e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance ed5f91f1-b3fd-4737-8ed6-fca13617bd6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 9e946b4a-9b93-459f-8e5e-d88612c4ec34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance a90b8dec-8529-4658-bf18-c5047c17c329 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 79c02f2d-a143-4522-9054-369da11b54ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Migration 39d76218-a07b-4517-b132-4e3fb4484638 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance bd70360d-30b8-47d5-b35e-adf0d28482dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Migration 7d266d84-6760-4fef-9ee0-849b99a23ad5 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 9530577b-69a6-45bc-a33b-1dc60d69a16f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=11776MB phys_disk=40GB used_disk=33GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0871cf-c4bb-4bc1-a3e0-0e33df63223d]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c, portal: 172.16.0.220,3260]
Aug 01 15:32:19 user nova-compute[72201]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c, portal: 172.16.0.220,3260] successful.
Aug 01 15:32:19 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be10844-84c6-4bb7-bfec-3fe85706866c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cac5e92-7ad2-4287-8cdb-52af309f8029]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] <== disconnect_volume: return (1986ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] No VIF found with MAC fa:16:3e:b5:d0:21, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9f7f9321-fa1b-4953-9303-b82f2fe3e03d tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "a90b8dec-8529-4658-bf18-c5047c17c329" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.585s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.809s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG nova.objects.instance [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lazy-loading 'flavor' on Instance uuid eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:32:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cf53a762-d783-41c0-8ee7-a6f28546b723 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.431s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "a90b8dec-8529-4658-bf18-c5047c17c329" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "a90b8dec-8529-4658-bf18-c5047c17c329" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:20 user nova-compute[72201]: INFO nova.compute.manager [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Detaching volume 4c21f030-d354-4c73-b995-3ea3775c925a
Aug 01 15:32:20 user nova-compute[72201]: INFO nova.virt.block_device [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Attempting to driver detach volume 4c21f030-d354-4c73-b995-3ea3775c925a from mountpoint /dev/vdb
Aug 01 15:32:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Attempting to detach device vdb from instance a90b8dec-8529-4658-bf18-c5047c17c329 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:32:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:32:20 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:32:20 user nova-compute[72201]:   <source dev="/dev/sdg"/>
Aug 01 15:32:20 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:32:20 user nova-compute[72201]:   <serial>4c21f030-d354-4c73-b995-3ea3775c925a</serial>
Aug 01 15:32:20 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:32:20 user nova-compute[72201]: </disk>
Aug 01 15:32:20 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:32:21 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Successfully detached device vdb from instance a90b8dec-8529-4658-bf18-c5047c17c329 from the persistent domain config.
Aug 01 15:32:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a90b8dec-8529-4658-bf18-c5047c17c329 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:32:21 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:32:21 user nova-compute[72201]:   <source dev="/dev/sdg"/>
Aug 01 15:32:21 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:32:21 user nova-compute[72201]:   <serial>4c21f030-d354-4c73-b995-3ea3775c925a</serial>
Aug 01 15:32:21 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:32:21 user nova-compute[72201]: </disk>
Aug 01 15:32:21 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "865b371c-59c5-4004-8469-cdc1e9327ecb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "865b371c-59c5-4004-8469-cdc1e9327ecb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "865b371c-59c5-4004-8469-cdc1e9327ecb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "865b371c-59c5-4004-8469-cdc1e9327ecb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "865b371c-59c5-4004-8469-cdc1e9327ecb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:21 user nova-compute[72201]: INFO nova.compute.manager [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Terminating instance
Aug 01 15:32:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-6b800aa0-ab22-4973-9d15-84c73f5b1db0 req-422fa5f3-2afe-4c05-9895-f9c9dbfc4cfa service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Received event network-vif-unplugged-d3f16763-8835-4330-945f-ab8dc7045426 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6b800aa0-ab22-4973-9d15-84c73f5b1db0 req-422fa5f3-2afe-4c05-9895-f9c9dbfc4cfa service nova] Acquiring lock "865b371c-59c5-4004-8469-cdc1e9327ecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6b800aa0-ab22-4973-9d15-84c73f5b1db0 req-422fa5f3-2afe-4c05-9895-f9c9dbfc4cfa service nova] Lock "865b371c-59c5-4004-8469-cdc1e9327ecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6b800aa0-ab22-4973-9d15-84c73f5b1db0 req-422fa5f3-2afe-4c05-9895-f9c9dbfc4cfa service nova] Lock "865b371c-59c5-4004-8469-cdc1e9327ecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-6b800aa0-ab22-4973-9d15-84c73f5b1db0 req-422fa5f3-2afe-4c05-9895-f9c9dbfc4cfa service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] No waiting events found dispatching network-vif-unplugged-d3f16763-8835-4330-945f-ab8dc7045426 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-6b800aa0-ab22-4973-9d15-84c73f5b1db0 req-422fa5f3-2afe-4c05-9895-f9c9dbfc4cfa service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Received event network-vif-unplugged-d3f16763-8835-4330-945f-ab8dc7045426 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690903941.4851658, a90b8dec-8529-4658-bf18-c5047c17c329 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a90b8dec-8529-4658-bf18-c5047c17c329 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:32:21 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Successfully detached device vdb from instance a90b8dec-8529-4658-bf18-c5047c17c329 from the live domain config.
Aug 01 15:32:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UqnpzBdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:32:21 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:32:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0807d059-0eb1-4951-89ab-2e7f50bf263a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e7db23-99c7-405c-9c26-cd75c619773f]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:21 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:21 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:21 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:32:21 user nova-compute[72201]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a (non-flash)
Aug 01 15:32:21 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:21 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:21 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:21 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:32:21 user nova-compute[72201]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a (non-flash)
Aug 01 15:32:21 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c6816c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a'): ({'sdg'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Removing single pathed devices sdg {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fb94af-880b-4be5-8a6d-fd81ec458d5c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d42286-10e1-410d-a46c-24e05dda451f]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Flushing IO for device /dev/sdg {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9d2a4c-4f40-4305-bfbd-cce2f759e08e]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.071s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ae210f-668e-49ba-8165-66d63f7005c5]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] SCSI volumes sdg have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[647d3103-ca0c-47c2-a9d7-f505de6a540c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ed4cba-ca93-403d-9678-30f76d5ea318]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a, portal: 172.16.0.220,3260]
Aug 01 15:32:21 user nova-compute[72201]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a, portal: 172.16.0.220,3260] successful.
Aug 01 15:32:21 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c21f030-d354-4c73-b995-3ea3775c925a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1d9ae6-5e3a-4fd8-866a-ecd2dcd1b543]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] <== disconnect_volume: return (355ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:32:21 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Instance destroyed successfully.
Aug 01 15:32:21 user nova-compute[72201]: DEBUG nova.objects.instance [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lazy-loading 'resources' on Instance uuid 865b371c-59c5-4004-8469-cdc1e9327ecb {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1276795495',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1276795495',id=19,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDZ0j58I8/Te9XqUZQ/tJwDoebmtJ26MOYivVZDlyyJzobMeRC060C4moZAKcQ6viSYdrrgwD1vNtgBhV/e5jOSRdeVi1igPFX/kAHDugSRCnghEn66FoQOaRhSmUbLHQ==',key_name='tempest-keypair-794991541',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:25:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0a434898181465ea2df89c7b1e42597',ramdisk_id='',reservation_id='r-ps12rmk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1609612653',owner_user_name='tempest-ServerActionsV293TestJSON-1609612653-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:25:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32967fa82739495685f336d7ace68000',uuid=865b371c-59c5-4004-8469-cdc1e9327ecb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3f16763-8835-4330-945f-ab8dc7045426", "address": "fa:16:3e:f0:07:0d", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f16763-88", "ovs_interfaceid": "d3f16763-8835-4330-945f-ab8dc7045426", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Converting VIF {"id": "d3f16763-8835-4330-945f-ab8dc7045426", "address": "fa:16:3e:f0:07:0d", "network": {"id": "968d4faa-613e-4954-86cc-3df6b86a2491", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-267394190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a434898181465ea2df89c7b1e42597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f16763-88", "ovs_interfaceid": "d3f16763-8835-4330-945f-ab8dc7045426", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=d3f16763-8835-4330-945f-ab8dc7045426,network=Network(968d4faa-613e-4954-86cc-3df6b86a2491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3f16763-88') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG os_vif [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=d3f16763-8835-4330-945f-ab8dc7045426,network=Network(968d4faa-613e-4954-86cc-3df6b86a2491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3f16763-88') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3f16763-88, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:21 user nova-compute[72201]: INFO os_vif [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:07:0d,bridge_name='br-int',has_traffic_filtering=True,id=d3f16763-8835-4330-945f-ab8dc7045426,network=Network(968d4faa-613e-4954-86cc-3df6b86a2491),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3f16763-88')
Aug 01 15:32:21 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Deleting instance files /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb_del
Aug 01 15:32:21 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Deletion of /opt/stack/data/nova/instances/865b371c-59c5-4004-8469-cdc1e9327ecb_del complete
Aug 01 15:32:21 user nova-compute[72201]: INFO nova.compute.manager [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 01 15:32:21 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:32:21 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:32:22 user nova-compute[72201]: DEBUG nova.objects.instance [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lazy-loading 'flavor' on Instance uuid a90b8dec-8529-4658-bf18-c5047c17c329 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:32:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cabf48bf-02ee-4789-94ad-cd36689a9c99 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "a90b8dec-8529-4658-bf18-c5047c17c329" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.823s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:22 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:32:22 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Took 0.96 seconds to deallocate network for instance.
Aug 01 15:32:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:23 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:32:23 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:32:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ecf5d0e9-176c-4628-8bab-d5ba83e51e30 req-0930fe3e-5e4a-454b-b13a-b00a8d789799 service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Received event network-vif-plugged-d3f16763-8835-4330-945f-ab8dc7045426 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:32:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ecf5d0e9-176c-4628-8bab-d5ba83e51e30 req-0930fe3e-5e4a-454b-b13a-b00a8d789799 service nova] Acquiring lock "865b371c-59c5-4004-8469-cdc1e9327ecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ecf5d0e9-176c-4628-8bab-d5ba83e51e30 req-0930fe3e-5e4a-454b-b13a-b00a8d789799 service nova] Lock "865b371c-59c5-4004-8469-cdc1e9327ecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ecf5d0e9-176c-4628-8bab-d5ba83e51e30 req-0930fe3e-5e4a-454b-b13a-b00a8d789799 service nova] Lock "865b371c-59c5-4004-8469-cdc1e9327ecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ecf5d0e9-176c-4628-8bab-d5ba83e51e30 req-0930fe3e-5e4a-454b-b13a-b00a8d789799 service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] No waiting events found dispatching network-vif-plugged-d3f16763-8835-4330-945f-ab8dc7045426 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:32:23 user nova-compute[72201]: WARNING nova.compute.manager [req-ecf5d0e9-176c-4628-8bab-d5ba83e51e30 req-0930fe3e-5e4a-454b-b13a-b00a8d789799 service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Received unexpected event network-vif-plugged-d3f16763-8835-4330-945f-ab8dc7045426 for instance with vm_state deleted and task_state None.
Aug 01 15:32:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-ecf5d0e9-176c-4628-8bab-d5ba83e51e30 req-0930fe3e-5e4a-454b-b13a-b00a8d789799 service nova] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Received event network-vif-deleted-d3f16763-8835-4330-945f-ab8dc7045426 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:32:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:23 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Deleted allocations for instance 865b371c-59c5-4004-8469-cdc1e9327ecb
Aug 01 15:32:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6db893a0-057c-4b49-a60c-a837148ba31b tempest-ServerActionsV293TestJSON-1609612653 tempest-ServerActionsV293TestJSON-1609612653-project-member] Lock "865b371c-59c5-4004-8469-cdc1e9327ecb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.485s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-f1e99e80-7a3f-440f-8c9c-f5ae3a802c8a req-6e6a7305-5aec-40fc-8f50-760ad0e7a2c4 service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Received event network-changed-90984cd0-4fa8-4f64-bcdb-f3551a73d91b {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-f1e99e80-7a3f-440f-8c9c-f5ae3a802c8a req-6e6a7305-5aec-40fc-8f50-760ad0e7a2c4 service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Refreshing instance network info cache due to event network-changed-90984cd0-4fa8-4f64-bcdb-f3551a73d91b. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f1e99e80-7a3f-440f-8c9c-f5ae3a802c8a req-6e6a7305-5aec-40fc-8f50-760ad0e7a2c4 service nova] Acquiring lock "refresh_cache-2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f1e99e80-7a3f-440f-8c9c-f5ae3a802c8a req-6e6a7305-5aec-40fc-8f50-760ad0e7a2c4 service nova] Acquired lock "refresh_cache-2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG nova.network.neutron [req-f1e99e80-7a3f-440f-8c9c-f5ae3a802c8a req-6e6a7305-5aec-40fc-8f50-760ad0e7a2c4 service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Refreshing network info cache for port 90984cd0-4fa8-4f64-bcdb-f3551a73d91b {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:29 user nova-compute[72201]: INFO nova.compute.manager [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Terminating instance
Aug 01 15:32:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-47891a9a-b442-4aea-af6a-3ce029b4f2b7 req-3e54eac8-6224-401a-85dc-95c03181805b service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Received event network-vif-unplugged-90984cd0-4fa8-4f64-bcdb-f3551a73d91b {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-47891a9a-b442-4aea-af6a-3ce029b4f2b7 req-3e54eac8-6224-401a-85dc-95c03181805b service nova] Acquiring lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-47891a9a-b442-4aea-af6a-3ce029b4f2b7 req-3e54eac8-6224-401a-85dc-95c03181805b service nova] Lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-47891a9a-b442-4aea-af6a-3ce029b4f2b7 req-3e54eac8-6224-401a-85dc-95c03181805b service nova] Lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-47891a9a-b442-4aea-af6a-3ce029b4f2b7 req-3e54eac8-6224-401a-85dc-95c03181805b service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] No waiting events found dispatching network-vif-unplugged-90984cd0-4fa8-4f64-bcdb-f3551a73d91b {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-47891a9a-b442-4aea-af6a-3ce029b4f2b7 req-3e54eac8-6224-401a-85dc-95c03181805b service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Received event network-vif-unplugged-90984cd0-4fa8-4f64-bcdb-f3551a73d91b for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG nova.network.neutron [req-f1e99e80-7a3f-440f-8c9c-f5ae3a802c8a req-6e6a7305-5aec-40fc-8f50-760ad0e7a2c4 service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Updated VIF entry in instance network info cache for port 90984cd0-4fa8-4f64-bcdb-f3551a73d91b. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG nova.network.neutron [req-f1e99e80-7a3f-440f-8c9c-f5ae3a802c8a req-6e6a7305-5aec-40fc-8f50-760ad0e7a2c4 service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Updating instance_info_cache with network_info: [{"id": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "address": "fa:16:3e:e5:db:9d", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90984cd0-4f", "ovs_interfaceid": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:32:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f1e99e80-7a3f-440f-8c9c-f5ae3a802c8a req-6e6a7305-5aec-40fc-8f50-760ad0e7a2c4 service nova] Releasing lock "refresh_cache-2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:32:30 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Instance destroyed successfully.
Aug 01 15:32:30 user nova-compute[72201]: DEBUG nova.objects.instance [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lazy-loading 'resources' on Instance uuid 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:32:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:29:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1181180077',display_name='tempest-TestStampPattern-server-1181180077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1181180077',id=27,image_ref='78d32fa9-528d-46b0-92cc-2cdea38b3808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4cjcpIrCgWJ8HeEyRLEl6J/NtkzbCoKCzwQr+AGaVQkH5fVBdRsWj/5tVNxW6Q1XUhgysYXiPaBl9ORZIAWs2VQxGxCYnIlCoMMGp8aO9DwuzAUIuYOHmCwk/FaqacxQ==',key_name='tempest-TestStampPattern-853407470',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:29:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8289b01d09f4cf4a35affa9e22fa7fd',ramdisk_id='',reservation_id='r-50lu7svo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='14e890ca-dc2a-4d89-a497-d55805d0c42e',image_min_disk='1',image_min_ram='0',image_owner_id='d8289b01d09f4cf4a35affa9e22fa7fd',image_owner_project_name='tempest-TestStampPattern-2066377363',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2066377363-project-member',image_user_id='7c69154feccc402f9f0d2c0aafdbdea7',owner_project_name='tempest-TestStampPattern-2066377363',owner_user_name='tempest-TestStampPattern-2066377363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:29:42Z,user_data=None,user_id='7c69154feccc402f9f0d2c0aafdbdea7',uuid=2813e0b2-5480-4098-ab5f-9fe33c1eb3c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "address": "fa:16:3e:e5:db:9d", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90984cd0-4f", "ovs_interfaceid": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:32:30 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Converting VIF {"id": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "address": "fa:16:3e:e5:db:9d", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90984cd0-4f", "ovs_interfaceid": "90984cd0-4fa8-4f64-bcdb-f3551a73d91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:32:30 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:db:9d,bridge_name='br-int',has_traffic_filtering=True,id=90984cd0-4fa8-4f64-bcdb-f3551a73d91b,network=Network(302af7b4-2054-4148-870e-a04f75c18a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90984cd0-4f') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:32:30 user nova-compute[72201]: DEBUG os_vif [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:db:9d,bridge_name='br-int',has_traffic_filtering=True,id=90984cd0-4fa8-4f64-bcdb-f3551a73d91b,network=Network(302af7b4-2054-4148-870e-a04f75c18a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90984cd0-4f') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:32:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90984cd0-4f, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:32:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:32:30 user nova-compute[72201]: INFO os_vif [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:db:9d,bridge_name='br-int',has_traffic_filtering=True,id=90984cd0-4fa8-4f64-bcdb-f3551a73d91b,network=Network(302af7b4-2054-4148-870e-a04f75c18a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90984cd0-4f')
Aug 01 15:32:30 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Deleting instance files /opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2_del
Aug 01 15:32:30 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Deletion of /opt/stack/data/nova/instances/2813e0b2-5480-4098-ab5f-9fe33c1eb3c2_del complete
Aug 01 15:32:30 user nova-compute[72201]: INFO nova.compute.manager [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 15:32:30 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:32:30 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:32:30 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:32:30 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:32:30 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Took 0.51 seconds to deallocate network for instance.
Aug 01 15:32:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:31 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:32:31 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:32:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:31 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Deleted allocations for instance 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2
Aug 01 15:32:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-260b8a13-7ac4-41ef-97aa-400bc9ac0268 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.931s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-c24725eb-290a-4e1a-95b4-f90e3fb9e3a7 req-2c0ffe53-9abe-4f8c-9135-a6defc3cf678 service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Received event network-vif-plugged-90984cd0-4fa8-4f64-bcdb-f3551a73d91b {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:32:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c24725eb-290a-4e1a-95b4-f90e3fb9e3a7 req-2c0ffe53-9abe-4f8c-9135-a6defc3cf678 service nova] Acquiring lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c24725eb-290a-4e1a-95b4-f90e3fb9e3a7 req-2c0ffe53-9abe-4f8c-9135-a6defc3cf678 service nova] Lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c24725eb-290a-4e1a-95b4-f90e3fb9e3a7 req-2c0ffe53-9abe-4f8c-9135-a6defc3cf678 service nova] Lock "2813e0b2-5480-4098-ab5f-9fe33c1eb3c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-c24725eb-290a-4e1a-95b4-f90e3fb9e3a7 req-2c0ffe53-9abe-4f8c-9135-a6defc3cf678 service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] No waiting events found dispatching network-vif-plugged-90984cd0-4fa8-4f64-bcdb-f3551a73d91b {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:32:31 user nova-compute[72201]: WARNING nova.compute.manager [req-c24725eb-290a-4e1a-95b4-f90e3fb9e3a7 req-2c0ffe53-9abe-4f8c-9135-a6defc3cf678 service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Received unexpected event network-vif-plugged-90984cd0-4fa8-4f64-bcdb-f3551a73d91b for instance with vm_state deleted and task_state None.
Aug 01 15:32:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-c24725eb-290a-4e1a-95b4-f90e3fb9e3a7 req-2c0ffe53-9abe-4f8c-9135-a6defc3cf678 service nova] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Received event network-vif-deleted-90984cd0-4fa8-4f64-bcdb-f3551a73d91b {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:32:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:31 user nova-compute[72201]: INFO nova.compute.manager [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Terminating instance
Aug 01 15:32:31 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:32:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:32 user nova-compute[72201]: DEBUG nova.compute.manager [req-bf5e3175-9965-44f1-ac45-c021cfff1d64 req-2da7d644-ad76-48bf-a257-053c66297a20 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received event network-vif-unplugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:32:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bf5e3175-9965-44f1-ac45-c021cfff1d64 req-2da7d644-ad76-48bf-a257-053c66297a20 service nova] Acquiring lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bf5e3175-9965-44f1-ac45-c021cfff1d64 req-2da7d644-ad76-48bf-a257-053c66297a20 service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bf5e3175-9965-44f1-ac45-c021cfff1d64 req-2da7d644-ad76-48bf-a257-053c66297a20 service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:32 user nova-compute[72201]: DEBUG nova.compute.manager [req-bf5e3175-9965-44f1-ac45-c021cfff1d64 req-2da7d644-ad76-48bf-a257-053c66297a20 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] No waiting events found dispatching network-vif-unplugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:32:32 user nova-compute[72201]: DEBUG nova.compute.manager [req-bf5e3175-9965-44f1-ac45-c021cfff1d64 req-2da7d644-ad76-48bf-a257-053c66297a20 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received event network-vif-unplugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:32:32 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Instance destroyed successfully.
Aug 01 15:32:32 user nova-compute[72201]: DEBUG nova.objects.instance [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lazy-loading 'resources' on Instance uuid 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:32:32 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-616113067',display_name='tempest-ServerStableDeviceRescueTest-server-616113067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-616113067',id=17,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3mv2L6pRwzDlLhsAfZgKjBYSoCSBLrKTMYtnKHzKZtZOFIChaqjgdb/atxzSM7ZpmJlUyit0iamU+T/ZT2+eMI8rXjGQV0wQ6XbxnRS7VabRySFu2LJnSzE7DAZn7bCw==',key_name='tempest-keypair-553162897',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:29:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='58b7341ffe06448bb276bdee2d242c59',ramdisk_id='',reservation_id='r-b64x8tdl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1956540841',owner_user_name='tempest-ServerStableDeviceRescueTest-1956540841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:31:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f08e5ef13d74417a8f07e7c82858ac86',uuid=3a2d865c-6c6c-49b1-a2d3-4afc63b10581,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "address": "fa:16:3e:49:45:f6", "network": {"id": "11d4bdb2-99b5-468c-aeb3-79328fdd2d1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58b7341ffe06448bb276bdee2d242c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf512d66-cb", "ovs_interfaceid": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:32:32 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Converting VIF {"id": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "address": "fa:16:3e:49:45:f6", "network": {"id": "11d4bdb2-99b5-468c-aeb3-79328fdd2d1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1187849676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58b7341ffe06448bb276bdee2d242c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf512d66-cb", "ovs_interfaceid": "af512d66-cb4c-4633-ba94-d8b6b3af6e87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:32:32 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:45:f6,bridge_name='br-int',has_traffic_filtering=True,id=af512d66-cb4c-4633-ba94-d8b6b3af6e87,network=Network(11d4bdb2-99b5-468c-aeb3-79328fdd2d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf512d66-cb') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:32:32 user nova-compute[72201]: DEBUG os_vif [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:45:f6,bridge_name='br-int',has_traffic_filtering=True,id=af512d66-cb4c-4633-ba94-d8b6b3af6e87,network=Network(11d4bdb2-99b5-468c-aeb3-79328fdd2d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf512d66-cb') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:32:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf512d66-cb, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:32:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:32 user nova-compute[72201]: INFO os_vif [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:45:f6,bridge_name='br-int',has_traffic_filtering=True,id=af512d66-cb4c-4633-ba94-d8b6b3af6e87,network=Network(11d4bdb2-99b5-468c-aeb3-79328fdd2d1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf512d66-cb')
Aug 01 15:32:32 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Deleting instance files /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581_del
Aug 01 15:32:32 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Deletion of /opt/stack/data/nova/instances/3a2d865c-6c6c-49b1-a2d3-4afc63b10581_del complete
Aug 01 15:32:32 user nova-compute[72201]: INFO nova.compute.manager [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 01 15:32:32 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:32:32 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:32:32 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:32:33 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:32:33 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Took 0.78 seconds to deallocate network for instance.
Aug 01 15:32:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:33 user nova-compute[72201]: DEBUG nova.compute.manager [req-09c850c3-a6df-42d6-bc06-4ae542dbfe83 req-19cb160b-9c88-4ff8-9837-7ae57a89f0a7 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received event network-vif-deleted-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:32:34 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:32:34 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:32:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:34 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Deleted allocations for instance 3a2d865c-6c6c-49b1-a2d3-4afc63b10581
Aug 01 15:32:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d6883606-873c-4b51-b078-bec0cb62dee9 tempest-ServerStableDeviceRescueTest-1956540841 tempest-ServerStableDeviceRescueTest-1956540841-project-member] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.260s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:34 user nova-compute[72201]: DEBUG nova.compute.manager [req-4871f36e-c41e-48e5-a06f-6a652351e1cc req-4ed81ae2-89d1-4a1c-a4be-83576031ae75 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received event network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:32:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4871f36e-c41e-48e5-a06f-6a652351e1cc req-4ed81ae2-89d1-4a1c-a4be-83576031ae75 service nova] Acquiring lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4871f36e-c41e-48e5-a06f-6a652351e1cc req-4ed81ae2-89d1-4a1c-a4be-83576031ae75 service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4871f36e-c41e-48e5-a06f-6a652351e1cc req-4ed81ae2-89d1-4a1c-a4be-83576031ae75 service nova] Lock "3a2d865c-6c6c-49b1-a2d3-4afc63b10581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:34 user nova-compute[72201]: DEBUG nova.compute.manager [req-4871f36e-c41e-48e5-a06f-6a652351e1cc req-4ed81ae2-89d1-4a1c-a4be-83576031ae75 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] No waiting events found dispatching network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:32:34 user nova-compute[72201]: WARNING nova.compute.manager [req-4871f36e-c41e-48e5-a06f-6a652351e1cc req-4ed81ae2-89d1-4a1c-a4be-83576031ae75 service nova] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Received unexpected event network-vif-plugged-af512d66-cb4c-4633-ba94-d8b6b3af6e87 for instance with vm_state deleted and task_state None.
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "79c02f2d-a143-4522-9054-369da11b54ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "79c02f2d-a143-4522-9054-369da11b54ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG nova.objects.instance [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lazy-loading 'flavor' on Instance uuid 79c02f2d-a143-4522-9054-369da11b54ba {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:32:35 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Ignoring supplied device name: /dev/vdb
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "79c02f2d-a143-4522-9054-369da11b54ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "79c02f2d-a143-4522-9054-369da11b54ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "79c02f2d-a143-4522-9054-369da11b54ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:35 user nova-compute[72201]: INFO nova.compute.manager [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Attaching volume 8cc154e3-9191-4694-8ece-d4e80e189568 to /dev/vdb
Aug 01 15:32:35 user nova-compute[72201]: DEBUG os_brick.utils [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98b2043-bac4-4dba-acde-597cde2d0a11]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[14daa5f2-1f94-491a-92d0-4f06566a7b4a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2680f3f6-f8d6-4617-945c-b641c08cb8e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a14de5-3b38-42db-9dba-d64011b8cee3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:32:35 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9fbbe1-eac4-4af0-a64d-d6cb608cca47]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG os_brick.utils [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Updating existing volume attachment record: c8f3383d-e195-441c-82d9-545b06803d8c {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG nova.compute.manager [req-e15728bb-1f17-4237-a4f2-8f28d5808e1c req-1f1ee194-5957-4e9d-b684-0768208398b7 service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Received event network-changed-a37cefd8-89f1-40f6-b0ed-68d450cbfbab {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG nova.compute.manager [req-e15728bb-1f17-4237-a4f2-8f28d5808e1c req-1f1ee194-5957-4e9d-b684-0768208398b7 service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Refreshing instance network info cache due to event network-changed-a37cefd8-89f1-40f6-b0ed-68d450cbfbab. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e15728bb-1f17-4237-a4f2-8f28d5808e1c req-1f1ee194-5957-4e9d-b684-0768208398b7 service nova] Acquiring lock "refresh_cache-79c02f2d-a143-4522-9054-369da11b54ba" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e15728bb-1f17-4237-a4f2-8f28d5808e1c req-1f1ee194-5957-4e9d-b684-0768208398b7 service nova] Acquired lock "refresh_cache-79c02f2d-a143-4522-9054-369da11b54ba" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:32:35 user nova-compute[72201]: DEBUG nova.network.neutron [req-e15728bb-1f17-4237-a4f2-8f28d5808e1c req-1f1ee194-5957-4e9d-b684-0768208398b7 service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Refreshing network info cache for port a37cefd8-89f1-40f6-b0ed-68d450cbfbab {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:32:36 user nova-compute[72201]: DEBUG nova.network.neutron [req-e15728bb-1f17-4237-a4f2-8f28d5808e1c req-1f1ee194-5957-4e9d-b684-0768208398b7 service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Updated VIF entry in instance network info cache for port a37cefd8-89f1-40f6-b0ed-68d450cbfbab. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:32:36 user nova-compute[72201]: DEBUG nova.network.neutron [req-e15728bb-1f17-4237-a4f2-8f28d5808e1c req-1f1ee194-5957-4e9d-b684-0768208398b7 service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Updating instance_info_cache with network_info: [{"id": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "address": "fa:16:3e:2e:3a:2f", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37cefd8-89", "ovs_interfaceid": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:32:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e15728bb-1f17-4237-a4f2-8f28d5808e1c req-1f1ee194-5957-4e9d-b684-0768208398b7 service nova] Releasing lock "refresh_cache-79c02f2d-a143-4522-9054-369da11b54ba" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:32:36 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903941.8609843, 865b371c-59c5-4004-8469-cdc1e9327ecb => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:32:36 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] VM Stopped (Lifecycle Event)
Aug 01 15:32:36 user nova-compute[72201]: DEBUG nova.compute.manager [None req-e61f55cf-0e62-4d67-a113-99e0caeb01a9 None None] [instance: 865b371c-59c5-4004-8469-cdc1e9327ecb] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:32:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:41 user nova-compute[72201]: INFO nova.compute.manager [None req-330fe76c-f596-47d4-a38e-386b42a4d505 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Unrescuing
Aug 01 15:32:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-330fe76c-f596-47d4-a38e-386b42a4d505 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "refresh_cache-9e946b4a-9b93-459f-8e5e-d88612c4ec34" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:32:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-330fe76c-f596-47d4-a38e-386b42a4d505 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquired lock "refresh_cache-9e946b4a-9b93-459f-8e5e-d88612c4ec34" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:32:41 user nova-compute[72201]: DEBUG nova.network.neutron [None req-330fe76c-f596-47d4-a38e-386b42a4d505 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:32:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG nova.network.neutron [None req-330fe76c-f596-47d4-a38e-386b42a4d505 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Updating instance_info_cache with network_info: [{"id": "983acc56-f35e-463b-9792-e837ce96710d", "address": "fa:16:3e:28:f5:cf", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983acc56-f3", "ovs_interfaceid": "983acc56-f35e-463b-9792-e837ce96710d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lLHXiZhJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:32:43 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:32:43 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:32:43 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-330fe76c-f596-47d4-a38e-386b42a4d505 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Releasing lock "refresh_cache-9e946b4a-9b93-459f-8e5e-d88612c4ec34" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG nova.objects.instance [None req-330fe76c-f596-47d4-a38e-386b42a4d505 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'flavor' on Instance uuid 9e946b4a-9b93-459f-8e5e-d88612c4ec34 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bb18e6-5ed0-49e4-a245-cc8321c70091]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:32:43 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf741e8-c4f4-4093-b29b-a0d063df2d21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568] added
Aug 01 15:32:43 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2438c926-4a7b-4e3e-bbb4-55b66f96584a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[825d824d-a953-424a-b68c-9572ef9a1325]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lLHXiZhJ {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lLHXiZhJ" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1531da03-c85a-49ae-bb47-6aa9c36adcb4]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lLHXiZhJ'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfc3322-eb2b-4c5e-8a71-35859179c334]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ecba54-c0dd-4563-8cfe-493f9eeb74aa]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:43 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:43 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:43 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:32:43 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:43 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:43 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:43 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:32:43 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffb1d35-cf1d-4370-ac09-fbd316449de9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568, portal: 172.16.0.220,3260]
Aug 01 15:32:43 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568, portal: 172.16.0.220,3260] successful.
Aug 01 15:32:43 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b4ba65-398d-4022-b7b7-cfbf9cb7d814]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-7a5b7ffe-ad41-4d39-b108-9626b35fdbae req-ab2abb0b-7f12-4154-be70-7fce3fa98cdf service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received event network-vif-unplugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7a5b7ffe-ad41-4d39-b108-9626b35fdbae req-ab2abb0b-7f12-4154-be70-7fce3fa98cdf service nova] Acquiring lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7a5b7ffe-ad41-4d39-b108-9626b35fdbae req-ab2abb0b-7f12-4154-be70-7fce3fa98cdf service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7a5b7ffe-ad41-4d39-b108-9626b35fdbae req-ab2abb0b-7f12-4154-be70-7fce3fa98cdf service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-7a5b7ffe-ad41-4d39-b108-9626b35fdbae req-ab2abb0b-7f12-4154-be70-7fce3fa98cdf service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] No waiting events found dispatching network-vif-unplugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:32:43 user nova-compute[72201]: WARNING nova.compute.manager [req-7a5b7ffe-ad41-4d39-b108-9626b35fdbae req-ab2abb0b-7f12-4154-be70-7fce3fa98cdf service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received unexpected event network-vif-unplugged-983acc56-f35e-463b-9792-e837ce96710d for instance with vm_state rescued and task_state unrescuing.
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb2c190-49b1-4ac4-86bf-71ddfafed7b8]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:43 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:43 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:43 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:32:43 user nova-compute[72201]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 (non-flash)
Aug 01 15:32:43 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:32:43 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:32:43 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:32:43 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:32:43 user nova-compute[72201]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 (non-flash)
Aug 01 15:32:43 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acad739-db99-484e-9da7-b591acfb4187]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lLHXiZhJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:43 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Instance destroyed successfully.
Aug 01 15:32:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:32:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23365626433343337', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:32:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365626433343337', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:32:44 user nova-compute[72201]: DEBUG nova.objects.instance [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lazy-loading 'flavor' on Instance uuid 79c02f2d-a143-4522-9054-369da11b54ba {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:32:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:32:44 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:32:44 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 15:32:44 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:32:44 user nova-compute[72201]:   <serial>8cc154e3-9191-4694-8ece-d4e80e189568</serial>
Aug 01 15:32:44 user nova-compute[72201]: </disk>
Aug 01 15:32:44 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:32:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:32:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:32:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] No VIF found with MAC fa:16:3e:2e:3a:2f, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:32:45 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903950.0734267, 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:32:45 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] VM Stopped (Lifecycle Event)
Aug 01 15:32:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-401dcea6-e0da-4e99-9663-683a2c27d2a7 None None] [instance: 2813e0b2-5480-4098-ab5f-9fe33c1eb3c2] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:32:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0793c0d1-6bcc-4560-9d49-748038463431 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "79c02f2d-a143-4522-9054-369da11b54ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.799s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-516165b8-7fd4-4ddf-8911-738832efd38c req-edd949bd-49b8-4847-84f9-5232aa8da689 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received event network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:32:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-516165b8-7fd4-4ddf-8911-738832efd38c req-edd949bd-49b8-4847-84f9-5232aa8da689 service nova] Acquiring lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-516165b8-7fd4-4ddf-8911-738832efd38c req-edd949bd-49b8-4847-84f9-5232aa8da689 service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-516165b8-7fd4-4ddf-8911-738832efd38c req-edd949bd-49b8-4847-84f9-5232aa8da689 service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-516165b8-7fd4-4ddf-8911-738832efd38c req-edd949bd-49b8-4847-84f9-5232aa8da689 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] No waiting events found dispatching network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:32:45 user nova-compute[72201]: WARNING nova.compute.manager [req-516165b8-7fd4-4ddf-8911-738832efd38c req-edd949bd-49b8-4847-84f9-5232aa8da689 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received unexpected event network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d for instance with vm_state rescued and task_state unrescuing.
Aug 01 15:32:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Removed pending event for 9e946b4a-9b93-459f-8e5e-d88612c4ec34 due to event {{(pid=72201) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903967.4484324, 9e946b4a-9b93-459f-8e5e-d88612c4ec34 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:32:47 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] VM Resumed (Lifecycle Event)
Aug 01 15:32:47 user nova-compute[72201]: DEBUG nova.compute.manager [None req-330fe76c-f596-47d4-a38e-386b42a4d505 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:32:47 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 15:32:47 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690903967.4569461, 9e946b4a-9b93-459f-8e5e-d88612c4ec34 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:32:47 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] VM Started (Lifecycle Event)
Aug 01 15:32:47 user nova-compute[72201]: DEBUG nova.compute.manager [req-d4ab0618-7a43-4fe1-af19-457c9b7fd9e9 req-9d71203c-82eb-4643-aeb7-9c977f0a1416 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received event network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d4ab0618-7a43-4fe1-af19-457c9b7fd9e9 req-9d71203c-82eb-4643-aeb7-9c977f0a1416 service nova] Acquiring lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d4ab0618-7a43-4fe1-af19-457c9b7fd9e9 req-9d71203c-82eb-4643-aeb7-9c977f0a1416 service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d4ab0618-7a43-4fe1-af19-457c9b7fd9e9 req-9d71203c-82eb-4643-aeb7-9c977f0a1416 service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG nova.compute.manager [req-d4ab0618-7a43-4fe1-af19-457c9b7fd9e9 req-9d71203c-82eb-4643-aeb7-9c977f0a1416 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] No waiting events found dispatching network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:32:47 user nova-compute[72201]: WARNING nova.compute.manager [req-d4ab0618-7a43-4fe1-af19-457c9b7fd9e9 req-9d71203c-82eb-4643-aeb7-9c977f0a1416 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received unexpected event network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d for instance with vm_state rescued and task_state unrescuing.
Aug 01 15:32:47 user nova-compute[72201]: DEBUG nova.compute.manager [req-d4ab0618-7a43-4fe1-af19-457c9b7fd9e9 req-9d71203c-82eb-4643-aeb7-9c977f0a1416 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received event network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d4ab0618-7a43-4fe1-af19-457c9b7fd9e9 req-9d71203c-82eb-4643-aeb7-9c977f0a1416 service nova] Acquiring lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d4ab0618-7a43-4fe1-af19-457c9b7fd9e9 req-9d71203c-82eb-4643-aeb7-9c977f0a1416 service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d4ab0618-7a43-4fe1-af19-457c9b7fd9e9 req-9d71203c-82eb-4643-aeb7-9c977f0a1416 service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG nova.compute.manager [req-d4ab0618-7a43-4fe1-af19-457c9b7fd9e9 req-9d71203c-82eb-4643-aeb7-9c977f0a1416 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] No waiting events found dispatching network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:32:47 user nova-compute[72201]: WARNING nova.compute.manager [req-d4ab0618-7a43-4fe1-af19-457c9b7fd9e9 req-9d71203c-82eb-4643-aeb7-9c977f0a1416 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received unexpected event network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d for instance with vm_state rescued and task_state unrescuing.
Aug 01 15:32:47 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be1cd663-ad51-4e1a-9abc-b50b4ce5629b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "bd70360d-30b8-47d5-b35e-adf0d28482dd" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be1cd663-ad51-4e1a-9abc-b50b4ce5629b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG nova.compute.manager [None req-be1cd663-ad51-4e1a-9abc-b50b4ce5629b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Going to confirm migration 1 {{(pid=72201) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903952.7231278, 3a2d865c-6c6c-49b1-a2d3-4afc63b10581 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:32:47 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] VM Stopped (Lifecycle Event)
Aug 01 15:32:47 user nova-compute[72201]: DEBUG nova.compute.manager [None req-53b25a59-2d23-4eed-871e-561dbac27ac8 None None] [instance: 3a2d865c-6c6c-49b1-a2d3-4afc63b10581] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be1cd663-ad51-4e1a-9abc-b50b4ce5629b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "refresh_cache-bd70360d-30b8-47d5-b35e-adf0d28482dd" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be1cd663-ad51-4e1a-9abc-b50b4ce5629b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquired lock "refresh_cache-bd70360d-30b8-47d5-b35e-adf0d28482dd" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG nova.network.neutron [None req-be1cd663-ad51-4e1a-9abc-b50b4ce5629b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:32:47 user nova-compute[72201]: DEBUG nova.objects.instance [None req-be1cd663-ad51-4e1a-9abc-b50b4ce5629b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lazy-loading 'info_cache' on Instance uuid bd70360d-30b8-47d5-b35e-adf0d28482dd {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:32:48 user nova-compute[72201]: DEBUG nova.network.neutron [None req-be1cd663-ad51-4e1a-9abc-b50b4ce5629b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Updating instance_info_cache with network_info: [{"id": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "address": "fa:16:3e:9c:ca:83", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9640f8a6-86", "ovs_interfaceid": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:32:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be1cd663-ad51-4e1a-9abc-b50b4ce5629b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Releasing lock "refresh_cache-bd70360d-30b8-47d5-b35e-adf0d28482dd" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:32:48 user nova-compute[72201]: DEBUG nova.objects.instance [None req-be1cd663-ad51-4e1a-9abc-b50b4ce5629b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lazy-loading 'migration_context' on Instance uuid bd70360d-30b8-47d5-b35e-adf0d28482dd {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:32:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be1cd663-ad51-4e1a-9abc-b50b4ce5629b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:32:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be1cd663-ad51-4e1a-9abc-b50b4ce5629b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:32:48 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-be1cd663-ad51-4e1a-9abc-b50b4ce5629b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:32:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:48 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-be1cd663-ad51-4e1a-9abc-b50b4ce5629b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:32:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be1cd663-ad51-4e1a-9abc-b50b4ce5629b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.514s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:49 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-be1cd663-ad51-4e1a-9abc-b50b4ce5629b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Deleted allocation for migration 39d76218-a07b-4517-b132-4e3fb4484638
Aug 01 15:32:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be1cd663-ad51-4e1a-9abc-b50b4ce5629b tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.570s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:32:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:32:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:03 user nova-compute[72201]: INFO nova.compute.manager [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Terminating instance
Aug 01 15:33:03 user nova-compute[72201]: DEBUG nova.compute.manager [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:33:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:03 user nova-compute[72201]: DEBUG nova.compute.manager [req-bfaff1bf-0e4e-45d2-b10a-ac7fe189784b req-2b20b944-786d-4098-bbbe-4d4e9ad51eb2 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received event network-vif-unplugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bfaff1bf-0e4e-45d2-b10a-ac7fe189784b req-2b20b944-786d-4098-bbbe-4d4e9ad51eb2 service nova] Acquiring lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bfaff1bf-0e4e-45d2-b10a-ac7fe189784b req-2b20b944-786d-4098-bbbe-4d4e9ad51eb2 service nova] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bfaff1bf-0e4e-45d2-b10a-ac7fe189784b req-2b20b944-786d-4098-bbbe-4d4e9ad51eb2 service nova] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:03 user nova-compute[72201]: DEBUG nova.compute.manager [req-bfaff1bf-0e4e-45d2-b10a-ac7fe189784b req-2b20b944-786d-4098-bbbe-4d4e9ad51eb2 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] No waiting events found dispatching network-vif-unplugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:33:03 user nova-compute[72201]: DEBUG nova.compute.manager [req-bfaff1bf-0e4e-45d2-b10a-ac7fe189784b req-2b20b944-786d-4098-bbbe-4d4e9ad51eb2 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received event network-vif-unplugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:33:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:04 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Instance destroyed successfully.
Aug 01 15:33:04 user nova-compute[72201]: DEBUG nova.objects.instance [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lazy-loading 'resources' on Instance uuid ed5f91f1-b3fd-4737-8ed6-fca13617bd6e {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:33:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:28:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-332406940',display_name='tempest-TestMinimumBasicScenario-server-332406940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-332406940',id=24,image_ref='c0670c94-fd3d-443f-aebb-0738f9376cbd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKu5FlU96T/URWJekboP/5eG4GC0WsZVMcgk5ed4tw6gP/YNDChRwoCs90mgM9aN2gDeP6FbbX+sbTNMsNmfUCqRJxGlzieVVBtAcJhgTqQ3WKEz5W5LDJ3fG3+AZ0MRA==',key_name='tempest-TestMinimumBasicScenario-1343136448',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:28:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5e1f59585b44545ae3ec0cdfa480fab',ramdisk_id='',reservation_id='r-eeuxjpbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c0670c94-fd3d-443f-aebb-0738f9376cbd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1524896067',owner_user_name='tempest-TestMinimumBasicScenario-1524896067-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:30:26Z,user_data=None,user_id='2c5267b768cf46958384d9ad4c585f82',uuid=ed5f91f1-b3fd-4737-8ed6-fca13617bd6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "address": "fa:16:3e:89:dd:94", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964ce05e-77", "ovs_interfaceid": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:33:04 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Converting VIF {"id": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "address": "fa:16:3e:89:dd:94", "network": {"id": "d1dbf82c-df93-48ae-b118-278943635ceb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506107377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5e1f59585b44545ae3ec0cdfa480fab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964ce05e-77", "ovs_interfaceid": "964ce05e-779d-4ccd-a19a-9c6832a9db28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:33:04 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:dd:94,bridge_name='br-int',has_traffic_filtering=True,id=964ce05e-779d-4ccd-a19a-9c6832a9db28,network=Network(d1dbf82c-df93-48ae-b118-278943635ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap964ce05e-77') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:33:04 user nova-compute[72201]: DEBUG os_vif [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:dd:94,bridge_name='br-int',has_traffic_filtering=True,id=964ce05e-779d-4ccd-a19a-9c6832a9db28,network=Network(d1dbf82c-df93-48ae-b118-278943635ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap964ce05e-77') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:33:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap964ce05e-77, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:33:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:04 user nova-compute[72201]: INFO os_vif [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:dd:94,bridge_name='br-int',has_traffic_filtering=True,id=964ce05e-779d-4ccd-a19a-9c6832a9db28,network=Network(d1dbf82c-df93-48ae-b118-278943635ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap964ce05e-77')
Aug 01 15:33:04 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Deleting instance files /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e_del
Aug 01 15:33:04 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Deletion of /opt/stack/data/nova/instances/ed5f91f1-b3fd-4737-8ed6-fca13617bd6e_del complete
Aug 01 15:33:04 user nova-compute[72201]: INFO nova.compute.manager [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 01 15:33:04 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:33:04 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:33:04 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:33:04 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:33:04 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Took 0.68 seconds to deallocate network for instance.
Aug 01 15:33:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-48565562-8be2-415b-bc9e-468791ea2bec req-930864c6-ecec-4e1f-a154-60ecb330de48 service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received event network-vif-deleted-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:05 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:33:05 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:33:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:05 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Deleted allocations for instance ed5f91f1-b3fd-4737-8ed6-fca13617bd6e
Aug 01 15:33:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-11262902-eecd-4228-89fe-128be4fdda7d tempest-TestMinimumBasicScenario-1524896067 tempest-TestMinimumBasicScenario-1524896067-project-member] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.134s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-cfe1a58e-e339-4e1c-95e2-ae7ccb8acedc req-ec5b0b1c-1189-4502-8430-45aeb35eab8a service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received event network-vif-plugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cfe1a58e-e339-4e1c-95e2-ae7ccb8acedc req-ec5b0b1c-1189-4502-8430-45aeb35eab8a service nova] Acquiring lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cfe1a58e-e339-4e1c-95e2-ae7ccb8acedc req-ec5b0b1c-1189-4502-8430-45aeb35eab8a service nova] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cfe1a58e-e339-4e1c-95e2-ae7ccb8acedc req-ec5b0b1c-1189-4502-8430-45aeb35eab8a service nova] Lock "ed5f91f1-b3fd-4737-8ed6-fca13617bd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-cfe1a58e-e339-4e1c-95e2-ae7ccb8acedc req-ec5b0b1c-1189-4502-8430-45aeb35eab8a service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] No waiting events found dispatching network-vif-plugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:33:05 user nova-compute[72201]: WARNING nova.compute.manager [req-cfe1a58e-e339-4e1c-95e2-ae7ccb8acedc req-ec5b0b1c-1189-4502-8430-45aeb35eab8a service nova] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Received unexpected event network-vif-plugged-964ce05e-779d-4ccd-a19a-9c6832a9db28 for instance with vm_state deleted and task_state None.
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquiring lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:07 user nova-compute[72201]: INFO nova.compute.manager [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Detaching volume 427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9
Aug 01 15:33:07 user nova-compute[72201]: INFO nova.virt.block_device [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Attempting to driver detach volume 427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 from mountpoint /dev/vdb
Aug 01 15:33:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Attempting to detach device vdb from instance eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:33:07 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:33:07 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 15:33:07 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:33:07 user nova-compute[72201]:   <serial>427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9</serial>
Aug 01 15:33:07 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:33:07 user nova-compute[72201]: </disk>
Aug 01 15:33:07 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:33:07 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Successfully detached device vdb from instance eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 from the persistent domain config.
Aug 01 15:33:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:33:07 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:33:07 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 15:33:07 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:33:07 user nova-compute[72201]:   <serial>427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9</serial>
Aug 01 15:33:07 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:33:07 user nova-compute[72201]: </disk>
Aug 01 15:33:07 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690903987.5651252, eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:33:07 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Successfully detached device vdb from instance eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 from the live domain config.
Aug 01 15:33:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JwCIDdut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:33:07 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:33:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[26137744-71cd-4493-bf5a-d4b4f7b18a7c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9da3f1-dace-42e0-9c09-26e0d07bc462]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:33:07 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:33:07 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:33:07 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:33:07 user nova-compute[72201]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 (non-flash)
Aug 01 15:33:07 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:33:07 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:33:07 user nova-compute[72201]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 (non-flash)
Aug 01 15:33:07 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:33:07 user nova-compute[72201]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 (non-flash)
Aug 01 15:33:07 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c410040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9'): ({'sdc'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Removing single pathed devices sdc {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8915854c-fce4-4adb-a1a8-4d6eb3273d9b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b01f5f6-1a8f-469e-8afc-59ec35d8a718]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Flushing IO for device /dev/sdc {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8edaf3-f6d8-498b-83d3-b9df868d0a21]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d314a547-2de1-40f8-ae96-3e25e7f43663]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[414abb1b-1eef-40be-a339-f9c2869e5de3]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20eb203-3dbf-40de-8234-b6350ec5567a]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9, portal: 172.16.0.220,3260]
Aug 01 15:33:07 user nova-compute[72201]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9, portal: 172.16.0.220,3260] successful.
Aug 01 15:33:07 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427c3ba5-b47d-4863-b4a0-0ff42cbdf8c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[268fa9f1-5293-40e6-8bc0-df53c3c5b447]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] <== disconnect_volume: return (284ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:33:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:33:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:33:08 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:33:08 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 15:33:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-b64f1cfb-64f2-4493-8721-fc63fcd93bb6" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:33:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-b64f1cfb-64f2-4493-8721-fc63fcd93bb6" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:33:08 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:33:08 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid b64f1cfb-64f2-4493-8721-fc63fcd93bb6 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:33:08 user nova-compute[72201]: DEBUG nova.objects.instance [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lazy-loading 'flavor' on Instance uuid eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:33:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c4523028-b649-4642-b5b8-e599917ec5d2 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.818s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:09 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Updating instance_info_cache with network_info: [{"id": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "address": "fa:16:3e:5d:24:e6", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8b84b-6b", "ovs_interfaceid": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:33:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-b64f1cfb-64f2-4493-8721-fc63fcd93bb6" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:33:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:33:09 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:33:09 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:33:09 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:33:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:33:10 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "a90b8dec-8529-4658-bf18-c5047c17c329" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "a90b8dec-8529-4658-bf18-c5047c17c329" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "a90b8dec-8529-4658-bf18-c5047c17c329-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "a90b8dec-8529-4658-bf18-c5047c17c329-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "a90b8dec-8529-4658-bf18-c5047c17c329-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:11 user nova-compute[72201]: INFO nova.compute.manager [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Terminating instance
Aug 01 15:33:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG nova.compute.manager [req-a2c973ba-57f7-43ec-af29-427ab961b027 req-6d834ce5-1dba-4e69-8a65-201ac16461c3 service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Received event network-vif-unplugged-14be95c0-4142-4241-89d8-2a084782c959 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a2c973ba-57f7-43ec-af29-427ab961b027 req-6d834ce5-1dba-4e69-8a65-201ac16461c3 service nova] Acquiring lock "a90b8dec-8529-4658-bf18-c5047c17c329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a2c973ba-57f7-43ec-af29-427ab961b027 req-6d834ce5-1dba-4e69-8a65-201ac16461c3 service nova] Lock "a90b8dec-8529-4658-bf18-c5047c17c329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a2c973ba-57f7-43ec-af29-427ab961b027 req-6d834ce5-1dba-4e69-8a65-201ac16461c3 service nova] Lock "a90b8dec-8529-4658-bf18-c5047c17c329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG nova.compute.manager [req-a2c973ba-57f7-43ec-af29-427ab961b027 req-6d834ce5-1dba-4e69-8a65-201ac16461c3 service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] No waiting events found dispatching network-vif-unplugged-14be95c0-4142-4241-89d8-2a084782c959 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG nova.compute.manager [req-a2c973ba-57f7-43ec-af29-427ab961b027 req-6d834ce5-1dba-4e69-8a65-201ac16461c3 service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Received event network-vif-unplugged-14be95c0-4142-4241-89d8-2a084782c959 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:33:11 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Instance destroyed successfully.
Aug 01 15:33:11 user nova-compute[72201]: DEBUG nova.objects.instance [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lazy-loading 'resources' on Instance uuid a90b8dec-8529-4658-bf18-c5047c17c329 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:30:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-509928076',display_name='tempest-AttachVolumeNegativeTest-server-509928076',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-509928076',id=29,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeLxMiAHgYOHkydr1wZlfA2VWFtcWSO7Ia5NXoKQZgGVFqIbbrt6GyZW7GKvoTncZF05nwXtRUTNecvmf+eHCebn/MtWWmaWOSqwM87zUNmGLQLDLKQ8z/WTRPHlmRV9A==',key_name='tempest-keypair-2107548255',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:30:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='548641aee9954aa48c567e798b4be247',ramdisk_id='',reservation_id='r-5gk9hj7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2028543234',owner_user_name='tempest-AttachVolumeNegativeTest-2028543234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:30:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd505dbb02e4d3d8e8f97839b25ed22',uuid=a90b8dec-8529-4658-bf18-c5047c17c329,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14be95c0-4142-4241-89d8-2a084782c959", "address": "fa:16:3e:b5:d0:21", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14be95c0-41", "ovs_interfaceid": "14be95c0-4142-4241-89d8-2a084782c959", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converting VIF {"id": "14be95c0-4142-4241-89d8-2a084782c959", "address": "fa:16:3e:b5:d0:21", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14be95c0-41", "ovs_interfaceid": "14be95c0-4142-4241-89d8-2a084782c959", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:d0:21,bridge_name='br-int',has_traffic_filtering=True,id=14be95c0-4142-4241-89d8-2a084782c959,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14be95c0-41') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG os_vif [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:d0:21,bridge_name='br-int',has_traffic_filtering=True,id=14be95c0-4142-4241-89d8-2a084782c959,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14be95c0-41') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14be95c0-41, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:11 user nova-compute[72201]: INFO os_vif [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:d0:21,bridge_name='br-int',has_traffic_filtering=True,id=14be95c0-4142-4241-89d8-2a084782c959,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14be95c0-41')
Aug 01 15:33:11 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Deleting instance files /opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329_del
Aug 01 15:33:11 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Deletion of /opt/stack/data/nova/instances/a90b8dec-8529-4658-bf18-c5047c17c329_del complete
Aug 01 15:33:12 user nova-compute[72201]: INFO nova.compute.manager [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "79c02f2d-a143-4522-9054-369da11b54ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "79c02f2d-a143-4522-9054-369da11b54ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:12 user nova-compute[72201]: INFO nova.compute.manager [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Detaching volume 8cc154e3-9191-4694-8ece-d4e80e189568
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:33:12 user nova-compute[72201]: INFO nova.virt.block_device [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Attempting to driver detach volume 8cc154e3-9191-4694-8ece-d4e80e189568 from mountpoint /dev/vdb
Aug 01 15:33:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Attempting to detach device vdb from instance 79c02f2d-a143-4522-9054-369da11b54ba from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:33:12 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:33:12 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 15:33:12 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:33:12 user nova-compute[72201]:   <serial>8cc154e3-9191-4694-8ece-d4e80e189568</serial>
Aug 01 15:33:12 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:33:12 user nova-compute[72201]: </disk>
Aug 01 15:33:12 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "79c02f2d-a143-4522-9054-369da11b54ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:12 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Successfully detached device vdb from instance 79c02f2d-a143-4522-9054-369da11b54ba from the persistent domain config.
Aug 01 15:33:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 79c02f2d-a143-4522-9054-369da11b54ba from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:33:12 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:33:12 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 15:33:12 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:33:12 user nova-compute[72201]:   <serial>8cc154e3-9191-4694-8ece-d4e80e189568</serial>
Aug 01 15:33:12 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:33:12 user nova-compute[72201]: </disk>
Aug 01 15:33:12 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690903992.6704025, 79c02f2d-a143-4522-9054-369da11b54ba => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 79c02f2d-a143-4522-9054-369da11b54ba {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:33:12 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Successfully detached device vdb from instance 79c02f2d-a143-4522-9054-369da11b54ba from the live domain config.
Aug 01 15:33:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lLHXiZhJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:33:12 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:33:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95ff31c-1a22-40ac-8fea-143245ad52b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b58c6a8-6c25-42a8-b444-f131867c2975]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:33:12 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:33:12 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:33:12 user nova-compute[72201]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 (non-flash)
Aug 01 15:33:12 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:33:12 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:33:12 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:33:12 user nova-compute[72201]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 (non-flash)
Aug 01 15:33:12 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5441bc5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568'): ({'sdb'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Removing single pathed devices sdb {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc563aa5-8288-4696-b895-bc582b047665]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23bf1f7-a3d8-41f9-93be-4a20057651a0]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Flushing IO for device /dev/sdb {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cbcf34-bb97-4194-af6c-17376bf7ff62]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3199054d-52f8-4467-9813-3af63aa6c122]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02f4169-4d1a-458e-b0b3-9edd429685b7]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b4cfda-fb94-45a6-9258-594b023b50dc]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568, portal: 172.16.0.220,3260]
Aug 01 15:33:12 user nova-compute[72201]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568, portal: 172.16.0.220,3260] successful.
Aug 01 15:33:12 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb4c5e5-c6bc-4bcd-a334-211cc3139963]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] <== disconnect_volume: return (309ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:33:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:33:13 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Took 1.10 seconds to deallocate network for instance.
Aug 01 15:33:13 user nova-compute[72201]: DEBUG nova.compute.manager [req-16f906aa-24e9-4e42-ab6b-3fa7f7c60208 req-37809510-1157-4cf0-b264-c6948e06ccbe service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Received event network-vif-deleted-14be95c0-4142-4241-89d8-2a084782c959 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:13 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Deleted allocations for instance a90b8dec-8529-4658-bf18-c5047c17c329
Aug 01 15:33:13 user nova-compute[72201]: DEBUG nova.compute.manager [req-85ddda9b-03c3-4262-93f0-f5727331bab5 req-3c1e6b46-f495-4558-8e54-bf14cbe08238 service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Received event network-vif-plugged-14be95c0-4142-4241-89d8-2a084782c959 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-85ddda9b-03c3-4262-93f0-f5727331bab5 req-3c1e6b46-f495-4558-8e54-bf14cbe08238 service nova] Acquiring lock "a90b8dec-8529-4658-bf18-c5047c17c329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-85ddda9b-03c3-4262-93f0-f5727331bab5 req-3c1e6b46-f495-4558-8e54-bf14cbe08238 service nova] Lock "a90b8dec-8529-4658-bf18-c5047c17c329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-85ddda9b-03c3-4262-93f0-f5727331bab5 req-3c1e6b46-f495-4558-8e54-bf14cbe08238 service nova] Lock "a90b8dec-8529-4658-bf18-c5047c17c329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG nova.compute.manager [req-85ddda9b-03c3-4262-93f0-f5727331bab5 req-3c1e6b46-f495-4558-8e54-bf14cbe08238 service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] No waiting events found dispatching network-vif-plugged-14be95c0-4142-4241-89d8-2a084782c959 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:33:13 user nova-compute[72201]: WARNING nova.compute.manager [req-85ddda9b-03c3-4262-93f0-f5727331bab5 req-3c1e6b46-f495-4558-8e54-bf14cbe08238 service nova] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Received unexpected event network-vif-plugged-14be95c0-4142-4241-89d8-2a084782c959 for instance with vm_state deleted and task_state None.
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG nova.objects.instance [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lazy-loading 'flavor' on Instance uuid 79c02f2d-a143-4522-9054-369da11b54ba {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd360e79-f648-4ac8-b030-cf0965af75c6 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "a90b8dec-8529-4658-bf18-c5047c17c329" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.670s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eed168eb-ecae-4081-a846-1df6d1f4d27d tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "79c02f2d-a143-4522-9054-369da11b54ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.776s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "79c02f2d-a143-4522-9054-369da11b54ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.665s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "79c02f2d-a143-4522-9054-369da11b54ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "79c02f2d-a143-4522-9054-369da11b54ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "79c02f2d-a143-4522-9054-369da11b54ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:13 user nova-compute[72201]: INFO nova.compute.manager [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Terminating instance
Aug 01 15:33:13 user nova-compute[72201]: DEBUG nova.compute.manager [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:14 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Instance destroyed successfully.
Aug 01 15:33:14 user nova-compute[72201]: DEBUG nova.objects.instance [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lazy-loading 'resources' on Instance uuid 79c02f2d-a143-4522-9054-369da11b54ba {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1571001394',display_name='tempest-VolumesSnapshotTestJSON-instance-1571001394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1571001394',id=30,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDm8Bc5YsS3vm7aQlzAJa8MjUuHiiEnTag9i8ctsR644Y0O/g3V45e7cX217PMUm7oc7UheCit1YbaZqZ8jNRDwXLI1RagQ7xKpeT1lVGgXY/inHK8JU7f9SAXFI7t+lFQ==',key_name='tempest-keypair-1008891001',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:30:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c85969cbfd374ba484cccd0f89fcf3be',ramdisk_id='',reservation_id='r-h0rb6c4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-840662389',owner_user_name='tempest-VolumesSnapshotTestJSON-840662389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:30:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='488991a215a64482a71cb25f3ecd9f0f',uuid=79c02f2d-a143-4522-9054-369da11b54ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "address": "fa:16:3e:2e:3a:2f", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37cefd8-89", "ovs_interfaceid": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Converting VIF {"id": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "address": "fa:16:3e:2e:3a:2f", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37cefd8-89", "ovs_interfaceid": "a37cefd8-89f1-40f6-b0ed-68d450cbfbab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:3a:2f,bridge_name='br-int',has_traffic_filtering=True,id=a37cefd8-89f1-40f6-b0ed-68d450cbfbab,network=Network(5b881fdd-ff08-42a6-aa9c-3ec904123af2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37cefd8-89') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG os_vif [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:3a:2f,bridge_name='br-int',has_traffic_filtering=True,id=a37cefd8-89f1-40f6-b0ed-68d450cbfbab,network=Network(5b881fdd-ff08-42a6-aa9c-3ec904123af2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37cefd8-89') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa37cefd8-89, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:33:14 user nova-compute[72201]: INFO os_vif [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:3a:2f,bridge_name='br-int',has_traffic_filtering=True,id=a37cefd8-89f1-40f6-b0ed-68d450cbfbab,network=Network(5b881fdd-ff08-42a6-aa9c-3ec904123af2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37cefd8-89')
Aug 01 15:33:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lLHXiZhJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:33:14 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:33:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cc154e3-9191-4694-8ece-d4e80e189568', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec79885e-fd44-4c0d-b399-8b16739a7f76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b894edc-ec57-4f84-a256-87b3d8ae2a34]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:33:14 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:33:14 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:33:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:33:14 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:33:14 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:33:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c1815a0>, {}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Disconnecting from: [] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.047s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] <== disconnect_volume: return (49ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:33:14 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Deleting instance files /opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba_del
Aug 01 15:33:14 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Deletion of /opt/stack/data/nova/instances/79c02f2d-a143-4522-9054-369da11b54ba_del complete
Aug 01 15:33:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:14 user nova-compute[72201]: INFO nova.compute.manager [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 01 15:33:14 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:33:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG nova.compute.manager [req-e07b1e22-47d0-4e3f-ae4f-90e2697d5cbe req-70d8f85b-537f-4f6a-810b-7b83c9822195 service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Received event network-vif-unplugged-a37cefd8-89f1-40f6-b0ed-68d450cbfbab {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e07b1e22-47d0-4e3f-ae4f-90e2697d5cbe req-70d8f85b-537f-4f6a-810b-7b83c9822195 service nova] Acquiring lock "79c02f2d-a143-4522-9054-369da11b54ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e07b1e22-47d0-4e3f-ae4f-90e2697d5cbe req-70d8f85b-537f-4f6a-810b-7b83c9822195 service nova] Lock "79c02f2d-a143-4522-9054-369da11b54ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e07b1e22-47d0-4e3f-ae4f-90e2697d5cbe req-70d8f85b-537f-4f6a-810b-7b83c9822195 service nova] Lock "79c02f2d-a143-4522-9054-369da11b54ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG nova.compute.manager [req-e07b1e22-47d0-4e3f-ae4f-90e2697d5cbe req-70d8f85b-537f-4f6a-810b-7b83c9822195 service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] No waiting events found dispatching network-vif-unplugged-a37cefd8-89f1-40f6-b0ed-68d450cbfbab {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG nova.compute.manager [req-e07b1e22-47d0-4e3f-ae4f-90e2697d5cbe req-70d8f85b-537f-4f6a-810b-7b83c9822195 service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Received event network-vif-unplugged-a37cefd8-89f1-40f6-b0ed-68d450cbfbab for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG nova.compute.manager [req-e07b1e22-47d0-4e3f-ae4f-90e2697d5cbe req-70d8f85b-537f-4f6a-810b-7b83c9822195 service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Received event network-vif-plugged-a37cefd8-89f1-40f6-b0ed-68d450cbfbab {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e07b1e22-47d0-4e3f-ae4f-90e2697d5cbe req-70d8f85b-537f-4f6a-810b-7b83c9822195 service nova] Acquiring lock "79c02f2d-a143-4522-9054-369da11b54ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e07b1e22-47d0-4e3f-ae4f-90e2697d5cbe req-70d8f85b-537f-4f6a-810b-7b83c9822195 service nova] Lock "79c02f2d-a143-4522-9054-369da11b54ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e07b1e22-47d0-4e3f-ae4f-90e2697d5cbe req-70d8f85b-537f-4f6a-810b-7b83c9822195 service nova] Lock "79c02f2d-a143-4522-9054-369da11b54ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG nova.compute.manager [req-e07b1e22-47d0-4e3f-ae4f-90e2697d5cbe req-70d8f85b-537f-4f6a-810b-7b83c9822195 service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] No waiting events found dispatching network-vif-plugged-a37cefd8-89f1-40f6-b0ed-68d450cbfbab {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:33:15 user nova-compute[72201]: WARNING nova.compute.manager [req-e07b1e22-47d0-4e3f-ae4f-90e2697d5cbe req-70d8f85b-537f-4f6a-810b-7b83c9822195 service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Received unexpected event network-vif-plugged-a37cefd8-89f1-40f6-b0ed-68d450cbfbab for instance with vm_state active and task_state deleting.
Aug 01 15:33:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG nova.compute.manager [req-ff58cd20-c2ae-4737-ba85-f97cb91e5e23 req-01025152-341c-4ea3-9b95-afb7b6fbd3ee service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Received event network-vif-deleted-a37cefd8-89f1-40f6-b0ed-68d450cbfbab {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:15 user nova-compute[72201]: INFO nova.compute.manager [req-ff58cd20-c2ae-4737-ba85-f97cb91e5e23 req-01025152-341c-4ea3-9b95-afb7b6fbd3ee service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Neutron deleted interface a37cefd8-89f1-40f6-b0ed-68d450cbfbab; detaching it from the instance and deleting it from the info cache
Aug 01 15:33:15 user nova-compute[72201]: DEBUG nova.network.neutron [req-ff58cd20-c2ae-4737-ba85-f97cb91e5e23 req-01025152-341c-4ea3-9b95-afb7b6fbd3ee service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG nova.compute.manager [req-ff58cd20-c2ae-4737-ba85-f97cb91e5e23 req-01025152-341c-4ea3-9b95-afb7b6fbd3ee service nova] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Detach interface failed, port_id=a37cefd8-89f1-40f6-b0ed-68d450cbfbab, reason: Instance 79c02f2d-a143-4522-9054-369da11b54ba could not be found. {{(pid=72201) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 15:33:15 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Took 1.09 seconds to deallocate network for instance.
Aug 01 15:33:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:15 user nova-compute[72201]: WARNING nova.volume.cinder [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Attachment c8f3383d-e195-441c-82d9-545b06803d8c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c8f3383d-e195-441c-82d9-545b06803d8c. (HTTP 404) (Request-ID: req-cdae4241-950b-452d-8b45-1599ea859291)
Aug 01 15:33:15 user nova-compute[72201]: INFO nova.compute.manager [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Took 0.03 seconds to detach 1 volumes for instance.
Aug 01 15:33:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:33:15 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Error from libvirt while getting description of instance-0000001e: [Error Code 42] Domain not found: no domain with matching uuid '79c02f2d-a143-4522-9054-369da11b54ba' (instance-0000001e): libvirt.libvirtError: Domain not found: no domain with matching uuid '79c02f2d-a143-4522-9054-369da11b54ba' (instance-0000001e)
Aug 01 15:33:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:16 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:33:16 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:33:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=7218MB free_disk=25.205081939697266GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:33:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:16 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:33:16 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:33:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.411s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:16 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Deleted allocations for instance 79c02f2d-a143-4522-9054-369da11b54ba
Aug 01 15:33:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Applying migration context for instance 9530577b-69a6-45bc-a33b-1dc60d69a16f as it has an incoming, in-progress migration 7d266d84-6760-4fef-9ee0-849b99a23ad5. Migration status is finished {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 15:33:16 user nova-compute[72201]: INFO nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Updating resource usage from migration 7d266d84-6760-4fef-9ee0-849b99a23ad5
Aug 01 15:33:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5630381e-b313-4380-a592-7a8f2110c2d1 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "79c02f2d-a143-4522-9054-369da11b54ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.066s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance b64f1cfb-64f2-4493-8721-fc63fcd93bb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:33:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e2ca19ea-868c-40ad-a453-f6e348cfac15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:33:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 0f059ccc-f609-4cf3-a644-c3d1305ae26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:33:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 14e890ca-dc2a-4d89-a497-d55805d0c42e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:33:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 9e946b4a-9b93-459f-8e5e-d88612c4ec34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:33:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:33:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance bd70360d-30b8-47d5-b35e-adf0d28482dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:33:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Migration 7d266d84-6760-4fef-9ee0-849b99a23ad5 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 15:33:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 9530577b-69a6-45bc-a33b-1dc60d69a16f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:33:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:33:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:33:17 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:33:17 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:33:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:33:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:18 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:33:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:19 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903984.0402138, ed5f91f1-b3fd-4737-8ed6-fca13617bd6e => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:33:19 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] VM Stopped (Lifecycle Event)
Aug 01 15:33:19 user nova-compute[72201]: DEBUG nova.compute.manager [None req-db2c9fe0-fa24-4ef1-b158-63fed121112b None None] [instance: ed5f91f1-b3fd-4737-8ed6-fca13617bd6e] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:33:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Acquiring lock "929ed2b3-a72e-424e-94c4-352c207442ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "929ed2b3-a72e-424e-94c4-352c207442ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:26 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:33:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:26 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:33:26 user nova-compute[72201]: INFO nova.compute.claims [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Claim successful on node user
Aug 01 15:33:26 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:33:26 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903991.9213972, a90b8dec-8529-4658-bf18-c5047c17c329 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:33:26 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] VM Stopped (Lifecycle Event)
Aug 01 15:33:26 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:33:26 user nova-compute[72201]: DEBUG nova.compute.manager [None req-082c5322-f7e5-475d-b720-3a3a298961da None None] [instance: a90b8dec-8529-4658-bf18-c5047c17c329] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:33:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:26 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:33:27 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:33:27 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG nova.policy [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '382a20da0cdd454181d19da58d22551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0e2836d3794cd8b26b8f54a73af7e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:33:27 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Creating image(s)
Aug 01 15:33:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Acquiring lock "/opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "/opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "/opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk 1073741824" returned: 0 in 0.062s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.148s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Checking if we can resize image /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Successfully created port: 112cdddb-0763-476b-a269-aed7d05c7856 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Cannot resize image /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG nova.objects.instance [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lazy-loading 'migration_context' on Instance uuid 929ed2b3-a72e-424e-94c4-352c207442ec {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Ensure instance console log exists: /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:28 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Successfully updated port: 112cdddb-0763-476b-a269-aed7d05c7856 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:33:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Acquiring lock "refresh_cache-929ed2b3-a72e-424e-94c4-352c207442ec" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:33:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Acquired lock "refresh_cache-929ed2b3-a72e-424e-94c4-352c207442ec" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:33:28 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:33:28 user nova-compute[72201]: DEBUG nova.compute.manager [req-d7d1e971-ce45-4b68-ae9c-e856a94452a8 req-afb58d1a-008a-4e21-a36f-771211eba0e8 service nova] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Received event network-changed-112cdddb-0763-476b-a269-aed7d05c7856 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:28 user nova-compute[72201]: DEBUG nova.compute.manager [req-d7d1e971-ce45-4b68-ae9c-e856a94452a8 req-afb58d1a-008a-4e21-a36f-771211eba0e8 service nova] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Refreshing instance network info cache due to event network-changed-112cdddb-0763-476b-a269-aed7d05c7856. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:33:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d7d1e971-ce45-4b68-ae9c-e856a94452a8 req-afb58d1a-008a-4e21-a36f-771211eba0e8 service nova] Acquiring lock "refresh_cache-929ed2b3-a72e-424e-94c4-352c207442ec" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Updating instance_info_cache with network_info: [{"id": "112cdddb-0763-476b-a269-aed7d05c7856", "address": "fa:16:3e:66:f3:81", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112cdddb-07", "ovs_interfaceid": "112cdddb-0763-476b-a269-aed7d05c7856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Releasing lock "refresh_cache-929ed2b3-a72e-424e-94c4-352c207442ec" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Instance network_info: |[{"id": "112cdddb-0763-476b-a269-aed7d05c7856", "address": "fa:16:3e:66:f3:81", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112cdddb-07", "ovs_interfaceid": "112cdddb-0763-476b-a269-aed7d05c7856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d7d1e971-ce45-4b68-ae9c-e856a94452a8 req-afb58d1a-008a-4e21-a36f-771211eba0e8 service nova] Acquired lock "refresh_cache-929ed2b3-a72e-424e-94c4-352c207442ec" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.network.neutron [req-d7d1e971-ce45-4b68-ae9c-e856a94452a8 req-afb58d1a-008a-4e21-a36f-771211eba0e8 service nova] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Refreshing network info cache for port 112cdddb-0763-476b-a269-aed7d05c7856 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Start _get_guest_xml network_info=[{"id": "112cdddb-0763-476b-a269-aed7d05c7856", "address": "fa:16:3e:66:f3:81", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112cdddb-07", "ovs_interfaceid": "112cdddb-0763-476b-a269-aed7d05c7856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:33:29 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:33:29 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:33:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1889734490',display_name='tempest-ServersNegativeTestJSON-server-1889734490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1889734490',id=31,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce0e2836d3794cd8b26b8f54a73af7e7',ramdisk_id='',reservation_id='r-0yu0memm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-592631034',owner_user_name='tempest-ServersNegativeTestJSON-592631034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:33:27Z,user_data=None,user_id='382a20da0cdd454181d19da58d22551a',uuid=929ed2b3-a72e-424e-94c4-352c207442ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "112cdddb-0763-476b-a269-aed7d05c7856", "address": "fa:16:3e:66:f3:81", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112cdddb-07", "ovs_interfaceid": "112cdddb-0763-476b-a269-aed7d05c7856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Converting VIF {"id": "112cdddb-0763-476b-a269-aed7d05c7856", "address": "fa:16:3e:66:f3:81", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112cdddb-07", "ovs_interfaceid": "112cdddb-0763-476b-a269-aed7d05c7856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:f3:81,bridge_name='br-int',has_traffic_filtering=True,id=112cdddb-0763-476b-a269-aed7d05c7856,network=Network(76e721f1-1135-4932-9d27-41c013b3c149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112cdddb-07') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.objects.instance [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lazy-loading 'pci_devices' on Instance uuid 929ed2b3-a72e-424e-94c4-352c207442ec {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:33:29 user nova-compute[72201]:   <uuid>929ed2b3-a72e-424e-94c4-352c207442ec</uuid>
Aug 01 15:33:29 user nova-compute[72201]:   <name>instance-0000001f</name>
Aug 01 15:33:29 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:33:29 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:33:29 user nova-compute[72201]:   <metadata>
Aug 01 15:33:29 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:33:29 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:33:29 user nova-compute[72201]:       <nova:name>tempest-ServersNegativeTestJSON-server-1889734490</nova:name>
Aug 01 15:33:29 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:33:29</nova:creationTime>
Aug 01 15:33:29 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:33:29 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:33:29 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:33:29 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:33:29 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:33:29 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:33:29 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:33:29 user nova-compute[72201]:       <nova:owner>
Aug 01 15:33:29 user nova-compute[72201]:         <nova:user uuid="382a20da0cdd454181d19da58d22551a">tempest-ServersNegativeTestJSON-592631034-project-member</nova:user>
Aug 01 15:33:29 user nova-compute[72201]:         <nova:project uuid="ce0e2836d3794cd8b26b8f54a73af7e7">tempest-ServersNegativeTestJSON-592631034</nova:project>
Aug 01 15:33:29 user nova-compute[72201]:       </nova:owner>
Aug 01 15:33:29 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:33:29 user nova-compute[72201]:       <nova:ports>
Aug 01 15:33:29 user nova-compute[72201]:         <nova:port uuid="112cdddb-0763-476b-a269-aed7d05c7856">
Aug 01 15:33:29 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 15:33:29 user nova-compute[72201]:         </nova:port>
Aug 01 15:33:29 user nova-compute[72201]:       </nova:ports>
Aug 01 15:33:29 user nova-compute[72201]:     </nova:instance>
Aug 01 15:33:29 user nova-compute[72201]:   </metadata>
Aug 01 15:33:29 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:33:29 user nova-compute[72201]:     <system>
Aug 01 15:33:29 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:33:29 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:33:29 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:33:29 user nova-compute[72201]:       <entry name="serial">929ed2b3-a72e-424e-94c4-352c207442ec</entry>
Aug 01 15:33:29 user nova-compute[72201]:       <entry name="uuid">929ed2b3-a72e-424e-94c4-352c207442ec</entry>
Aug 01 15:33:29 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:33:29 user nova-compute[72201]:     </system>
Aug 01 15:33:29 user nova-compute[72201]:   </sysinfo>
Aug 01 15:33:29 user nova-compute[72201]:   <os>
Aug 01 15:33:29 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:33:29 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:33:29 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:33:29 user nova-compute[72201]:   </os>
Aug 01 15:33:29 user nova-compute[72201]:   <features>
Aug 01 15:33:29 user nova-compute[72201]:     <acpi/>
Aug 01 15:33:29 user nova-compute[72201]:     <apic/>
Aug 01 15:33:29 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:33:29 user nova-compute[72201]:   </features>
Aug 01 15:33:29 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:33:29 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:33:29 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:33:29 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:33:29 user nova-compute[72201]:   </clock>
Aug 01 15:33:29 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:33:29 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:33:29 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:33:29 user nova-compute[72201]:   </cpu>
Aug 01 15:33:29 user nova-compute[72201]:   <devices>
Aug 01 15:33:29 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:33:29 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:33:29 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk"/>
Aug 01 15:33:29 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:33:29 user nova-compute[72201]:     </disk>
Aug 01 15:33:29 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:33:29 user nova-compute[72201]:       <mac address="fa:16:3e:66:f3:81"/>
Aug 01 15:33:29 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:33:29 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:33:29 user nova-compute[72201]:       <target dev="tap112cdddb-07"/>
Aug 01 15:33:29 user nova-compute[72201]:     </interface>
Aug 01 15:33:29 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:33:29 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/console.log" append="off"/>
Aug 01 15:33:29 user nova-compute[72201]:     </serial>
Aug 01 15:33:29 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:33:29 user nova-compute[72201]:     <video>
Aug 01 15:33:29 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:33:29 user nova-compute[72201]:     </video>
Aug 01 15:33:29 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:33:29 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:33:29 user nova-compute[72201]:     </rng>
Aug 01 15:33:29 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:33:29 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:33:29 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:33:29 user nova-compute[72201]:     </memballoon>
Aug 01 15:33:29 user nova-compute[72201]:   </devices>
Aug 01 15:33:29 user nova-compute[72201]: </domain>
Aug 01 15:33:29 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:33:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1889734490',display_name='tempest-ServersNegativeTestJSON-server-1889734490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1889734490',id=31,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce0e2836d3794cd8b26b8f54a73af7e7',ramdisk_id='',reservation_id='r-0yu0memm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-592631034',owner_user_name='tempest-ServersNegativeTestJSON-592631034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:33:27Z,user_data=None,user_id='382a20da0cdd454181d19da58d22551a',uuid=929ed2b3-a72e-424e-94c4-352c207442ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "112cdddb-0763-476b-a269-aed7d05c7856", "address": "fa:16:3e:66:f3:81", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112cdddb-07", "ovs_interfaceid": "112cdddb-0763-476b-a269-aed7d05c7856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Converting VIF {"id": "112cdddb-0763-476b-a269-aed7d05c7856", "address": "fa:16:3e:66:f3:81", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112cdddb-07", "ovs_interfaceid": "112cdddb-0763-476b-a269-aed7d05c7856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:f3:81,bridge_name='br-int',has_traffic_filtering=True,id=112cdddb-0763-476b-a269-aed7d05c7856,network=Network(76e721f1-1135-4932-9d27-41c013b3c149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112cdddb-07') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG os_vif [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:f3:81,bridge_name='br-int',has_traffic_filtering=True,id=112cdddb-0763-476b-a269-aed7d05c7856,network=Network(76e721f1-1135-4932-9d27-41c013b3c149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112cdddb-07') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap112cdddb-07, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap112cdddb-07, col_values=(('external_ids', {'iface-id': '112cdddb-0763-476b-a269-aed7d05c7856', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:f3:81', 'vm-uuid': '929ed2b3-a72e-424e-94c4-352c207442ec'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:29 user nova-compute[72201]: INFO os_vif [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:f3:81,bridge_name='br-int',has_traffic_filtering=True,id=112cdddb-0763-476b-a269-aed7d05c7856,network=Network(76e721f1-1135-4932-9d27-41c013b3c149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112cdddb-07')
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] No VIF found with MAC fa:16:3e:66:f3:81, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-a6cd1253-ed4a-4d76-aed1-b3ae8c976698 req-16353ba1-50e2-4f1b-a172-d46be2807178 service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Received event network-changed-9067d464-7696-450e-bc4e-6ac29aec6c8f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-a6cd1253-ed4a-4d76-aed1-b3ae8c976698 req-16353ba1-50e2-4f1b-a172-d46be2807178 service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Refreshing instance network info cache due to event network-changed-9067d464-7696-450e-bc4e-6ac29aec6c8f. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6cd1253-ed4a-4d76-aed1-b3ae8c976698 req-16353ba1-50e2-4f1b-a172-d46be2807178 service nova] Acquiring lock "refresh_cache-14e890ca-dc2a-4d89-a497-d55805d0c42e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6cd1253-ed4a-4d76-aed1-b3ae8c976698 req-16353ba1-50e2-4f1b-a172-d46be2807178 service nova] Acquired lock "refresh_cache-14e890ca-dc2a-4d89-a497-d55805d0c42e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.network.neutron [req-a6cd1253-ed4a-4d76-aed1-b3ae8c976698 req-16353ba1-50e2-4f1b-a172-d46be2807178 service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Refreshing network info cache for port 9067d464-7696-450e-bc4e-6ac29aec6c8f {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690903994.6340144, 79c02f2d-a143-4522-9054-369da11b54ba => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:33:29 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] VM Stopped (Lifecycle Event)
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-70752d75-9053-4cf0-a1cb-19215990ff01 None None] [instance: 79c02f2d-a143-4522-9054-369da11b54ba] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.network.neutron [req-d7d1e971-ce45-4b68-ae9c-e856a94452a8 req-afb58d1a-008a-4e21-a36f-771211eba0e8 service nova] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Updated VIF entry in instance network info cache for port 112cdddb-0763-476b-a269-aed7d05c7856. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:33:29 user nova-compute[72201]: DEBUG nova.network.neutron [req-d7d1e971-ce45-4b68-ae9c-e856a94452a8 req-afb58d1a-008a-4e21-a36f-771211eba0e8 service nova] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Updating instance_info_cache with network_info: [{"id": "112cdddb-0763-476b-a269-aed7d05c7856", "address": "fa:16:3e:66:f3:81", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112cdddb-07", "ovs_interfaceid": "112cdddb-0763-476b-a269-aed7d05c7856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:33:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d7d1e971-ce45-4b68-ae9c-e856a94452a8 req-afb58d1a-008a-4e21-a36f-771211eba0e8 service nova] Releasing lock "refresh_cache-929ed2b3-a72e-424e-94c4-352c207442ec" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:33:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "14e890ca-dc2a-4d89-a497-d55805d0c42e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "14e890ca-dc2a-4d89-a497-d55805d0c42e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "14e890ca-dc2a-4d89-a497-d55805d0c42e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "14e890ca-dc2a-4d89-a497-d55805d0c42e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "14e890ca-dc2a-4d89-a497-d55805d0c42e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:30 user nova-compute[72201]: INFO nova.compute.manager [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Terminating instance
Aug 01 15:33:30 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:33:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:30 user nova-compute[72201]: DEBUG nova.network.neutron [req-a6cd1253-ed4a-4d76-aed1-b3ae8c976698 req-16353ba1-50e2-4f1b-a172-d46be2807178 service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Updated VIF entry in instance network info cache for port 9067d464-7696-450e-bc4e-6ac29aec6c8f. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:33:30 user nova-compute[72201]: DEBUG nova.network.neutron [req-a6cd1253-ed4a-4d76-aed1-b3ae8c976698 req-16353ba1-50e2-4f1b-a172-d46be2807178 service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Updating instance_info_cache with network_info: [{"id": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "address": "fa:16:3e:af:9c:2f", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9067d464-76", "ovs_interfaceid": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:33:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6cd1253-ed4a-4d76-aed1-b3ae8c976698 req-16353ba1-50e2-4f1b-a172-d46be2807178 service nova] Releasing lock "refresh_cache-14e890ca-dc2a-4d89-a497-d55805d0c42e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:33:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-bf94f0af-f84e-4942-90f3-22dce18ae442 req-06475fef-7418-43c2-98a3-da298334b54f service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Received event network-vif-unplugged-9067d464-7696-450e-bc4e-6ac29aec6c8f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bf94f0af-f84e-4942-90f3-22dce18ae442 req-06475fef-7418-43c2-98a3-da298334b54f service nova] Acquiring lock "14e890ca-dc2a-4d89-a497-d55805d0c42e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bf94f0af-f84e-4942-90f3-22dce18ae442 req-06475fef-7418-43c2-98a3-da298334b54f service nova] Lock "14e890ca-dc2a-4d89-a497-d55805d0c42e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bf94f0af-f84e-4942-90f3-22dce18ae442 req-06475fef-7418-43c2-98a3-da298334b54f service nova] Lock "14e890ca-dc2a-4d89-a497-d55805d0c42e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-bf94f0af-f84e-4942-90f3-22dce18ae442 req-06475fef-7418-43c2-98a3-da298334b54f service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] No waiting events found dispatching network-vif-unplugged-9067d464-7696-450e-bc4e-6ac29aec6c8f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-bf94f0af-f84e-4942-90f3-22dce18ae442 req-06475fef-7418-43c2-98a3-da298334b54f service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Received event network-vif-unplugged-9067d464-7696-450e-bc4e-6ac29aec6c8f for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-bf94f0af-f84e-4942-90f3-22dce18ae442 req-06475fef-7418-43c2-98a3-da298334b54f service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Received event network-vif-plugged-9067d464-7696-450e-bc4e-6ac29aec6c8f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bf94f0af-f84e-4942-90f3-22dce18ae442 req-06475fef-7418-43c2-98a3-da298334b54f service nova] Acquiring lock "14e890ca-dc2a-4d89-a497-d55805d0c42e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bf94f0af-f84e-4942-90f3-22dce18ae442 req-06475fef-7418-43c2-98a3-da298334b54f service nova] Lock "14e890ca-dc2a-4d89-a497-d55805d0c42e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bf94f0af-f84e-4942-90f3-22dce18ae442 req-06475fef-7418-43c2-98a3-da298334b54f service nova] Lock "14e890ca-dc2a-4d89-a497-d55805d0c42e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-bf94f0af-f84e-4942-90f3-22dce18ae442 req-06475fef-7418-43c2-98a3-da298334b54f service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] No waiting events found dispatching network-vif-plugged-9067d464-7696-450e-bc4e-6ac29aec6c8f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:33:31 user nova-compute[72201]: WARNING nova.compute.manager [req-bf94f0af-f84e-4942-90f3-22dce18ae442 req-06475fef-7418-43c2-98a3-da298334b54f service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Received unexpected event network-vif-plugged-9067d464-7696-450e-bc4e-6ac29aec6c8f for instance with vm_state active and task_state deleting.
Aug 01 15:33:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:31 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Instance destroyed successfully.
Aug 01 15:33:31 user nova-compute[72201]: DEBUG nova.objects.instance [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lazy-loading 'resources' on Instance uuid 14e890ca-dc2a-4d89-a497-d55805d0c42e {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:26:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1177886463',display_name='tempest-TestStampPattern-server-1177886463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1177886463',id=20,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4cjcpIrCgWJ8HeEyRLEl6J/NtkzbCoKCzwQr+AGaVQkH5fVBdRsWj/5tVNxW6Q1XUhgysYXiPaBl9ORZIAWs2VQxGxCYnIlCoMMGp8aO9DwuzAUIuYOHmCwk/FaqacxQ==',key_name='tempest-TestStampPattern-853407470',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:26:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8289b01d09f4cf4a35affa9e22fa7fd',ramdisk_id='',reservation_id='r-lezk0efj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-2066377363',owner_user_name='tempest-TestStampPattern-2066377363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:29:31Z,user_data=None,user_id='7c69154feccc402f9f0d2c0aafdbdea7',uuid=14e890ca-dc2a-4d89-a497-d55805d0c42e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "address": "fa:16:3e:af:9c:2f", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9067d464-76", "ovs_interfaceid": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Converting VIF {"id": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "address": "fa:16:3e:af:9c:2f", "network": {"id": "302af7b4-2054-4148-870e-a04f75c18a52", "bridge": "br-int", "label": "tempest-TestStampPattern-1620128749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8289b01d09f4cf4a35affa9e22fa7fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9067d464-76", "ovs_interfaceid": "9067d464-7696-450e-bc4e-6ac29aec6c8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:9c:2f,bridge_name='br-int',has_traffic_filtering=True,id=9067d464-7696-450e-bc4e-6ac29aec6c8f,network=Network(302af7b4-2054-4148-870e-a04f75c18a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9067d464-76') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG os_vif [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:9c:2f,bridge_name='br-int',has_traffic_filtering=True,id=9067d464-7696-450e-bc4e-6ac29aec6c8f,network=Network(302af7b4-2054-4148-870e-a04f75c18a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9067d464-76') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9067d464-76, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:31 user nova-compute[72201]: INFO os_vif [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:9c:2f,bridge_name='br-int',has_traffic_filtering=True,id=9067d464-7696-450e-bc4e-6ac29aec6c8f,network=Network(302af7b4-2054-4148-870e-a04f75c18a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9067d464-76')
Aug 01 15:33:31 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Deleting instance files /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e_del
Aug 01 15:33:31 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Deletion of /opt/stack/data/nova/instances/14e890ca-dc2a-4d89-a497-d55805d0c42e_del complete
Aug 01 15:33:31 user nova-compute[72201]: INFO nova.compute.manager [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Took 1.38 seconds to destroy the instance on the hypervisor.
Aug 01 15:33:31 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:31 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:33:32 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Took 0.55 seconds to deallocate network for instance.
Aug 01 15:33:32 user nova-compute[72201]: DEBUG nova.compute.manager [req-28a8bb96-4214-4f6a-b722-b47b95c3eab3 req-0c8514c3-28f6-45f3-8883-b3a47d2e189f service nova] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Received event network-vif-deleted-9067d464-7696-450e-bc4e-6ac29aec6c8f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:32 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:33:32 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:33:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:32 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Deleted allocations for instance 14e890ca-dc2a-4d89-a497-d55805d0c42e
Aug 01 15:33:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-75561a69-1998-47e0-9ca9-2f214e57f935 tempest-TestStampPattern-2066377363 tempest-TestStampPattern-2066377363-project-member] Lock "14e890ca-dc2a-4d89-a497-d55805d0c42e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.647s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:33 user nova-compute[72201]: DEBUG nova.compute.manager [req-df615018-d3d1-4e5e-8af2-deff97192ba7 req-c1c3943b-1060-49c5-91cb-e3fcce05c0d1 service nova] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Received event network-vif-plugged-112cdddb-0763-476b-a269-aed7d05c7856 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-df615018-d3d1-4e5e-8af2-deff97192ba7 req-c1c3943b-1060-49c5-91cb-e3fcce05c0d1 service nova] Acquiring lock "929ed2b3-a72e-424e-94c4-352c207442ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-df615018-d3d1-4e5e-8af2-deff97192ba7 req-c1c3943b-1060-49c5-91cb-e3fcce05c0d1 service nova] Lock "929ed2b3-a72e-424e-94c4-352c207442ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-df615018-d3d1-4e5e-8af2-deff97192ba7 req-c1c3943b-1060-49c5-91cb-e3fcce05c0d1 service nova] Lock "929ed2b3-a72e-424e-94c4-352c207442ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:33 user nova-compute[72201]: DEBUG nova.compute.manager [req-df615018-d3d1-4e5e-8af2-deff97192ba7 req-c1c3943b-1060-49c5-91cb-e3fcce05c0d1 service nova] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] No waiting events found dispatching network-vif-plugged-112cdddb-0763-476b-a269-aed7d05c7856 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:33:33 user nova-compute[72201]: WARNING nova.compute.manager [req-df615018-d3d1-4e5e-8af2-deff97192ba7 req-c1c3943b-1060-49c5-91cb-e3fcce05c0d1 service nova] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Received unexpected event network-vif-plugged-112cdddb-0763-476b-a269-aed7d05c7856 for instance with vm_state building and task_state spawning.
Aug 01 15:33:33 user nova-compute[72201]: DEBUG nova.compute.manager [req-df615018-d3d1-4e5e-8af2-deff97192ba7 req-c1c3943b-1060-49c5-91cb-e3fcce05c0d1 service nova] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Received event network-vif-plugged-112cdddb-0763-476b-a269-aed7d05c7856 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-df615018-d3d1-4e5e-8af2-deff97192ba7 req-c1c3943b-1060-49c5-91cb-e3fcce05c0d1 service nova] Acquiring lock "929ed2b3-a72e-424e-94c4-352c207442ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-df615018-d3d1-4e5e-8af2-deff97192ba7 req-c1c3943b-1060-49c5-91cb-e3fcce05c0d1 service nova] Lock "929ed2b3-a72e-424e-94c4-352c207442ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-df615018-d3d1-4e5e-8af2-deff97192ba7 req-c1c3943b-1060-49c5-91cb-e3fcce05c0d1 service nova] Lock "929ed2b3-a72e-424e-94c4-352c207442ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:33 user nova-compute[72201]: DEBUG nova.compute.manager [req-df615018-d3d1-4e5e-8af2-deff97192ba7 req-c1c3943b-1060-49c5-91cb-e3fcce05c0d1 service nova] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] No waiting events found dispatching network-vif-plugged-112cdddb-0763-476b-a269-aed7d05c7856 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:33:33 user nova-compute[72201]: WARNING nova.compute.manager [req-df615018-d3d1-4e5e-8af2-deff97192ba7 req-c1c3943b-1060-49c5-91cb-e3fcce05c0d1 service nova] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Received unexpected event network-vif-plugged-112cdddb-0763-476b-a269-aed7d05c7856 for instance with vm_state building and task_state spawning.
Aug 01 15:33:33 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904013.479529, 929ed2b3-a72e-424e-94c4-352c207442ec => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:33:33 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] VM Resumed (Lifecycle Event)
Aug 01 15:33:33 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:33:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:33:33 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Instance spawned successfully.
Aug 01 15:33:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:33:33 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:33:33 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:33:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:33:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:33:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:33:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:33:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:33:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:33:33 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:33:33 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904013.4826088, 929ed2b3-a72e-424e-94c4-352c207442ec => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:33:33 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] VM Started (Lifecycle Event)
Aug 01 15:33:33 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:33:33 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:33:33 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:33:33 user nova-compute[72201]: INFO nova.compute.manager [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Took 6.33 seconds to spawn the instance on the hypervisor.
Aug 01 15:33:33 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:33:33 user nova-compute[72201]: INFO nova.compute.manager [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Took 7.25 seconds to build instance.
Aug 01 15:33:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e05a818-ff6a-4467-be33-3f6e671906e7 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "929ed2b3-a72e-424e-94c4-352c207442ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.384s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:44 user nova-compute[72201]: DEBUG nova.network.neutron [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Port 2cccc4c0-1ece-49a9-9e19-065c8fe55d9f binding to destination host user is already ACTIVE {{(pid=72201) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 15:33:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:33:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquired lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:33:44 user nova-compute[72201]: DEBUG nova.network.neutron [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:33:45 user nova-compute[72201]: DEBUG nova.network.neutron [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Updating instance_info_cache with network_info: [{"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:33:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Releasing lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:33:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Creating tmpfile /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/tmppf7atcwd to verify with other compute node that the instance is on the same shared storage. {{(pid=72201) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 01 15:33:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-64590964-cc90-4ecf-ab4e-bbb40e1cde08 req-8c19c579-b81f-4f2d-a6fc-737c56ea82a4 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received event network-vif-unplugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-64590964-cc90-4ecf-ab4e-bbb40e1cde08 req-8c19c579-b81f-4f2d-a6fc-737c56ea82a4 service nova] Acquiring lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-64590964-cc90-4ecf-ab4e-bbb40e1cde08 req-8c19c579-b81f-4f2d-a6fc-737c56ea82a4 service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-64590964-cc90-4ecf-ab4e-bbb40e1cde08 req-8c19c579-b81f-4f2d-a6fc-737c56ea82a4 service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-64590964-cc90-4ecf-ab4e-bbb40e1cde08 req-8c19c579-b81f-4f2d-a6fc-737c56ea82a4 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] No waiting events found dispatching network-vif-unplugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:33:45 user nova-compute[72201]: WARNING nova.compute.manager [req-64590964-cc90-4ecf-ab4e-bbb40e1cde08 req-8c19c579-b81f-4f2d-a6fc-737c56ea82a4 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received unexpected event network-vif-unplugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f for instance with vm_state resized and task_state resize_reverting.
Aug 01 15:33:46 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Instance destroyed successfully.
Aug 01 15:33:46 user nova-compute[72201]: DEBUG nova.objects.instance [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lazy-loading 'resources' on Instance uuid 9530577b-69a6-45bc-a33b-1dc60d69a16f {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:27:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1658925189',display_name='tempest-ServerActionsTestOtherB-server-1658925189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1658925189',id=23,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJArwB9vrejGtK4OyRlF/OPoTmPfhsQE57Hge1qGzDjlRPweDSIgEPC9CjlFjLzOgL7v2M+GdTat2K+6ohuaRgnBN7sGvF/1T+/fwnocb98Oa2hVXX8HgqjMMybuv12ZQ==',key_name='tempest-keypair-162505840',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:32:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7d07e2a1943449baeb9ca49a3d1326f',ramdisk_id='',reservation_id='r-0d5v5zbb',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2096061393',owner_user_name='tempest-ServerActionsTestOtherB-2096061393-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:32:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa902dd334b04d4cbf0ee4eb1eb582ff',uuid=9530577b-69a6-45bc-a33b-1dc60d69a16f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Converting VIF {"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:0d:a8,bridge_name='br-int',has_traffic_filtering=True,id=2cccc4c0-1ece-49a9-9e19-065c8fe55d9f,network=Network(bbd9214a-e302-4a4a-9395-f3e70e0cc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cccc4c0-1e') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG os_vif [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:0d:a8,bridge_name='br-int',has_traffic_filtering=True,id=2cccc4c0-1ece-49a9-9e19-065c8fe55d9f,network=Network(bbd9214a-e302-4a4a-9395-f3e70e0cc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cccc4c0-1e') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cccc4c0-1e, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:33:46 user nova-compute[72201]: INFO os_vif [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:0d:a8,bridge_name='br-int',has_traffic_filtering=True,id=2cccc4c0-1ece-49a9-9e19-065c8fe55d9f,network=Network(bbd9214a-e302-4a4a-9395-f3e70e0cc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cccc4c0-1e')
Aug 01 15:33:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwmPABNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:33:46 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:33:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9b0bb6-ba97-474c-b636-9f9c93bb7cc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f2619d-3db8-4c66-bed2-e35d95333532]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:33:46 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:33:46 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:33:46 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:33:46 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:33:46 user nova-compute[72201]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:33:46 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c139b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7'): ({'sde'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Removing single pathed devices sde {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7631d366-40e0-4725-bf70-c7015911fed5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2fc75a-005d-4a17-b445-9d6df6b3fe05]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Flushing IO for device /dev/sde {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0163fb10-b96b-4664-93a7-31f171f5ca5a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f330c06d-dc81-4479-9804-13a54f5dd765]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] SCSI volumes sde have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690904011.2973068, 14e890ca-dc2a-4d89-a497-d55805d0c42e => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:33:46 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] VM Stopped (Lifecycle Event)
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55df9c2-46e3-4c31-ba8b-f6762ff8df37]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-e14b33ed-aa4e-499e-8cb5-8f23e794bbb7 None None] [instance: 14e890ca-dc2a-4d89-a497-d55805d0c42e] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[56674551-397e-46bc-8def-b8a17d650f95]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260]
Aug 01 15:33:46 user nova-compute[72201]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260] successful.
Aug 01 15:33:46 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e362bc2b-ca56-479f-b039-a86c5628acd1]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] <== disconnect_volume: return (287ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:33:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:33:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:47 user nova-compute[72201]: DEBUG nova.objects.instance [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lazy-loading 'migration_context' on Instance uuid 9530577b-69a6-45bc-a33b-1dc60d69a16f {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:33:47 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:33:47 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:33:47 user nova-compute[72201]: DEBUG nova.compute.manager [req-de24b48f-a475-47a8-b80b-f50957d0c695 req-a8f2c8fa-698d-4def-b3e9-06a84416979e service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received event network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-de24b48f-a475-47a8-b80b-f50957d0c695 req-a8f2c8fa-698d-4def-b3e9-06a84416979e service nova] Acquiring lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-de24b48f-a475-47a8-b80b-f50957d0c695 req-a8f2c8fa-698d-4def-b3e9-06a84416979e service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-de24b48f-a475-47a8-b80b-f50957d0c695 req-a8f2c8fa-698d-4def-b3e9-06a84416979e service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:47 user nova-compute[72201]: DEBUG nova.compute.manager [req-de24b48f-a475-47a8-b80b-f50957d0c695 req-a8f2c8fa-698d-4def-b3e9-06a84416979e service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] No waiting events found dispatching network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:33:47 user nova-compute[72201]: WARNING nova.compute.manager [req-de24b48f-a475-47a8-b80b-f50957d0c695 req-a8f2c8fa-698d-4def-b3e9-06a84416979e service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received unexpected event network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f for instance with vm_state resized and task_state resize_reverting.
Aug 01 15:33:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.416s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:47 user nova-compute[72201]: INFO nova.compute.manager [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Swapping old allocation on dict_keys(['4ad5f056-b591-413c-b5b7-aab61bc138ae']) held by migration 7d266d84-6760-4fef-9ee0-849b99a23ad5 for instance
Aug 01 15:33:47 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Overwriting current allocation {'allocations': {'4ad5f056-b591-413c-b5b7-aab61bc138ae': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 38}}, 'project_id': 'a7d07e2a1943449baeb9ca49a3d1326f', 'user_id': 'fa902dd334b04d4cbf0ee4eb1eb582ff', 'consumer_generation': 1} on consumer 9530577b-69a6-45bc-a33b-1dc60d69a16f {{(pid=72201) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquired lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG nova.network.neutron [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG nova.network.neutron [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Updating instance_info_cache with network_info: [{"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Releasing lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG os_brick.utils [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e796e427-f1e5-406b-9de5-a62d6327e722]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[015bdb06-7cc1-46a7-ad8d-031aaa848d43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c883e24-b7f5-41dd-b7d3-dfc69c88f929]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2319e186-3de9-44c5-8490-c958136aa601]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:33:48 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:33:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[853ed6d7-2228-4cee-ac6b-6c45b6a02090]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:33:48 user nova-compute[72201]: DEBUG os_brick.utils [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:33:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Starting finish_revert_migration {{(pid=72201) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Start _get_guest_xml network_info=[{"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwmPABNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '9530577b-69a6-45bc-a33b-1dc60d69a16f', 'attached_at': '2023-08-01T15:33:56.000000', 'detached_at': '', 'volume_id': 'eaeddea5-fbb6-4b61-9a48-07c49f1b82b7', 'serial': 'eaeddea5-fbb6-4b61-9a48-07c49f1b82b7'}, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'cac12dd1-419f-4b10-9973-f50f4bee05fa', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:33:56 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:33:56 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:33:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG nova.objects.instance [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9530577b-69a6-45bc-a33b-1dc60d69a16f {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwmPABNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:33:56 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:33:56 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:33:56 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff69d69-8e9c-42df-a076-842ec2713ccf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:33:56 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[802e40e1-47cc-441e-afb8-78e6d824a774]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7] added
Aug 01 15:33:56 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c0604c-3d8b-4881-b794-6ce44b7430fe]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cf80a9-36a7-4a26-a38d-3bf1e42900f3]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwmPABNE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwmPABNE" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[37520ca6-3e4f-42d3-96a9-28787f3ec6b0]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jwmPABNE'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a29eff2-9bab-4f8d-815e-9097690a709c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[efeeed80-527a-41ae-84cd-a9db9a36628c]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:33:56 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:33:56 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:33:56 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:33:56 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[225f5ca0-7afb-4504-9280-2448ebf7dd9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260]
Aug 01 15:33:56 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260] successful.
Aug 01 15:33:56 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff11b6e-765a-48b6-bcc7-a33f359e986b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ac8537-a165-4e1a-b0f9-c0b91145edc4]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:33:56 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:33:56 user nova-compute[72201]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:33:56 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:33:56 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:33:56 user nova-compute[72201]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:33:56 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2a305c-a939-4fa9-b105-8f10bd8101c8]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:33:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwmPABNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquiring lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquiring lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:57 user nova-compute[72201]: INFO nova.compute.manager [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Terminating instance
Aug 01 15:33:57 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26233306335393138', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233306335393138', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:27:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1658925189',display_name='tempest-ServerActionsTestOtherB-server-1658925189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1658925189',id=23,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJArwB9vrejGtK4OyRlF/OPoTmPfhsQE57Hge1qGzDjlRPweDSIgEPC9CjlFjLzOgL7v2M+GdTat2K+6ohuaRgnBN7sGvF/1T+/fwnocb98Oa2hVXX8HgqjMMybuv12ZQ==',key_name='tempest-keypair-162505840',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:32:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a7d07e2a1943449baeb9ca49a3d1326f',ramdisk_id='',reservation_id='r-0d5v5zbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2096061393',owner_user_name='tempest-ServerActionsTestOtherB-2096061393-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa902dd334b04d4cbf0ee4eb1eb582ff',uuid=9530577b-69a6-45bc-a33b-1dc60d69a16f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Converting VIF {"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:0d:a8,bridge_name='br-int',has_traffic_filtering=True,id=2cccc4c0-1ece-49a9-9e19-065c8fe55d9f,network=Network(bbd9214a-e302-4a4a-9395-f3e70e0cc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cccc4c0-1e') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:33:57 user nova-compute[72201]:   <uuid>9530577b-69a6-45bc-a33b-1dc60d69a16f</uuid>
Aug 01 15:33:57 user nova-compute[72201]:   <name>instance-00000017</name>
Aug 01 15:33:57 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:33:57 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:33:57 user nova-compute[72201]:   <metadata>
Aug 01 15:33:57 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:33:57 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:33:57 user nova-compute[72201]:       <nova:name>tempest-ServerActionsTestOtherB-server-1658925189</nova:name>
Aug 01 15:33:57 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:33:56</nova:creationTime>
Aug 01 15:33:57 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:33:57 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:33:57 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:33:57 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:33:57 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:33:57 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:33:57 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:33:57 user nova-compute[72201]:       <nova:owner>
Aug 01 15:33:57 user nova-compute[72201]:         <nova:user uuid="fa902dd334b04d4cbf0ee4eb1eb582ff">tempest-ServerActionsTestOtherB-2096061393-project-member</nova:user>
Aug 01 15:33:57 user nova-compute[72201]:         <nova:project uuid="a7d07e2a1943449baeb9ca49a3d1326f">tempest-ServerActionsTestOtherB-2096061393</nova:project>
Aug 01 15:33:57 user nova-compute[72201]:       </nova:owner>
Aug 01 15:33:57 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:33:57 user nova-compute[72201]:       <nova:ports>
Aug 01 15:33:57 user nova-compute[72201]:         <nova:port uuid="2cccc4c0-1ece-49a9-9e19-065c8fe55d9f">
Aug 01 15:33:57 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 15:33:57 user nova-compute[72201]:         </nova:port>
Aug 01 15:33:57 user nova-compute[72201]:       </nova:ports>
Aug 01 15:33:57 user nova-compute[72201]:     </nova:instance>
Aug 01 15:33:57 user nova-compute[72201]:   </metadata>
Aug 01 15:33:57 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:33:57 user nova-compute[72201]:     <system>
Aug 01 15:33:57 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:33:57 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:33:57 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:33:57 user nova-compute[72201]:       <entry name="serial">9530577b-69a6-45bc-a33b-1dc60d69a16f</entry>
Aug 01 15:33:57 user nova-compute[72201]:       <entry name="uuid">9530577b-69a6-45bc-a33b-1dc60d69a16f</entry>
Aug 01 15:33:57 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:33:57 user nova-compute[72201]:     </system>
Aug 01 15:33:57 user nova-compute[72201]:   </sysinfo>
Aug 01 15:33:57 user nova-compute[72201]:   <os>
Aug 01 15:33:57 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:33:57 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:33:57 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:33:57 user nova-compute[72201]:   </os>
Aug 01 15:33:57 user nova-compute[72201]:   <features>
Aug 01 15:33:57 user nova-compute[72201]:     <acpi/>
Aug 01 15:33:57 user nova-compute[72201]:     <apic/>
Aug 01 15:33:57 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:33:57 user nova-compute[72201]:   </features>
Aug 01 15:33:57 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:33:57 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:33:57 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:33:57 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:33:57 user nova-compute[72201]:   </clock>
Aug 01 15:33:57 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:33:57 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:33:57 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:33:57 user nova-compute[72201]:   </cpu>
Aug 01 15:33:57 user nova-compute[72201]:   <devices>
Aug 01 15:33:57 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:33:57 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:33:57 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk"/>
Aug 01 15:33:57 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:33:57 user nova-compute[72201]:     </disk>
Aug 01 15:33:57 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:33:57 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:33:57 user nova-compute[72201]:       <source dev="/dev/sdb"/>
Aug 01 15:33:57 user nova-compute[72201]:       <target dev="vdb" bus="virtio"/>
Aug 01 15:33:57 user nova-compute[72201]:       <serial>eaeddea5-fbb6-4b61-9a48-07c49f1b82b7</serial>
Aug 01 15:33:57 user nova-compute[72201]:     </disk>
Aug 01 15:33:57 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:33:57 user nova-compute[72201]:       <mac address="fa:16:3e:78:0d:a8"/>
Aug 01 15:33:57 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:33:57 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:33:57 user nova-compute[72201]:       <target dev="tap2cccc4c0-1e"/>
Aug 01 15:33:57 user nova-compute[72201]:     </interface>
Aug 01 15:33:57 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:33:57 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/console.log" append="off"/>
Aug 01 15:33:57 user nova-compute[72201]:     </serial>
Aug 01 15:33:57 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:33:57 user nova-compute[72201]:     <video>
Aug 01 15:33:57 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:33:57 user nova-compute[72201]:     </video>
Aug 01 15:33:57 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:33:57 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:33:57 user nova-compute[72201]:     </rng>
Aug 01 15:33:57 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:33:57 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:33:57 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:33:57 user nova-compute[72201]:     </memballoon>
Aug 01 15:33:57 user nova-compute[72201]:   </devices>
Aug 01 15:33:57 user nova-compute[72201]: </domain>
Aug 01 15:33:57 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:27:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1658925189',display_name='tempest-ServerActionsTestOtherB-server-1658925189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1658925189',id=23,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJArwB9vrejGtK4OyRlF/OPoTmPfhsQE57Hge1qGzDjlRPweDSIgEPC9CjlFjLzOgL7v2M+GdTat2K+6ohuaRgnBN7sGvF/1T+/fwnocb98Oa2hVXX8HgqjMMybuv12ZQ==',key_name='tempest-keypair-162505840',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:32:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a7d07e2a1943449baeb9ca49a3d1326f',ramdisk_id='',reservation_id='r-0d5v5zbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2096061393',owner_user_name='tempest-ServerActionsTestOtherB-2096061393-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa902dd334b04d4cbf0ee4eb1eb582ff',uuid=9530577b-69a6-45bc-a33b-1dc60d69a16f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Converting VIF {"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:0d:a8,bridge_name='br-int',has_traffic_filtering=True,id=2cccc4c0-1ece-49a9-9e19-065c8fe55d9f,network=Network(bbd9214a-e302-4a4a-9395-f3e70e0cc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cccc4c0-1e') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG os_vif [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:0d:a8,bridge_name='br-int',has_traffic_filtering=True,id=2cccc4c0-1ece-49a9-9e19-065c8fe55d9f,network=Network(bbd9214a-e302-4a4a-9395-f3e70e0cc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cccc4c0-1e') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cccc4c0-1e, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2cccc4c0-1e, col_values=(('external_ids', {'iface-id': '2cccc4c0-1ece-49a9-9e19-065c8fe55d9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:0d:a8', 'vm-uuid': '9530577b-69a6-45bc-a33b-1dc60d69a16f'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:57 user nova-compute[72201]: INFO os_vif [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:0d:a8,bridge_name='br-int',has_traffic_filtering=True,id=2cccc4c0-1ece-49a9-9e19-065c8fe55d9f,network=Network(bbd9214a-e302-4a4a-9395-f3e70e0cc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cccc4c0-1e')
Aug 01 15:33:57 user nova-compute[72201]: DEBUG nova.compute.manager [req-15b1a834-5d42-4714-b5fd-412ff78f923d req-e443f073-64e0-480e-81eb-9b751e9b24aa service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Received event network-vif-unplugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-15b1a834-5d42-4714-b5fd-412ff78f923d req-e443f073-64e0-480e-81eb-9b751e9b24aa service nova] Acquiring lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-15b1a834-5d42-4714-b5fd-412ff78f923d req-e443f073-64e0-480e-81eb-9b751e9b24aa service nova] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-15b1a834-5d42-4714-b5fd-412ff78f923d req-e443f073-64e0-480e-81eb-9b751e9b24aa service nova] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG nova.compute.manager [req-15b1a834-5d42-4714-b5fd-412ff78f923d req-e443f073-64e0-480e-81eb-9b751e9b24aa service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] No waiting events found dispatching network-vif-unplugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:33:57 user nova-compute[72201]: DEBUG nova.compute.manager [req-15b1a834-5d42-4714-b5fd-412ff78f923d req-e443f073-64e0-480e-81eb-9b751e9b24aa service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Received event network-vif-unplugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:33:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:59 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Instance destroyed successfully.
Aug 01 15:33:59 user nova-compute[72201]: DEBUG nova.objects.instance [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lazy-loading 'resources' on Instance uuid eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:29:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1259013972',display_name='tempest-TestServerVolumeAttachmentScenario-server-1259013972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1259013972',id=28,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWP+JYsGMev02QM0JIA9apIF5G6P/qi4HJmT2Ye1rdJdIsbQJKEtEANSTb8xt9oxCa1Rzb8weZKKOwv9sqI5FEsl+7Flpo3H5Jdll4/XjqLqaLLGOQS2tbmpCzYp5ucxA==',key_name='tempest-keypair-1383056269',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:30:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1fa68dc043d456f85c918466114934f',ramdisk_id='',reservation_id='r-7kjs6382',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1394607266',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1394607266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:30:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f54d83edcf3a4816b7d30714dd0b20b9',uuid=eaf8c38a-c309-4a7a-a8d5-11f82deae5f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "address": "fa:16:3e:b2:68:3a", "network": {"id": "0a5cd34a-6838-4b6e-b44b-5d561a6a1573", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-719005822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fa68dc043d456f85c918466114934f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001b32aa-da", "ovs_interfaceid": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Converting VIF {"id": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "address": "fa:16:3e:b2:68:3a", "network": {"id": "0a5cd34a-6838-4b6e-b44b-5d561a6a1573", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-719005822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fa68dc043d456f85c918466114934f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap001b32aa-da", "ovs_interfaceid": "001b32aa-da69-4d16-8f4c-ab2a0a5b91d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:68:3a,bridge_name='br-int',has_traffic_filtering=True,id=001b32aa-da69-4d16-8f4c-ab2a0a5b91d8,network=Network(0a5cd34a-6838-4b6e-b44b-5d561a6a1573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap001b32aa-da') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG os_vif [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:68:3a,bridge_name='br-int',has_traffic_filtering=True,id=001b32aa-da69-4d16-8f4c-ab2a0a5b91d8,network=Network(0a5cd34a-6838-4b6e-b44b-5d561a6a1573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap001b32aa-da') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap001b32aa-da, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:59 user nova-compute[72201]: INFO os_vif [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:68:3a,bridge_name='br-int',has_traffic_filtering=True,id=001b32aa-da69-4d16-8f4c-ab2a0a5b91d8,network=Network(0a5cd34a-6838-4b6e-b44b-5d561a6a1573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap001b32aa-da')
Aug 01 15:33:59 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Deleting instance files /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2_del
Aug 01 15:33:59 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Deletion of /opt/stack/data/nova/instances/eaf8c38a-c309-4a7a-a8d5-11f82deae5f2_del complete
Aug 01 15:33:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:59 user nova-compute[72201]: INFO nova.compute.manager [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Took 1.78 seconds to destroy the instance on the hypervisor.
Aug 01 15:33:59 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG nova.compute.manager [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Received event network-vif-plugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] Acquiring lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG nova.compute.manager [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] No waiting events found dispatching network-vif-plugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:33:59 user nova-compute[72201]: WARNING nova.compute.manager [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Received unexpected event network-vif-plugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 for instance with vm_state active and task_state deleting.
Aug 01 15:33:59 user nova-compute[72201]: DEBUG nova.compute.manager [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Received event network-vif-plugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] Acquiring lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG nova.compute.manager [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] No waiting events found dispatching network-vif-plugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:33:59 user nova-compute[72201]: WARNING nova.compute.manager [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Received unexpected event network-vif-plugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 for instance with vm_state active and task_state deleting.
Aug 01 15:33:59 user nova-compute[72201]: DEBUG nova.compute.manager [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Received event network-vif-plugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] Acquiring lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG nova.compute.manager [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] No waiting events found dispatching network-vif-plugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:33:59 user nova-compute[72201]: WARNING nova.compute.manager [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Received unexpected event network-vif-plugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 for instance with vm_state active and task_state deleting.
Aug 01 15:33:59 user nova-compute[72201]: DEBUG nova.compute.manager [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Received event network-vif-unplugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] Acquiring lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG nova.compute.manager [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] No waiting events found dispatching network-vif-unplugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG nova.compute.manager [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Received event network-vif-unplugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG nova.compute.manager [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Received event network-vif-plugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] Acquiring lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG nova.compute.manager [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] No waiting events found dispatching network-vif-plugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:33:59 user nova-compute[72201]: WARNING nova.compute.manager [req-616ed52d-56ce-4217-aabf-785d2d8e3342 req-d2fa13f5-fcbc-45e6-bc65-6d663206c187 service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Received unexpected event network-vif-plugged-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 for instance with vm_state active and task_state deleting.
Aug 01 15:33:59 user nova-compute[72201]: DEBUG nova.compute.manager [req-ae7f49fb-a80d-44e1-9af6-01101b2841a8 req-4ab5ba60-4971-4bb9-b3ff-4de246453819 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received event network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ae7f49fb-a80d-44e1-9af6-01101b2841a8 req-4ab5ba60-4971-4bb9-b3ff-4de246453819 service nova] Acquiring lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ae7f49fb-a80d-44e1-9af6-01101b2841a8 req-4ab5ba60-4971-4bb9-b3ff-4de246453819 service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ae7f49fb-a80d-44e1-9af6-01101b2841a8 req-4ab5ba60-4971-4bb9-b3ff-4de246453819 service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:33:59 user nova-compute[72201]: DEBUG nova.compute.manager [req-ae7f49fb-a80d-44e1-9af6-01101b2841a8 req-4ab5ba60-4971-4bb9-b3ff-4de246453819 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] No waiting events found dispatching network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:33:59 user nova-compute[72201]: WARNING nova.compute.manager [req-ae7f49fb-a80d-44e1-9af6-01101b2841a8 req-4ab5ba60-4971-4bb9-b3ff-4de246453819 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received unexpected event network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f for instance with vm_state resized and task_state resize_reverting.
Aug 01 15:33:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:01 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690904026.0794284, 9530577b-69a6-45bc-a33b-1dc60d69a16f => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:34:01 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] VM Stopped (Lifecycle Event)
Aug 01 15:34:01 user nova-compute[72201]: DEBUG nova.compute.manager [None req-711fad00-3e3b-41eb-882f-75275356640e None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:34:01 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:34:01 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Took 2.13 seconds to deallocate network for instance.
Aug 01 15:34:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:01 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:34:01 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:34:01 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904041.7671459, 9530577b-69a6-45bc-a33b-1dc60d69a16f => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:34:01 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] VM Resumed (Lifecycle Event)
Aug 01 15:34:01 user nova-compute[72201]: DEBUG nova.compute.manager [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:34:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:01 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:34:01 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Instance running successfully.
Aug 01 15:34:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] finish_revert_migration finished successfully. {{(pid=72201) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 01 15:34:01 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:34:01 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Deleted allocations for instance eaf8c38a-c309-4a7a-a8d5-11f82deae5f2
Aug 01 15:34:01 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 01 15:34:01 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904041.7751977, 9530577b-69a6-45bc-a33b-1dc60d69a16f => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:34:01 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] VM Started (Lifecycle Event)
Aug 01 15:34:01 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:34:01 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:34:01 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 01 15:34:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4dec8e3c-7c17-4d56-b226-e5351e88f3d6 tempest-TestServerVolumeAttachmentScenario-1394607266 tempest-TestServerVolumeAttachmentScenario-1394607266-project-member] Lock "eaf8c38a-c309-4a7a-a8d5-11f82deae5f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.588s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:02 user nova-compute[72201]: INFO nova.compute.manager [None req-26dc5e15-2fa8-45f9-bc6d-213e8b200158 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Updating instance to original state: 'active'
Aug 01 15:34:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-a99f474e-28c0-4b2f-91c7-7172ad4baf56 req-6e396a8f-76cb-4e9d-8453-7fc5dce1b39c service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received event network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:34:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a99f474e-28c0-4b2f-91c7-7172ad4baf56 req-6e396a8f-76cb-4e9d-8453-7fc5dce1b39c service nova] Acquiring lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a99f474e-28c0-4b2f-91c7-7172ad4baf56 req-6e396a8f-76cb-4e9d-8453-7fc5dce1b39c service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a99f474e-28c0-4b2f-91c7-7172ad4baf56 req-6e396a8f-76cb-4e9d-8453-7fc5dce1b39c service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-a99f474e-28c0-4b2f-91c7-7172ad4baf56 req-6e396a8f-76cb-4e9d-8453-7fc5dce1b39c service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] No waiting events found dispatching network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:34:02 user nova-compute[72201]: WARNING nova.compute.manager [req-a99f474e-28c0-4b2f-91c7-7172ad4baf56 req-6e396a8f-76cb-4e9d-8453-7fc5dce1b39c service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received unexpected event network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f for instance with vm_state resized and task_state resize_reverting.
Aug 01 15:34:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-a99f474e-28c0-4b2f-91c7-7172ad4baf56 req-6e396a8f-76cb-4e9d-8453-7fc5dce1b39c service nova] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Received event network-vif-deleted-001b32aa-da69-4d16-8f4c-ab2a0a5b91d8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:34:02 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:34:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:04 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:34:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:06 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:34:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:06 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:34:06 user nova-compute[72201]: INFO nova.compute.claims [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Claim successful on node user
Aug 01 15:34:07 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:34:07 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:34:07 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG nova.policy [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fd505dbb02e4d3d8e8f97839b25ed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548641aee9954aa48c567e798b4be247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:34:07 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Creating image(s)
Aug 01 15:34:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "/opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "/opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "/opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.146s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk 1073741824" returned: 0 in 0.062s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.150s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:34:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:08 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Cannot resize image /opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:34:08 user nova-compute[72201]: DEBUG nova.objects.instance [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lazy-loading 'migration_context' on Instance uuid 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:34:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:34:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Ensure instance console log exists: /opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:34:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:34:08 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:34:08 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Successfully created port: ebb58ee4-b7ff-470c-9599-fb635cfbd89f {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:34:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-e2ca19ea-868c-40ad-a453-f6e348cfac15" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:34:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-e2ca19ea-868c-40ad-a453-f6e348cfac15" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:34:08 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:34:08 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Updating instance_info_cache with network_info: [{"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:34:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-e2ca19ea-868c-40ad-a453-f6e348cfac15" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:34:08 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:34:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:09 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Successfully updated port: ebb58ee4-b7ff-470c-9599-fb635cfbd89f {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:34:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "refresh_cache-20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:34:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquired lock "refresh_cache-20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:34:09 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:34:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-0888e0d6-f36c-4063-a371-44594933cea4 req-155a9dfe-9ecd-407b-8e9e-17ee6074b2bf service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Received event network-changed-ebb58ee4-b7ff-470c-9599-fb635cfbd89f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:34:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-0888e0d6-f36c-4063-a371-44594933cea4 req-155a9dfe-9ecd-407b-8e9e-17ee6074b2bf service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Refreshing instance network info cache due to event network-changed-ebb58ee4-b7ff-470c-9599-fb635cfbd89f. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:34:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0888e0d6-f36c-4063-a371-44594933cea4 req-155a9dfe-9ecd-407b-8e9e-17ee6074b2bf service nova] Acquiring lock "refresh_cache-20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:34:09 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Updating instance_info_cache with network_info: [{"id": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "address": "fa:16:3e:5a:be:b2", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb58ee4-b7", "ovs_interfaceid": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Releasing lock "refresh_cache-20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Instance network_info: |[{"id": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "address": "fa:16:3e:5a:be:b2", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb58ee4-b7", "ovs_interfaceid": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0888e0d6-f36c-4063-a371-44594933cea4 req-155a9dfe-9ecd-407b-8e9e-17ee6074b2bf service nova] Acquired lock "refresh_cache-20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.network.neutron [req-0888e0d6-f36c-4063-a371-44594933cea4 req-155a9dfe-9ecd-407b-8e9e-17ee6074b2bf service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Refreshing network info cache for port ebb58ee4-b7ff-470c-9599-fb635cfbd89f {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Start _get_guest_xml network_info=[{"id": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "address": "fa:16:3e:5a:be:b2", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb58ee4-b7", "ovs_interfaceid": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:34:10 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:34:10 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:34:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1678565475',display_name='tempest-AttachVolumeNegativeTest-server-1678565475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1678565475',id=32,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMya1+vVBJZkwsOq2tyEFJp4qoAZCbYcjsIXTrg3PM89wXIsQI7rPphJybHGRh/eIG2R/8iFi1cFqUqQJJGHY6MOpX0dTgDgLTXydXeK/gpJN/B3nAuGvzs4ZFsNAvUfUA==',key_name='tempest-keypair-1610557227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548641aee9954aa48c567e798b4be247',ramdisk_id='',reservation_id='r-nyi8hb0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2028543234',owner_user_name='tempest-AttachVolumeNegativeTest-2028543234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd505dbb02e4d3d8e8f97839b25ed22',uuid=20d257a3-8f64-4e6c-b7be-b8dd8ed9610d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "address": "fa:16:3e:5a:be:b2", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb58ee4-b7", "ovs_interfaceid": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converting VIF {"id": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "address": "fa:16:3e:5a:be:b2", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb58ee4-b7", "ovs_interfaceid": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:be:b2,bridge_name='br-int',has_traffic_filtering=True,id=ebb58ee4-b7ff-470c-9599-fb635cfbd89f,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb58ee4-b7') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.objects.instance [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lazy-loading 'pci_devices' on Instance uuid 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:34:10 user nova-compute[72201]:   <uuid>20d257a3-8f64-4e6c-b7be-b8dd8ed9610d</uuid>
Aug 01 15:34:10 user nova-compute[72201]:   <name>instance-00000020</name>
Aug 01 15:34:10 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:34:10 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:34:10 user nova-compute[72201]:   <metadata>
Aug 01 15:34:10 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:34:10 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:34:10 user nova-compute[72201]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1678565475</nova:name>
Aug 01 15:34:10 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:34:10</nova:creationTime>
Aug 01 15:34:10 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:34:10 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:34:10 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:34:10 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:34:10 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:34:10 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:34:10 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:34:10 user nova-compute[72201]:       <nova:owner>
Aug 01 15:34:10 user nova-compute[72201]:         <nova:user uuid="6fd505dbb02e4d3d8e8f97839b25ed22">tempest-AttachVolumeNegativeTest-2028543234-project-member</nova:user>
Aug 01 15:34:10 user nova-compute[72201]:         <nova:project uuid="548641aee9954aa48c567e798b4be247">tempest-AttachVolumeNegativeTest-2028543234</nova:project>
Aug 01 15:34:10 user nova-compute[72201]:       </nova:owner>
Aug 01 15:34:10 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:34:10 user nova-compute[72201]:       <nova:ports>
Aug 01 15:34:10 user nova-compute[72201]:         <nova:port uuid="ebb58ee4-b7ff-470c-9599-fb635cfbd89f">
Aug 01 15:34:10 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 15:34:10 user nova-compute[72201]:         </nova:port>
Aug 01 15:34:10 user nova-compute[72201]:       </nova:ports>
Aug 01 15:34:10 user nova-compute[72201]:     </nova:instance>
Aug 01 15:34:10 user nova-compute[72201]:   </metadata>
Aug 01 15:34:10 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:34:10 user nova-compute[72201]:     <system>
Aug 01 15:34:10 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:34:10 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:34:10 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:34:10 user nova-compute[72201]:       <entry name="serial">20d257a3-8f64-4e6c-b7be-b8dd8ed9610d</entry>
Aug 01 15:34:10 user nova-compute[72201]:       <entry name="uuid">20d257a3-8f64-4e6c-b7be-b8dd8ed9610d</entry>
Aug 01 15:34:10 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:34:10 user nova-compute[72201]:     </system>
Aug 01 15:34:10 user nova-compute[72201]:   </sysinfo>
Aug 01 15:34:10 user nova-compute[72201]:   <os>
Aug 01 15:34:10 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:34:10 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:34:10 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:34:10 user nova-compute[72201]:   </os>
Aug 01 15:34:10 user nova-compute[72201]:   <features>
Aug 01 15:34:10 user nova-compute[72201]:     <acpi/>
Aug 01 15:34:10 user nova-compute[72201]:     <apic/>
Aug 01 15:34:10 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:34:10 user nova-compute[72201]:   </features>
Aug 01 15:34:10 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:34:10 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:34:10 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:34:10 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:34:10 user nova-compute[72201]:   </clock>
Aug 01 15:34:10 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:34:10 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:34:10 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:34:10 user nova-compute[72201]:   </cpu>
Aug 01 15:34:10 user nova-compute[72201]:   <devices>
Aug 01 15:34:10 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:34:10 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:34:10 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk"/>
Aug 01 15:34:10 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:34:10 user nova-compute[72201]:     </disk>
Aug 01 15:34:10 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:34:10 user nova-compute[72201]:       <mac address="fa:16:3e:5a:be:b2"/>
Aug 01 15:34:10 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:34:10 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:34:10 user nova-compute[72201]:       <target dev="tapebb58ee4-b7"/>
Aug 01 15:34:10 user nova-compute[72201]:     </interface>
Aug 01 15:34:10 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:34:10 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/console.log" append="off"/>
Aug 01 15:34:10 user nova-compute[72201]:     </serial>
Aug 01 15:34:10 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:34:10 user nova-compute[72201]:     <video>
Aug 01 15:34:10 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:34:10 user nova-compute[72201]:     </video>
Aug 01 15:34:10 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:34:10 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:34:10 user nova-compute[72201]:     </rng>
Aug 01 15:34:10 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:34:10 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:34:10 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:34:10 user nova-compute[72201]:     </memballoon>
Aug 01 15:34:10 user nova-compute[72201]:   </devices>
Aug 01 15:34:10 user nova-compute[72201]: </domain>
Aug 01 15:34:10 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:34:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1678565475',display_name='tempest-AttachVolumeNegativeTest-server-1678565475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1678565475',id=32,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMya1+vVBJZkwsOq2tyEFJp4qoAZCbYcjsIXTrg3PM89wXIsQI7rPphJybHGRh/eIG2R/8iFi1cFqUqQJJGHY6MOpX0dTgDgLTXydXeK/gpJN/B3nAuGvzs4ZFsNAvUfUA==',key_name='tempest-keypair-1610557227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548641aee9954aa48c567e798b4be247',ramdisk_id='',reservation_id='r-nyi8hb0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2028543234',owner_user_name='tempest-AttachVolumeNegativeTest-2028543234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd505dbb02e4d3d8e8f97839b25ed22',uuid=20d257a3-8f64-4e6c-b7be-b8dd8ed9610d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "address": "fa:16:3e:5a:be:b2", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb58ee4-b7", "ovs_interfaceid": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converting VIF {"id": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "address": "fa:16:3e:5a:be:b2", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb58ee4-b7", "ovs_interfaceid": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:be:b2,bridge_name='br-int',has_traffic_filtering=True,id=ebb58ee4-b7ff-470c-9599-fb635cfbd89f,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb58ee4-b7') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG os_vif [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:be:b2,bridge_name='br-int',has_traffic_filtering=True,id=ebb58ee4-b7ff-470c-9599-fb635cfbd89f,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb58ee4-b7') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebb58ee4-b7, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapebb58ee4-b7, col_values=(('external_ids', {'iface-id': 'ebb58ee4-b7ff-470c-9599-fb635cfbd89f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:be:b2', 'vm-uuid': '20d257a3-8f64-4e6c-b7be-b8dd8ed9610d'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:10 user nova-compute[72201]: INFO os_vif [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:be:b2,bridge_name='br-int',has_traffic_filtering=True,id=ebb58ee4-b7ff-470c-9599-fb635cfbd89f,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb58ee4-b7')
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] No VIF found with MAC fa:16:3e:5a:be:b2, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.network.neutron [req-0888e0d6-f36c-4063-a371-44594933cea4 req-155a9dfe-9ecd-407b-8e9e-17ee6074b2bf service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Updated VIF entry in instance network info cache for port ebb58ee4-b7ff-470c-9599-fb635cfbd89f. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG nova.network.neutron [req-0888e0d6-f36c-4063-a371-44594933cea4 req-155a9dfe-9ecd-407b-8e9e-17ee6074b2bf service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Updating instance_info_cache with network_info: [{"id": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "address": "fa:16:3e:5a:be:b2", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb58ee4-b7", "ovs_interfaceid": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:34:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0888e0d6-f36c-4063-a371-44594933cea4 req-155a9dfe-9ecd-407b-8e9e-17ee6074b2bf service nova] Releasing lock "refresh_cache-20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:34:11 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:34:11 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:34:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:34:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-df73b93f-9094-4b7d-b23d-19d693a77124 req-c77088fb-a641-4c6e-943d-49e5e1f805a3 service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Received event network-vif-plugged-ebb58ee4-b7ff-470c-9599-fb635cfbd89f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:34:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-df73b93f-9094-4b7d-b23d-19d693a77124 req-c77088fb-a641-4c6e-943d-49e5e1f805a3 service nova] Acquiring lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-df73b93f-9094-4b7d-b23d-19d693a77124 req-c77088fb-a641-4c6e-943d-49e5e1f805a3 service nova] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-df73b93f-9094-4b7d-b23d-19d693a77124 req-c77088fb-a641-4c6e-943d-49e5e1f805a3 service nova] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-df73b93f-9094-4b7d-b23d-19d693a77124 req-c77088fb-a641-4c6e-943d-49e5e1f805a3 service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] No waiting events found dispatching network-vif-plugged-ebb58ee4-b7ff-470c-9599-fb635cfbd89f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:34:12 user nova-compute[72201]: WARNING nova.compute.manager [req-df73b93f-9094-4b7d-b23d-19d693a77124 req-c77088fb-a641-4c6e-943d-49e5e1f805a3 service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Received unexpected event network-vif-plugged-ebb58ee4-b7ff-470c-9599-fb635cfbd89f for instance with vm_state building and task_state spawning.
Aug 01 15:34:12 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:34:12 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:34:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:13 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:34:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:13 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:34:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:13 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904053.9607882, 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:34:13 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] VM Resumed (Lifecycle Event)
Aug 01 15:34:13 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:34:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:34:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:13 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Instance spawned successfully.
Aug 01 15:34:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690904039.009192, eaf8c38a-c309-4a7a-a8d5-11f82deae5f2 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:34:14 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] VM Stopped (Lifecycle Event)
Aug 01 15:34:14 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG nova.compute.manager [None req-09a4a05f-42f9-43bf-923d-9dcdf7564b99 None None] [instance: eaf8c38a-c309-4a7a-a8d5-11f82deae5f2] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG nova.compute.manager [req-1ab08455-9421-4fd8-abeb-74c4a8c1d100 req-ee8b30aa-0202-42c2-908f-3800690b93f9 service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Received event network-vif-plugged-ebb58ee4-b7ff-470c-9599-fb635cfbd89f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1ab08455-9421-4fd8-abeb-74c4a8c1d100 req-ee8b30aa-0202-42c2-908f-3800690b93f9 service nova] Acquiring lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1ab08455-9421-4fd8-abeb-74c4a8c1d100 req-ee8b30aa-0202-42c2-908f-3800690b93f9 service nova] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1ab08455-9421-4fd8-abeb-74c4a8c1d100 req-ee8b30aa-0202-42c2-908f-3800690b93f9 service nova] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG nova.compute.manager [req-1ab08455-9421-4fd8-abeb-74c4a8c1d100 req-ee8b30aa-0202-42c2-908f-3800690b93f9 service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] No waiting events found dispatching network-vif-plugged-ebb58ee4-b7ff-470c-9599-fb635cfbd89f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:34:14 user nova-compute[72201]: WARNING nova.compute.manager [req-1ab08455-9421-4fd8-abeb-74c4a8c1d100 req-ee8b30aa-0202-42c2-908f-3800690b93f9 service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Received unexpected event network-vif-plugged-ebb58ee4-b7ff-470c-9599-fb635cfbd89f for instance with vm_state building and task_state spawning.
Aug 01 15:34:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:34:14 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:34:14 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904053.9668164, 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:34:14 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] VM Started (Lifecycle Event)
Aug 01 15:34:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:34:14 user nova-compute[72201]: INFO nova.compute.manager [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Took 6.81 seconds to spawn the instance on the hypervisor.
Aug 01 15:34:14 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:34:14 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:34:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:14 user nova-compute[72201]: INFO nova.compute.manager [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Took 7.56 seconds to build instance.
Aug 01 15:34:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6ce6dd2f-ea0a-4685-91e0-ae84a1015dc1 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.760s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:34:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:34:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:16 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:34:16 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:34:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=7521MB free_disk=25.411632537841797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:34:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance b64f1cfb-64f2-4493-8721-fc63fcd93bb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:34:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e2ca19ea-868c-40ad-a453-f6e348cfac15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:34:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 0f059ccc-f609-4cf3-a644-c3d1305ae26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:34:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 9e946b4a-9b93-459f-8e5e-d88612c4ec34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:34:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance bd70360d-30b8-47d5-b35e-adf0d28482dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:34:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 9530577b-69a6-45bc-a33b-1dc60d69a16f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:34:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 929ed2b3-a72e-424e-94c4-352c207442ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:34:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:34:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:34:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:34:16 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:34:16 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:34:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:34:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.436s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:18 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:34:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "02353c28-57e8-4209-914a-99b61fe14ba8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "02353c28-57e8-4209-914a-99b61fe14ba8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:34:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:29 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:34:29 user nova-compute[72201]: INFO nova.compute.claims [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Claim successful on node user
Aug 01 15:34:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:29 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:34:29 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:34:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:34:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:34:29 user nova-compute[72201]: DEBUG nova.network.neutron [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:34:29 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:34:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:34:29 user nova-compute[72201]: DEBUG nova.policy [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '488991a215a64482a71cb25f3ecd9f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85969cbfd374ba484cccd0f89fcf3be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:34:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:34:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:34:29 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Creating image(s)
Aug 01 15:34:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "/opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "/opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "/opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.148s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquiring lock "a7721f4d-4a5b-4196-9358-9126426566f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "a7721f4d-4a5b-4196-9358-9126426566f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8/disk 1073741824" returned: 0 in 0.064s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG nova.network.neutron [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Successfully created port: c4efc73b-8686-49b1-81bc-722a3dc7c322 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:34:30 user nova-compute[72201]: INFO nova.compute.claims [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Claim successful on node user
Aug 01 15:34:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Cannot resize image /opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG nova.objects.instance [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lazy-loading 'migration_context' on Instance uuid 02353c28-57e8-4209-914a-99b61fe14ba8 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Ensure instance console log exists: /opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:30 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:34:31 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:34:31 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:34:31 user nova-compute[72201]: INFO nova.virt.block_device [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Booting with volume c7de637b-e39e-4bad-af19-bb86cdba4ac1 at /dev/vda
Aug 01 15:34:31 user nova-compute[72201]: DEBUG os_brick.utils [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a975f31-b158-4247-bf86-f230cd805b00]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG nova.policy [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54744ee637ec4f6989f6bded4bd01a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de91196332140e7abe9ae60574c68cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4301be40-d8f5-4da9-a06c-0d3be2fd008b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[be161aa0-a25c-40ae-af54-1836e5c00639]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1be5065-c146-4dc7-9d81-bdd7df837c8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:34:31 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:34:31 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e1d2c8-6ccb-45cd-918a-0ae3178fcd9d]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG os_brick.utils [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Updating existing volume attachment record: d26ee200-b1f3-4a71-babb-cd619b1ee839 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG nova.network.neutron [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Successfully updated port: c4efc73b-8686-49b1-81bc-722a3dc7c322 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "refresh_cache-02353c28-57e8-4209-914a-99b61fe14ba8" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquired lock "refresh_cache-02353c28-57e8-4209-914a-99b61fe14ba8" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG nova.network.neutron [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-f002efe9-70b7-491f-a1d8-171da6c07df4 req-13ec976b-734e-4500-83e2-ba70a2776626 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Received event network-changed-c4efc73b-8686-49b1-81bc-722a3dc7c322 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-f002efe9-70b7-491f-a1d8-171da6c07df4 req-13ec976b-734e-4500-83e2-ba70a2776626 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Refreshing instance network info cache due to event network-changed-c4efc73b-8686-49b1-81bc-722a3dc7c322. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f002efe9-70b7-491f-a1d8-171da6c07df4 req-13ec976b-734e-4500-83e2-ba70a2776626 service nova] Acquiring lock "refresh_cache-02353c28-57e8-4209-914a-99b61fe14ba8" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:34:31 user nova-compute[72201]: DEBUG nova.network.neutron [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.network.neutron [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Updating instance_info_cache with network_info: [{"id": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "address": "fa:16:3e:1b:a3:5c", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4efc73b-86", "ovs_interfaceid": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Releasing lock "refresh_cache-02353c28-57e8-4209-914a-99b61fe14ba8" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Instance network_info: |[{"id": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "address": "fa:16:3e:1b:a3:5c", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4efc73b-86", "ovs_interfaceid": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f002efe9-70b7-491f-a1d8-171da6c07df4 req-13ec976b-734e-4500-83e2-ba70a2776626 service nova] Acquired lock "refresh_cache-02353c28-57e8-4209-914a-99b61fe14ba8" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.network.neutron [req-f002efe9-70b7-491f-a1d8-171da6c07df4 req-13ec976b-734e-4500-83e2-ba70a2776626 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Refreshing network info cache for port c4efc73b-8686-49b1-81bc-722a3dc7c322 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Start _get_guest_xml network_info=[{"id": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "address": "fa:16:3e:1b:a3:5c", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4efc73b-86", "ovs_interfaceid": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:34:32 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:34:32 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-349772799',display_name='tempest-VolumesSnapshotTestJSON-instance-349772799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-349772799',id=33,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+Y3oQG7k6g0/7wZk4bHmhvBHuLQuNzdZYNcXQa4aO6PS0Rux9Lhah+EVQKJWaXWUMP1pPBQGHWAZh4mhjaMtv5BJPmkE9ct0nyxiYteTgaRCNhREK2h2KPGSzURm2XHw==',key_name='tempest-keypair-2077566837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c85969cbfd374ba484cccd0f89fcf3be',ramdisk_id='',reservation_id='r-bplxu2s6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-840662389',owner_user_name='tempest-VolumesSnapshotTestJSON-840662389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='488991a215a64482a71cb25f3ecd9f0f',uuid=02353c28-57e8-4209-914a-99b61fe14ba8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "address": "fa:16:3e:1b:a3:5c", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4efc73b-86", "ovs_interfaceid": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Converting VIF {"id": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "address": "fa:16:3e:1b:a3:5c", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4efc73b-86", "ovs_interfaceid": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a3:5c,bridge_name='br-int',has_traffic_filtering=True,id=c4efc73b-8686-49b1-81bc-722a3dc7c322,network=Network(5b881fdd-ff08-42a6-aa9c-3ec904123af2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4efc73b-86') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.objects.instance [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lazy-loading 'pci_devices' on Instance uuid 02353c28-57e8-4209-914a-99b61fe14ba8 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:34:32 user nova-compute[72201]:   <uuid>02353c28-57e8-4209-914a-99b61fe14ba8</uuid>
Aug 01 15:34:32 user nova-compute[72201]:   <name>instance-00000021</name>
Aug 01 15:34:32 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:34:32 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:34:32 user nova-compute[72201]:   <metadata>
Aug 01 15:34:32 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:34:32 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:34:32 user nova-compute[72201]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-349772799</nova:name>
Aug 01 15:34:32 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:34:32</nova:creationTime>
Aug 01 15:34:32 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:34:32 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:34:32 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:34:32 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:34:32 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:34:32 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:34:32 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:34:32 user nova-compute[72201]:       <nova:owner>
Aug 01 15:34:32 user nova-compute[72201]:         <nova:user uuid="488991a215a64482a71cb25f3ecd9f0f">tempest-VolumesSnapshotTestJSON-840662389-project-member</nova:user>
Aug 01 15:34:32 user nova-compute[72201]:         <nova:project uuid="c85969cbfd374ba484cccd0f89fcf3be">tempest-VolumesSnapshotTestJSON-840662389</nova:project>
Aug 01 15:34:32 user nova-compute[72201]:       </nova:owner>
Aug 01 15:34:32 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:34:32 user nova-compute[72201]:       <nova:ports>
Aug 01 15:34:32 user nova-compute[72201]:         <nova:port uuid="c4efc73b-8686-49b1-81bc-722a3dc7c322">
Aug 01 15:34:32 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 15:34:32 user nova-compute[72201]:         </nova:port>
Aug 01 15:34:32 user nova-compute[72201]:       </nova:ports>
Aug 01 15:34:32 user nova-compute[72201]:     </nova:instance>
Aug 01 15:34:32 user nova-compute[72201]:   </metadata>
Aug 01 15:34:32 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:34:32 user nova-compute[72201]:     <system>
Aug 01 15:34:32 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:34:32 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:34:32 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:34:32 user nova-compute[72201]:       <entry name="serial">02353c28-57e8-4209-914a-99b61fe14ba8</entry>
Aug 01 15:34:32 user nova-compute[72201]:       <entry name="uuid">02353c28-57e8-4209-914a-99b61fe14ba8</entry>
Aug 01 15:34:32 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:34:32 user nova-compute[72201]:     </system>
Aug 01 15:34:32 user nova-compute[72201]:   </sysinfo>
Aug 01 15:34:32 user nova-compute[72201]:   <os>
Aug 01 15:34:32 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:34:32 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:34:32 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:34:32 user nova-compute[72201]:   </os>
Aug 01 15:34:32 user nova-compute[72201]:   <features>
Aug 01 15:34:32 user nova-compute[72201]:     <acpi/>
Aug 01 15:34:32 user nova-compute[72201]:     <apic/>
Aug 01 15:34:32 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:34:32 user nova-compute[72201]:   </features>
Aug 01 15:34:32 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:34:32 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:34:32 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:34:32 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:34:32 user nova-compute[72201]:   </clock>
Aug 01 15:34:32 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:34:32 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:34:32 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:34:32 user nova-compute[72201]:   </cpu>
Aug 01 15:34:32 user nova-compute[72201]:   <devices>
Aug 01 15:34:32 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:34:32 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:34:32 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8/disk"/>
Aug 01 15:34:32 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:34:32 user nova-compute[72201]:     </disk>
Aug 01 15:34:32 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:34:32 user nova-compute[72201]:       <mac address="fa:16:3e:1b:a3:5c"/>
Aug 01 15:34:32 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:34:32 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:34:32 user nova-compute[72201]:       <target dev="tapc4efc73b-86"/>
Aug 01 15:34:32 user nova-compute[72201]:     </interface>
Aug 01 15:34:32 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:34:32 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8/console.log" append="off"/>
Aug 01 15:34:32 user nova-compute[72201]:     </serial>
Aug 01 15:34:32 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:34:32 user nova-compute[72201]:     <video>
Aug 01 15:34:32 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:34:32 user nova-compute[72201]:     </video>
Aug 01 15:34:32 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:34:32 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:34:32 user nova-compute[72201]:     </rng>
Aug 01 15:34:32 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:34:32 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:34:32 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:34:32 user nova-compute[72201]:     </memballoon>
Aug 01 15:34:32 user nova-compute[72201]:   </devices>
Aug 01 15:34:32 user nova-compute[72201]: </domain>
Aug 01 15:34:32 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-349772799',display_name='tempest-VolumesSnapshotTestJSON-instance-349772799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-349772799',id=33,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+Y3oQG7k6g0/7wZk4bHmhvBHuLQuNzdZYNcXQa4aO6PS0Rux9Lhah+EVQKJWaXWUMP1pPBQGHWAZh4mhjaMtv5BJPmkE9ct0nyxiYteTgaRCNhREK2h2KPGSzURm2XHw==',key_name='tempest-keypair-2077566837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c85969cbfd374ba484cccd0f89fcf3be',ramdisk_id='',reservation_id='r-bplxu2s6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-840662389',owner_user_name='tempest-VolumesSnapshotTestJSON-840662389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='488991a215a64482a71cb25f3ecd9f0f',uuid=02353c28-57e8-4209-914a-99b61fe14ba8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "address": "fa:16:3e:1b:a3:5c", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4efc73b-86", "ovs_interfaceid": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Converting VIF {"id": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "address": "fa:16:3e:1b:a3:5c", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4efc73b-86", "ovs_interfaceid": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a3:5c,bridge_name='br-int',has_traffic_filtering=True,id=c4efc73b-8686-49b1-81bc-722a3dc7c322,network=Network(5b881fdd-ff08-42a6-aa9c-3ec904123af2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4efc73b-86') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG os_vif [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a3:5c,bridge_name='br-int',has_traffic_filtering=True,id=c4efc73b-8686-49b1-81bc-722a3dc7c322,network=Network(5b881fdd-ff08-42a6-aa9c-3ec904123af2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4efc73b-86') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4efc73b-86, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc4efc73b-86, col_values=(('external_ids', {'iface-id': 'c4efc73b-8686-49b1-81bc-722a3dc7c322', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:a3:5c', 'vm-uuid': '02353c28-57e8-4209-914a-99b61fe14ba8'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:32 user nova-compute[72201]: INFO os_vif [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a3:5c,bridge_name='br-int',has_traffic_filtering=True,id=c4efc73b-8686-49b1-81bc-722a3dc7c322,network=Network(5b881fdd-ff08-42a6-aa9c-3ec904123af2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4efc73b-86')
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Successfully created port: 3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:34:32 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] No VIF found with MAC fa:16:3e:1b:a3:5c, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:34:33 user nova-compute[72201]: DEBUG nova.network.neutron [req-f002efe9-70b7-491f-a1d8-171da6c07df4 req-13ec976b-734e-4500-83e2-ba70a2776626 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Updated VIF entry in instance network info cache for port c4efc73b-8686-49b1-81bc-722a3dc7c322. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:34:33 user nova-compute[72201]: DEBUG nova.network.neutron [req-f002efe9-70b7-491f-a1d8-171da6c07df4 req-13ec976b-734e-4500-83e2-ba70a2776626 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Updating instance_info_cache with network_info: [{"id": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "address": "fa:16:3e:1b:a3:5c", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4efc73b-86", "ovs_interfaceid": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:34:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f002efe9-70b7-491f-a1d8-171da6c07df4 req-13ec976b-734e-4500-83e2-ba70a2776626 service nova] Releasing lock "refresh_cache-02353c28-57e8-4209-914a-99b61fe14ba8" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:34:33 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Successfully updated port: 3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:34:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquiring lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:34:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquired lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:34:33 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:34:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:33 user nova-compute[72201]: DEBUG nova.compute.manager [req-08b7da81-cd15-4daa-afa3-fef3a427eac9 req-847f0841-8b78-4dd9-bf48-7fe562dbb428 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received event network-changed-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:34:33 user nova-compute[72201]: DEBUG nova.compute.manager [req-08b7da81-cd15-4daa-afa3-fef3a427eac9 req-847f0841-8b78-4dd9-bf48-7fe562dbb428 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Refreshing instance network info cache due to event network-changed-3ca61173-de45-4386-a12b-9ecdf45b29d9. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:34:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-08b7da81-cd15-4daa-afa3-fef3a427eac9 req-847f0841-8b78-4dd9-bf48-7fe562dbb428 service nova] Acquiring lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:34:33 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:34:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG nova.compute.manager [req-255101c6-2c76-4ded-be69-356c5e2524eb req-94c3d27b-d24a-43eb-8da3-145aeef44f48 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received event network-changed-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG nova.compute.manager [req-255101c6-2c76-4ded-be69-356c5e2524eb req-94c3d27b-d24a-43eb-8da3-145aeef44f48 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Refreshing instance network info cache due to event network-changed-983acc56-f35e-463b-9792-e837ce96710d. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-255101c6-2c76-4ded-be69-356c5e2524eb req-94c3d27b-d24a-43eb-8da3-145aeef44f48 service nova] Acquiring lock "refresh_cache-9e946b4a-9b93-459f-8e5e-d88612c4ec34" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-255101c6-2c76-4ded-be69-356c5e2524eb req-94c3d27b-d24a-43eb-8da3-145aeef44f48 service nova] Acquired lock "refresh_cache-9e946b4a-9b93-459f-8e5e-d88612c4ec34" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG nova.network.neutron [req-255101c6-2c76-4ded-be69-356c5e2524eb req-94c3d27b-d24a-43eb-8da3-145aeef44f48 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Refreshing network info cache for port 983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG nova.compute.manager [req-02755a62-25c0-4c8d-9cab-9d0fc7e40f3b req-a19e7e07-94af-4771-af5c-80c63859be09 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Received event network-vif-plugged-c4efc73b-8686-49b1-81bc-722a3dc7c322 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-02755a62-25c0-4c8d-9cab-9d0fc7e40f3b req-a19e7e07-94af-4771-af5c-80c63859be09 service nova] Acquiring lock "02353c28-57e8-4209-914a-99b61fe14ba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-02755a62-25c0-4c8d-9cab-9d0fc7e40f3b req-a19e7e07-94af-4771-af5c-80c63859be09 service nova] Lock "02353c28-57e8-4209-914a-99b61fe14ba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-02755a62-25c0-4c8d-9cab-9d0fc7e40f3b req-a19e7e07-94af-4771-af5c-80c63859be09 service nova] Lock "02353c28-57e8-4209-914a-99b61fe14ba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG nova.compute.manager [req-02755a62-25c0-4c8d-9cab-9d0fc7e40f3b req-a19e7e07-94af-4771-af5c-80c63859be09 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] No waiting events found dispatching network-vif-plugged-c4efc73b-8686-49b1-81bc-722a3dc7c322 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:34:34 user nova-compute[72201]: WARNING nova.compute.manager [req-02755a62-25c0-4c8d-9cab-9d0fc7e40f3b req-a19e7e07-94af-4771-af5c-80c63859be09 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Received unexpected event network-vif-plugged-c4efc73b-8686-49b1-81bc-722a3dc7c322 for instance with vm_state building and task_state spawning.
Aug 01 15:34:34 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Updating instance_info_cache with network_info: [{"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Releasing lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Instance network_info: |[{"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-08b7da81-cd15-4daa-afa3-fef3a427eac9 req-847f0841-8b78-4dd9-bf48-7fe562dbb428 service nova] Acquired lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG nova.network.neutron [req-08b7da81-cd15-4daa-afa3-fef3a427eac9 req-847f0841-8b78-4dd9-bf48-7fe562dbb428 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Refreshing network info cache for port 3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:34 user nova-compute[72201]: INFO nova.compute.manager [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Detaching volume f63575ac-6e2e-46b6-99c6-bfc53742fe57
Aug 01 15:34:34 user nova-compute[72201]: INFO nova.virt.block_device [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Attempting to driver detach volume f63575ac-6e2e-46b6-99c6-bfc53742fe57 from mountpoint /dev/vdb
Aug 01 15:34:34 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Attempting to detach device vdb from instance 9e946b4a-9b93-459f-8e5e-d88612c4ec34 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:34:34 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:34:34 user nova-compute[72201]:   <source dev="/dev/sdf"/>
Aug 01 15:34:34 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:34:34 user nova-compute[72201]:   <serial>f63575ac-6e2e-46b6-99c6-bfc53742fe57</serial>
Aug 01 15:34:34 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:34:34 user nova-compute[72201]: </disk>
Aug 01 15:34:34 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:34:34 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Successfully detached device vdb from instance 9e946b4a-9b93-459f-8e5e-d88612c4ec34 from the persistent domain config.
Aug 01 15:34:34 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e946b4a-9b93-459f-8e5e-d88612c4ec34 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:34:34 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:34:34 user nova-compute[72201]:   <source dev="/dev/sdf"/>
Aug 01 15:34:34 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:34:34 user nova-compute[72201]:   <serial>f63575ac-6e2e-46b6-99c6-bfc53742fe57</serial>
Aug 01 15:34:34 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:34:34 user nova-compute[72201]: </disk>
Aug 01 15:34:34 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG nova.network.neutron [req-08b7da81-cd15-4daa-afa3-fef3a427eac9 req-847f0841-8b78-4dd9-bf48-7fe562dbb428 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Updated VIF entry in instance network info cache for port 3ca61173-de45-4386-a12b-9ecdf45b29d9. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:34:34 user nova-compute[72201]: DEBUG nova.network.neutron [req-08b7da81-cd15-4daa-afa3-fef3a427eac9 req-847f0841-8b78-4dd9-bf48-7fe562dbb428 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Updating instance_info_cache with network_info: [{"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-08b7da81-cd15-4daa-afa3-fef3a427eac9 req-847f0841-8b78-4dd9-bf48-7fe562dbb428 service nova] Releasing lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690904075.4004624, 9e946b4a-9b93-459f-8e5e-d88612c4ec34 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e946b4a-9b93-459f-8e5e-d88612c4ec34 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:34:35 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Successfully detached device vdb from instance 9e946b4a-9b93-459f-8e5e-d88612c4ec34 from the live domain config.
Aug 01 15:34:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVhbXNxO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:34:35 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:34:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09e8752-9877-4339-8ce7-2eb8721fd891]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[54456bc5-e1e2-48bb-a5a9-036e60966f54]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:34:35 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:34:35 user nova-compute[72201]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:34:35 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 (non-flash)
Aug 01 15:34:35 user nova-compute[72201]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:34:35 user nova-compute[72201]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:34:35 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c515a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57'): ({'sdf'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Removing single pathed devices sdf {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3218c193-3973-4797-9c1e-07dd4c8a5d97]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG nova.network.neutron [req-255101c6-2c76-4ded-be69-356c5e2524eb req-94c3d27b-d24a-43eb-8da3-145aeef44f48 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Updated VIF entry in instance network info cache for port 983acc56-f35e-463b-9792-e837ce96710d. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG nova.network.neutron [req-255101c6-2c76-4ded-be69-356c5e2524eb req-94c3d27b-d24a-43eb-8da3-145aeef44f48 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Updating instance_info_cache with network_info: [{"id": "983acc56-f35e-463b-9792-e837ce96710d", "address": "fa:16:3e:28:f5:cf", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983acc56-f3", "ovs_interfaceid": "983acc56-f35e-463b-9792-e837ce96710d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.028s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[55589069-4e2b-441d-b0cc-3b6eda6ec7cc]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Flushing IO for device /dev/sdf {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-255101c6-2c76-4ded-be69-356c5e2524eb req-94c3d27b-d24a-43eb-8da3-145aeef44f48 service nova] Releasing lock "refresh_cache-9e946b4a-9b93-459f-8e5e-d88612c4ec34" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8939826f-bcd0-4616-ae8b-63449a861e92]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c532ab31-f5d6-4b84-8daf-8359e9b3f501]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] SCSI volumes sdf have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7744e560-9703-41b4-9a5b-13dd3f077de7]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b68dc94-5e8b-41f4-a7ed-a14c0761cd7d]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57, portal: 172.16.0.220,3260]
Aug 01 15:34:35 user nova-compute[72201]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57, portal: 172.16.0.220,3260] successful.
Aug 01 15:34:35 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63575ac-6e2e-46b6-99c6-bfc53742fe57 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[83491cd2-6ad0-4896-9fd8-a206103ef1d3]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] <== disconnect_volume: return (331ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:34:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.compute.manager [req-dd53d343-f5b9-416f-ab5c-aec7b16de693 req-7dde8345-b02b-4f4a-8ff0-da8dace5c2c7 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received event network-changed-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.compute.manager [req-dd53d343-f5b9-416f-ab5c-aec7b16de693 req-7dde8345-b02b-4f4a-8ff0-da8dace5c2c7 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Refreshing instance network info cache due to event network-changed-983acc56-f35e-463b-9792-e837ce96710d. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-dd53d343-f5b9-416f-ab5c-aec7b16de693 req-7dde8345-b02b-4f4a-8ff0-da8dace5c2c7 service nova] Acquiring lock "refresh_cache-9e946b4a-9b93-459f-8e5e-d88612c4ec34" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-dd53d343-f5b9-416f-ab5c-aec7b16de693 req-7dde8345-b02b-4f4a-8ff0-da8dace5c2c7 service nova] Acquired lock "refresh_cache-9e946b4a-9b93-459f-8e5e-d88612c4ec34" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.network.neutron [req-dd53d343-f5b9-416f-ab5c-aec7b16de693 req-7dde8345-b02b-4f4a-8ff0-da8dace5c2c7 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Refreshing network info cache for port 983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904076.3236644, 02353c28-57e8-4209-914a-99b61fe14ba8 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:34:36 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] VM Resumed (Lifecycle Event)
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:34:36 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Instance spawned successfully.
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.compute.manager [req-7b0e5978-e132-4cb4-9194-2d1282bb7a51 req-2640e7d0-2bde-4565-9297-ab20b8fdb633 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Received event network-vif-plugged-c4efc73b-8686-49b1-81bc-722a3dc7c322 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7b0e5978-e132-4cb4-9194-2d1282bb7a51 req-2640e7d0-2bde-4565-9297-ab20b8fdb633 service nova] Acquiring lock "02353c28-57e8-4209-914a-99b61fe14ba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7b0e5978-e132-4cb4-9194-2d1282bb7a51 req-2640e7d0-2bde-4565-9297-ab20b8fdb633 service nova] Lock "02353c28-57e8-4209-914a-99b61fe14ba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7b0e5978-e132-4cb4-9194-2d1282bb7a51 req-2640e7d0-2bde-4565-9297-ab20b8fdb633 service nova] Lock "02353c28-57e8-4209-914a-99b61fe14ba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.compute.manager [req-7b0e5978-e132-4cb4-9194-2d1282bb7a51 req-2640e7d0-2bde-4565-9297-ab20b8fdb633 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] No waiting events found dispatching network-vif-plugged-c4efc73b-8686-49b1-81bc-722a3dc7c322 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:34:36 user nova-compute[72201]: WARNING nova.compute.manager [req-7b0e5978-e132-4cb4-9194-2d1282bb7a51 req-2640e7d0-2bde-4565-9297-ab20b8fdb633 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Received unexpected event network-vif-plugged-c4efc73b-8686-49b1-81bc-722a3dc7c322 for instance with vm_state building and task_state spawning.
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:34:36 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904076.328563, 02353c28-57e8-4209-914a-99b61fe14ba8 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:34:36 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] VM Started (Lifecycle Event)
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:34:36 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:34:36 user nova-compute[72201]: INFO nova.compute.manager [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Took 6.60 seconds to spawn the instance on the hypervisor.
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG nova.objects.instance [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'flavor' on Instance uuid 9e946b4a-9b93-459f-8e5e-d88612c4ec34 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:34:36 user nova-compute[72201]: INFO nova.compute.manager [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Took 7.62 seconds to build instance.
Aug 01 15:34:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-dab50b52-8ed9-4450-a9e8-f75f48568014 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.977s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9d3152c9-1e34-47af-90e3-72caa1a98bea tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "02353c28-57e8-4209-914a-99b61fe14ba8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.736s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:37 user nova-compute[72201]: DEBUG nova.network.neutron [req-dd53d343-f5b9-416f-ab5c-aec7b16de693 req-7dde8345-b02b-4f4a-8ff0-da8dace5c2c7 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Updated VIF entry in instance network info cache for port 983acc56-f35e-463b-9792-e837ce96710d. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:34:37 user nova-compute[72201]: DEBUG nova.network.neutron [req-dd53d343-f5b9-416f-ab5c-aec7b16de693 req-7dde8345-b02b-4f4a-8ff0-da8dace5c2c7 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Updating instance_info_cache with network_info: [{"id": "983acc56-f35e-463b-9792-e837ce96710d", "address": "fa:16:3e:28:f5:cf", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983acc56-f3", "ovs_interfaceid": "983acc56-f35e-463b-9792-e837ce96710d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:34:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-dd53d343-f5b9-416f-ab5c-aec7b16de693 req-7dde8345-b02b-4f4a-8ff0-da8dace5c2c7 service nova] Releasing lock "refresh_cache-9e946b4a-9b93-459f-8e5e-d88612c4ec34" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:34:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:38 user nova-compute[72201]: INFO nova.compute.manager [None req-83eed733-ad1c-48af-8b92-50981ee12439 tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Get console output
Aug 01 15:34:38 user nova-compute[72201]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 01 15:34:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:34:40 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Creating image(s)
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Did not create local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Ensure instance console log exists: /opt/stack/data/nova/instances/a7721f4d-4a5b-4196-9358-9126426566f0/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Start _get_guest_xml network_info=[{"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YwXuUipm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a7721f4d-4a5b-4196-9358-9126426566f0', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7de637b-e39e-4bad-af19-bb86cdba4ac1', 'serial': 'c7de637b-e39e-4bad-af19-bb86cdba4ac1'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'd26ee200-b1f3-4a71-babb-cd619b1ee839', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:34:40 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:34:40 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YwXuUipm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:34:40 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:34:40 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:34:40 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[62024f22-eeaf-490d-9d08-8a47cdbaef5e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:34:40 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cab5760-4c18-4f7f-9b57-70793b2fad2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1] added
Aug 01 15:34:40 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c427d713-2123-4680-8064-03e9c87ad034]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b740dd11-c960-4dc7-b263-98f6814acc30]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YwXuUipm {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YwXuUipm" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[133f50ca-08dc-42bd-86a3-6726a1c5f9ea]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YwXuUipm'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0bea12-ae88-4b34-a451-5cd89b7a8937]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8434f1a-ad41-456d-bac2-c8cf681e1749]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:34:40 user nova-compute[72201]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:34:40 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:34:40 user nova-compute[72201]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:34:40 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b3eff4-995a-4814-b3af-71624ee878ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1, portal: 172.16.0.220,3260]
Aug 01 15:34:40 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1, portal: 172.16.0.220,3260] successful.
Aug 01 15:34:40 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.060s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f90ff6-5539-46bd-9a57-4b7cfa54c6ae]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ce256d-c97c-48bf-94dd-6ba68e1995b5]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:34:40 user nova-compute[72201]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:34:40 user nova-compute[72201]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)
Aug 01 15:34:40 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:34:40 user nova-compute[72201]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:34:40 user nova-compute[72201]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)
Aug 01 15:34:40 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d487785-0098-455b-ac45-192d70e48ab2]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:34:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YwXuUipm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23733343631666234', 'path': '/dev/sdc'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733343631666234', 'path': '/dev/sdc'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:34:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-540186684',display_name='tempest-TestShelveInstance-server-540186684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-540186684',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsS8OvfaRGk693yFtpHMMn1bjidzbjAJvJwchxy+re0xxLrLl1tBj97I2/hrLO28yDkro0x84MfikDrXYUibDS8jklejvz69Wj1Ib7AjIUqAgrXWPmcBhfFo66aXZArCw==',key_name='tempest-TestShelveInstance-1065743790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2de91196332140e7abe9ae60574c68cc',ramdisk_id='',reservation_id='r-nugea08p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2040618803',owner_user_name='tempest-TestShelveInstance-2040618803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:34:31Z,user_data=None,user_id='54744ee637ec4f6989f6bded4bd01a28',uuid=a7721f4d-4a5b-4196-9358-9126426566f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Converting VIF {"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:cd:b4,bridge_name='br-int',has_traffic_filtering=True,id=3ca61173-de45-4386-a12b-9ecdf45b29d9,network=Network(8a16a227-fcc9-46cf-a739-1697d1fd78e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca61173-de') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lazy-loading 'pci_devices' on Instance uuid a7721f4d-4a5b-4196-9358-9126426566f0 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:34:41 user nova-compute[72201]:   <uuid>a7721f4d-4a5b-4196-9358-9126426566f0</uuid>
Aug 01 15:34:41 user nova-compute[72201]:   <name>instance-00000022</name>
Aug 01 15:34:41 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:34:41 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:34:41 user nova-compute[72201]:   <metadata>
Aug 01 15:34:41 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:34:41 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:34:41 user nova-compute[72201]:       <nova:name>tempest-TestShelveInstance-server-540186684</nova:name>
Aug 01 15:34:41 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:34:40</nova:creationTime>
Aug 01 15:34:41 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:34:41 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:34:41 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:34:41 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:34:41 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:34:41 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:34:41 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:34:41 user nova-compute[72201]:       <nova:owner>
Aug 01 15:34:41 user nova-compute[72201]:         <nova:user uuid="54744ee637ec4f6989f6bded4bd01a28">tempest-TestShelveInstance-2040618803-project-member</nova:user>
Aug 01 15:34:41 user nova-compute[72201]:         <nova:project uuid="2de91196332140e7abe9ae60574c68cc">tempest-TestShelveInstance-2040618803</nova:project>
Aug 01 15:34:41 user nova-compute[72201]:       </nova:owner>
Aug 01 15:34:41 user nova-compute[72201]:       <nova:ports>
Aug 01 15:34:41 user nova-compute[72201]:         <nova:port uuid="3ca61173-de45-4386-a12b-9ecdf45b29d9">
Aug 01 15:34:41 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 15:34:41 user nova-compute[72201]:         </nova:port>
Aug 01 15:34:41 user nova-compute[72201]:       </nova:ports>
Aug 01 15:34:41 user nova-compute[72201]:     </nova:instance>
Aug 01 15:34:41 user nova-compute[72201]:   </metadata>
Aug 01 15:34:41 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:34:41 user nova-compute[72201]:     <system>
Aug 01 15:34:41 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:34:41 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:34:41 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:34:41 user nova-compute[72201]:       <entry name="serial">a7721f4d-4a5b-4196-9358-9126426566f0</entry>
Aug 01 15:34:41 user nova-compute[72201]:       <entry name="uuid">a7721f4d-4a5b-4196-9358-9126426566f0</entry>
Aug 01 15:34:41 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:34:41 user nova-compute[72201]:     </system>
Aug 01 15:34:41 user nova-compute[72201]:   </sysinfo>
Aug 01 15:34:41 user nova-compute[72201]:   <os>
Aug 01 15:34:41 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:34:41 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:34:41 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:34:41 user nova-compute[72201]:   </os>
Aug 01 15:34:41 user nova-compute[72201]:   <features>
Aug 01 15:34:41 user nova-compute[72201]:     <acpi/>
Aug 01 15:34:41 user nova-compute[72201]:     <apic/>
Aug 01 15:34:41 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:34:41 user nova-compute[72201]:   </features>
Aug 01 15:34:41 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:34:41 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:34:41 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:34:41 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:34:41 user nova-compute[72201]:   </clock>
Aug 01 15:34:41 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:34:41 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:34:41 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:34:41 user nova-compute[72201]:   </cpu>
Aug 01 15:34:41 user nova-compute[72201]:   <devices>
Aug 01 15:34:41 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:34:41 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:34:41 user nova-compute[72201]:       <source dev="/dev/sdc"/>
Aug 01 15:34:41 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:34:41 user nova-compute[72201]:       <serial>c7de637b-e39e-4bad-af19-bb86cdba4ac1</serial>
Aug 01 15:34:41 user nova-compute[72201]:     </disk>
Aug 01 15:34:41 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:34:41 user nova-compute[72201]:       <mac address="fa:16:3e:48:cd:b4"/>
Aug 01 15:34:41 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:34:41 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:34:41 user nova-compute[72201]:       <target dev="tap3ca61173-de"/>
Aug 01 15:34:41 user nova-compute[72201]:     </interface>
Aug 01 15:34:41 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:34:41 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/a7721f4d-4a5b-4196-9358-9126426566f0/console.log" append="off"/>
Aug 01 15:34:41 user nova-compute[72201]:     </serial>
Aug 01 15:34:41 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:34:41 user nova-compute[72201]:     <video>
Aug 01 15:34:41 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:34:41 user nova-compute[72201]:     </video>
Aug 01 15:34:41 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:34:41 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:34:41 user nova-compute[72201]:     </rng>
Aug 01 15:34:41 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:34:41 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:34:41 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:34:41 user nova-compute[72201]:     </memballoon>
Aug 01 15:34:41 user nova-compute[72201]:   </devices>
Aug 01 15:34:41 user nova-compute[72201]: </domain>
Aug 01 15:34:41 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:34:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-540186684',display_name='tempest-TestShelveInstance-server-540186684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-540186684',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsS8OvfaRGk693yFtpHMMn1bjidzbjAJvJwchxy+re0xxLrLl1tBj97I2/hrLO28yDkro0x84MfikDrXYUibDS8jklejvz69Wj1Ib7AjIUqAgrXWPmcBhfFo66aXZArCw==',key_name='tempest-TestShelveInstance-1065743790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2de91196332140e7abe9ae60574c68cc',ramdisk_id='',reservation_id='r-nugea08p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2040618803',owner_user_name='tempest-TestShelveInstance-2040618803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:34:31Z,user_data=None,user_id='54744ee637ec4f6989f6bded4bd01a28',uuid=a7721f4d-4a5b-4196-9358-9126426566f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Converting VIF {"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:cd:b4,bridge_name='br-int',has_traffic_filtering=True,id=3ca61173-de45-4386-a12b-9ecdf45b29d9,network=Network(8a16a227-fcc9-46cf-a739-1697d1fd78e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca61173-de') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG os_vif [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:cd:b4,bridge_name='br-int',has_traffic_filtering=True,id=3ca61173-de45-4386-a12b-9ecdf45b29d9,network=Network(8a16a227-fcc9-46cf-a739-1697d1fd78e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca61173-de') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ca61173-de, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3ca61173-de, col_values=(('external_ids', {'iface-id': '3ca61173-de45-4386-a12b-9ecdf45b29d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:cd:b4', 'vm-uuid': 'a7721f4d-4a5b-4196-9358-9126426566f0'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:41 user nova-compute[72201]: INFO os_vif [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:cd:b4,bridge_name='br-int',has_traffic_filtering=True,id=3ca61173-de45-4386-a12b-9ecdf45b29d9,network=Network(8a16a227-fcc9-46cf-a739-1697d1fd78e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca61173-de')
Aug 01 15:34:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:34:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] No VIF found with MAC fa:16:3e:48:cd:b4, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:34:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-86b4be37-6733-4bd9-8d7d-8d7eba7b44cc req-6d3aa895-c0d3-4e3a-9d3f-aeb0739cd36f service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received event network-vif-plugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:34:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-86b4be37-6733-4bd9-8d7d-8d7eba7b44cc req-6d3aa895-c0d3-4e3a-9d3f-aeb0739cd36f service nova] Acquiring lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-86b4be37-6733-4bd9-8d7d-8d7eba7b44cc req-6d3aa895-c0d3-4e3a-9d3f-aeb0739cd36f service nova] Lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-86b4be37-6733-4bd9-8d7d-8d7eba7b44cc req-6d3aa895-c0d3-4e3a-9d3f-aeb0739cd36f service nova] Lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-86b4be37-6733-4bd9-8d7d-8d7eba7b44cc req-6d3aa895-c0d3-4e3a-9d3f-aeb0739cd36f service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] No waiting events found dispatching network-vif-plugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:34:43 user nova-compute[72201]: WARNING nova.compute.manager [req-86b4be37-6733-4bd9-8d7d-8d7eba7b44cc req-6d3aa895-c0d3-4e3a-9d3f-aeb0739cd36f service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received unexpected event network-vif-plugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 for instance with vm_state building and task_state spawning.
Aug 01 15:34:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:34:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:34:45 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904085.0794966, a7721f4d-4a5b-4196-9358-9126426566f0 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:34:45 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] VM Resumed (Lifecycle Event)
Aug 01 15:34:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:34:45 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Instance spawned successfully.
Aug 01 15:34:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:34:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:34:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:34:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:34:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:34:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:34:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:34:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:34:45 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:34:45 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904085.0812461, a7721f4d-4a5b-4196-9358-9126426566f0 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:34:45 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] VM Started (Lifecycle Event)
Aug 01 15:34:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:34:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:34:45 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:34:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-7a523993-0ad4-4bb7-9a92-3e7e181c47b6 req-d62522cd-565f-448a-9cc7-c4756006075e service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received event network-vif-plugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:34:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7a523993-0ad4-4bb7-9a92-3e7e181c47b6 req-d62522cd-565f-448a-9cc7-c4756006075e service nova] Acquiring lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:34:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7a523993-0ad4-4bb7-9a92-3e7e181c47b6 req-d62522cd-565f-448a-9cc7-c4756006075e service nova] Lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:34:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7a523993-0ad4-4bb7-9a92-3e7e181c47b6 req-d62522cd-565f-448a-9cc7-c4756006075e service nova] Lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-7a523993-0ad4-4bb7-9a92-3e7e181c47b6 req-d62522cd-565f-448a-9cc7-c4756006075e service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] No waiting events found dispatching network-vif-plugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:34:45 user nova-compute[72201]: WARNING nova.compute.manager [req-7a523993-0ad4-4bb7-9a92-3e7e181c47b6 req-d62522cd-565f-448a-9cc7-c4756006075e service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received unexpected event network-vif-plugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 for instance with vm_state building and task_state spawning.
Aug 01 15:34:45 user nova-compute[72201]: INFO nova.compute.manager [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Took 5.26 seconds to spawn the instance on the hypervisor.
Aug 01 15:34:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:34:45 user nova-compute[72201]: INFO nova.compute.manager [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Took 14.95 seconds to build instance.
Aug 01 15:34:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a2d2d384-ccb4-4cf8-978c-f66c48c764fe tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "a7721f4d-4a5b-4196-9358-9126426566f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.098s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:34:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:34:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:03 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:35:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:06 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:35:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:35:08 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:35:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-0f059ccc-f609-4cf3-a644-c3d1305ae26e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:35:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-0f059ccc-f609-4cf3-a644-c3d1305ae26e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:35:08 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:35:08 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Updating instance_info_cache with network_info: [{"id": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "address": "fa:16:3e:2d:e0:8c", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1fc053-fd", "ovs_interfaceid": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:35:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-0f059ccc-f609-4cf3-a644-c3d1305ae26e" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:35:08 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:35:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:10 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:35:11 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:35:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:13 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:35:13 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:35:13 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:35:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:14 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:35:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:35:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:35:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:35:14 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:35:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:35:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:35:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:35:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:17 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:35:17 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:35:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=7259MB free_disk=25.349872589111328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance b64f1cfb-64f2-4493-8721-fc63fcd93bb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e2ca19ea-868c-40ad-a453-f6e348cfac15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 0f059ccc-f609-4cf3-a644-c3d1305ae26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 9e946b4a-9b93-459f-8e5e-d88612c4ec34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance bd70360d-30b8-47d5-b35e-adf0d28482dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 9530577b-69a6-45bc-a33b-1dc60d69a16f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 929ed2b3-a72e-424e-94c4-352c207442ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 02353c28-57e8-4209-914a-99b61fe14ba8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance a7721f4d-4a5b-4196-9358-9126426566f0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 5040757b-7100-4cb0-b252-7b52f35ec4ba has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Acquiring lock "5040757b-7100-4cb0-b252-7b52f35ec4ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "5040757b-7100-4cb0-b252-7b52f35ec4ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.182s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:35:17 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:35:17 user nova-compute[72201]: INFO nova.compute.claims [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Claim successful on node user
Aug 01 15:35:18 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:35:18 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:35:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:35:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:35:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:35:18 user nova-compute[72201]: DEBUG nova.network.neutron [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:35:18 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:35:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:35:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:35:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:35:18 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Creating image(s)
Aug 01 15:35:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Acquiring lock "/opt/stack/data/nova/instances/5040757b-7100-4cb0-b252-7b52f35ec4ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:35:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "/opt/stack/data/nova/instances/5040757b-7100-4cb0-b252-7b52f35ec4ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:35:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "/opt/stack/data/nova/instances/5040757b-7100-4cb0-b252-7b52f35ec4ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:35:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:18 user nova-compute[72201]: DEBUG nova.policy [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '382a20da0cdd454181d19da58d22551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0e2836d3794cd8b26b8f54a73af7e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:35:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.131s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:35:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:35:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/5040757b-7100-4cb0-b252-7b52f35ec4ba/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/5040757b-7100-4cb0-b252-7b52f35ec4ba/disk 1073741824" returned: 0 in 0.049s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:35:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:18 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:35:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:19 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5040757b-7100-4cb0-b252-7b52f35ec4ba/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:35:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5040757b-7100-4cb0-b252-7b52f35ec4ba/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5040757b-7100-4cb0-b252-7b52f35ec4ba/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:19 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Cannot resize image /opt/stack/data/nova/instances/5040757b-7100-4cb0-b252-7b52f35ec4ba/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:35:19 user nova-compute[72201]: DEBUG nova.objects.instance [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lazy-loading 'migration_context' on Instance uuid 5040757b-7100-4cb0-b252-7b52f35ec4ba {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:35:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:35:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Ensure instance console log exists: /opt/stack/data/nova/instances/5040757b-7100-4cb0-b252-7b52f35ec4ba/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:35:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:35:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:35:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:35:19 user nova-compute[72201]: DEBUG nova.network.neutron [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Successfully created port: 56a3c540-5604-47bb-b376-ff0abf5f8f5f {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.network.neutron [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Successfully updated port: 56a3c540-5604-47bb-b376-ff0abf5f8f5f {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Acquiring lock "refresh_cache-5040757b-7100-4cb0-b252-7b52f35ec4ba" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Acquired lock "refresh_cache-5040757b-7100-4cb0-b252-7b52f35ec4ba" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.network.neutron [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.compute.manager [req-cbbd0f93-4031-4091-bd99-e9de88f509b0 req-dd4d7faa-81c1-4795-89a2-48258a65c319 service nova] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Received event network-changed-56a3c540-5604-47bb-b376-ff0abf5f8f5f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.compute.manager [req-cbbd0f93-4031-4091-bd99-e9de88f509b0 req-dd4d7faa-81c1-4795-89a2-48258a65c319 service nova] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Refreshing instance network info cache due to event network-changed-56a3c540-5604-47bb-b376-ff0abf5f8f5f. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cbbd0f93-4031-4091-bd99-e9de88f509b0 req-dd4d7faa-81c1-4795-89a2-48258a65c319 service nova] Acquiring lock "refresh_cache-5040757b-7100-4cb0-b252-7b52f35ec4ba" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.network.neutron [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.network.neutron [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Updating instance_info_cache with network_info: [{"id": "56a3c540-5604-47bb-b376-ff0abf5f8f5f", "address": "fa:16:3e:69:5b:84", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a3c540-56", "ovs_interfaceid": "56a3c540-5604-47bb-b376-ff0abf5f8f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Releasing lock "refresh_cache-5040757b-7100-4cb0-b252-7b52f35ec4ba" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.compute.manager [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Instance network_info: |[{"id": "56a3c540-5604-47bb-b376-ff0abf5f8f5f", "address": "fa:16:3e:69:5b:84", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a3c540-56", "ovs_interfaceid": "56a3c540-5604-47bb-b376-ff0abf5f8f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cbbd0f93-4031-4091-bd99-e9de88f509b0 req-dd4d7faa-81c1-4795-89a2-48258a65c319 service nova] Acquired lock "refresh_cache-5040757b-7100-4cb0-b252-7b52f35ec4ba" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.network.neutron [req-cbbd0f93-4031-4091-bd99-e9de88f509b0 req-dd4d7faa-81c1-4795-89a2-48258a65c319 service nova] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Refreshing network info cache for port 56a3c540-5604-47bb-b376-ff0abf5f8f5f {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Start _get_guest_xml network_info=[{"id": "56a3c540-5604-47bb-b376-ff0abf5f8f5f", "address": "fa:16:3e:69:5b:84", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a3c540-56", "ovs_interfaceid": "56a3c540-5604-47bb-b376-ff0abf5f8f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:35:20 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:35:20 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:35:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1671225041',display_name='tempest-ServersNegativeTestJSON-server-1671225041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1671225041',id=35,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce0e2836d3794cd8b26b8f54a73af7e7',ramdisk_id='',reservation_id='r-kkzblg7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-592631034',owner_user_name='tempest-ServersNegativeTestJSON-592631034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:35:18Z,user_data=None,user_id='382a20da0cdd454181d19da58d22551a',uuid=5040757b-7100-4cb0-b252-7b52f35ec4ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56a3c540-5604-47bb-b376-ff0abf5f8f5f", "address": "fa:16:3e:69:5b:84", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a3c540-56", "ovs_interfaceid": "56a3c540-5604-47bb-b376-ff0abf5f8f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Converting VIF {"id": "56a3c540-5604-47bb-b376-ff0abf5f8f5f", "address": "fa:16:3e:69:5b:84", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a3c540-56", "ovs_interfaceid": "56a3c540-5604-47bb-b376-ff0abf5f8f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:5b:84,bridge_name='br-int',has_traffic_filtering=True,id=56a3c540-5604-47bb-b376-ff0abf5f8f5f,network=Network(76e721f1-1135-4932-9d27-41c013b3c149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56a3c540-56') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.objects.instance [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lazy-loading 'pci_devices' on Instance uuid 5040757b-7100-4cb0-b252-7b52f35ec4ba {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:35:20 user nova-compute[72201]:   <uuid>5040757b-7100-4cb0-b252-7b52f35ec4ba</uuid>
Aug 01 15:35:20 user nova-compute[72201]:   <name>instance-00000023</name>
Aug 01 15:35:20 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:35:20 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:35:20 user nova-compute[72201]:   <metadata>
Aug 01 15:35:20 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:35:20 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:35:20 user nova-compute[72201]:       <nova:name>tempest-ServersNegativeTestJSON-server-1671225041</nova:name>
Aug 01 15:35:20 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:35:20</nova:creationTime>
Aug 01 15:35:20 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:35:20 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:35:20 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:35:20 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:35:20 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:35:20 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:35:20 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:35:20 user nova-compute[72201]:       <nova:owner>
Aug 01 15:35:20 user nova-compute[72201]:         <nova:user uuid="382a20da0cdd454181d19da58d22551a">tempest-ServersNegativeTestJSON-592631034-project-member</nova:user>
Aug 01 15:35:20 user nova-compute[72201]:         <nova:project uuid="ce0e2836d3794cd8b26b8f54a73af7e7">tempest-ServersNegativeTestJSON-592631034</nova:project>
Aug 01 15:35:20 user nova-compute[72201]:       </nova:owner>
Aug 01 15:35:20 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:35:20 user nova-compute[72201]:       <nova:ports>
Aug 01 15:35:20 user nova-compute[72201]:         <nova:port uuid="56a3c540-5604-47bb-b376-ff0abf5f8f5f">
Aug 01 15:35:20 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 15:35:20 user nova-compute[72201]:         </nova:port>
Aug 01 15:35:20 user nova-compute[72201]:       </nova:ports>
Aug 01 15:35:20 user nova-compute[72201]:     </nova:instance>
Aug 01 15:35:20 user nova-compute[72201]:   </metadata>
Aug 01 15:35:20 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:35:20 user nova-compute[72201]:     <system>
Aug 01 15:35:20 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:35:20 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:35:20 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:35:20 user nova-compute[72201]:       <entry name="serial">5040757b-7100-4cb0-b252-7b52f35ec4ba</entry>
Aug 01 15:35:20 user nova-compute[72201]:       <entry name="uuid">5040757b-7100-4cb0-b252-7b52f35ec4ba</entry>
Aug 01 15:35:20 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:35:20 user nova-compute[72201]:     </system>
Aug 01 15:35:20 user nova-compute[72201]:   </sysinfo>
Aug 01 15:35:20 user nova-compute[72201]:   <os>
Aug 01 15:35:20 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:35:20 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:35:20 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:35:20 user nova-compute[72201]:   </os>
Aug 01 15:35:20 user nova-compute[72201]:   <features>
Aug 01 15:35:20 user nova-compute[72201]:     <acpi/>
Aug 01 15:35:20 user nova-compute[72201]:     <apic/>
Aug 01 15:35:20 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:35:20 user nova-compute[72201]:   </features>
Aug 01 15:35:20 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:35:20 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:35:20 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:35:20 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:35:20 user nova-compute[72201]:   </clock>
Aug 01 15:35:20 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:35:20 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:35:20 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:35:20 user nova-compute[72201]:   </cpu>
Aug 01 15:35:20 user nova-compute[72201]:   <devices>
Aug 01 15:35:20 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:35:20 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:35:20 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/5040757b-7100-4cb0-b252-7b52f35ec4ba/disk"/>
Aug 01 15:35:20 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:35:20 user nova-compute[72201]:     </disk>
Aug 01 15:35:20 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:35:20 user nova-compute[72201]:       <mac address="fa:16:3e:69:5b:84"/>
Aug 01 15:35:20 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:35:20 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:35:20 user nova-compute[72201]:       <target dev="tap56a3c540-56"/>
Aug 01 15:35:20 user nova-compute[72201]:     </interface>
Aug 01 15:35:20 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:35:20 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/5040757b-7100-4cb0-b252-7b52f35ec4ba/console.log" append="off"/>
Aug 01 15:35:20 user nova-compute[72201]:     </serial>
Aug 01 15:35:20 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:35:20 user nova-compute[72201]:     <video>
Aug 01 15:35:20 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:35:20 user nova-compute[72201]:     </video>
Aug 01 15:35:20 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:35:20 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:35:20 user nova-compute[72201]:     </rng>
Aug 01 15:35:20 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:35:20 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:35:20 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:35:20 user nova-compute[72201]:     </memballoon>
Aug 01 15:35:20 user nova-compute[72201]:   </devices>
Aug 01 15:35:20 user nova-compute[72201]: </domain>
Aug 01 15:35:20 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:35:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1671225041',display_name='tempest-ServersNegativeTestJSON-server-1671225041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1671225041',id=35,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce0e2836d3794cd8b26b8f54a73af7e7',ramdisk_id='',reservation_id='r-kkzblg7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-592631034',owner_user_name='tempest-ServersNegativeTestJSON-592631034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:35:18Z,user_data=None,user_id='382a20da0cdd454181d19da58d22551a',uuid=5040757b-7100-4cb0-b252-7b52f35ec4ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56a3c540-5604-47bb-b376-ff0abf5f8f5f", "address": "fa:16:3e:69:5b:84", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a3c540-56", "ovs_interfaceid": "56a3c540-5604-47bb-b376-ff0abf5f8f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Converting VIF {"id": "56a3c540-5604-47bb-b376-ff0abf5f8f5f", "address": "fa:16:3e:69:5b:84", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a3c540-56", "ovs_interfaceid": "56a3c540-5604-47bb-b376-ff0abf5f8f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:5b:84,bridge_name='br-int',has_traffic_filtering=True,id=56a3c540-5604-47bb-b376-ff0abf5f8f5f,network=Network(76e721f1-1135-4932-9d27-41c013b3c149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56a3c540-56') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG os_vif [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:5b:84,bridge_name='br-int',has_traffic_filtering=True,id=56a3c540-5604-47bb-b376-ff0abf5f8f5f,network=Network(76e721f1-1135-4932-9d27-41c013b3c149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56a3c540-56') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56a3c540-56, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap56a3c540-56, col_values=(('external_ids', {'iface-id': '56a3c540-5604-47bb-b376-ff0abf5f8f5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:5b:84', 'vm-uuid': '5040757b-7100-4cb0-b252-7b52f35ec4ba'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:20 user nova-compute[72201]: INFO os_vif [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:5b:84,bridge_name='br-int',has_traffic_filtering=True,id=56a3c540-5604-47bb-b376-ff0abf5f8f5f,network=Network(76e721f1-1135-4932-9d27-41c013b3c149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56a3c540-56')
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] No VIF found with MAC fa:16:3e:69:5b:84, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.network.neutron [req-cbbd0f93-4031-4091-bd99-e9de88f509b0 req-dd4d7faa-81c1-4795-89a2-48258a65c319 service nova] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Updated VIF entry in instance network info cache for port 56a3c540-5604-47bb-b376-ff0abf5f8f5f. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG nova.network.neutron [req-cbbd0f93-4031-4091-bd99-e9de88f509b0 req-dd4d7faa-81c1-4795-89a2-48258a65c319 service nova] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Updating instance_info_cache with network_info: [{"id": "56a3c540-5604-47bb-b376-ff0abf5f8f5f", "address": "fa:16:3e:69:5b:84", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a3c540-56", "ovs_interfaceid": "56a3c540-5604-47bb-b376-ff0abf5f8f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:35:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cbbd0f93-4031-4091-bd99-e9de88f509b0 req-dd4d7faa-81c1-4795-89a2-48258a65c319 service nova] Releasing lock "refresh_cache-5040757b-7100-4cb0-b252-7b52f35ec4ba" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:35:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:22 user nova-compute[72201]: DEBUG nova.compute.manager [req-95364585-8388-4a49-9079-274ef78d24e8 req-ce3df00c-e864-460a-8624-e4e629f1426b service nova] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Received event network-vif-plugged-56a3c540-5604-47bb-b376-ff0abf5f8f5f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:35:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-95364585-8388-4a49-9079-274ef78d24e8 req-ce3df00c-e864-460a-8624-e4e629f1426b service nova] Acquiring lock "5040757b-7100-4cb0-b252-7b52f35ec4ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:35:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-95364585-8388-4a49-9079-274ef78d24e8 req-ce3df00c-e864-460a-8624-e4e629f1426b service nova] Lock "5040757b-7100-4cb0-b252-7b52f35ec4ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:35:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-95364585-8388-4a49-9079-274ef78d24e8 req-ce3df00c-e864-460a-8624-e4e629f1426b service nova] Lock "5040757b-7100-4cb0-b252-7b52f35ec4ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:35:22 user nova-compute[72201]: DEBUG nova.compute.manager [req-95364585-8388-4a49-9079-274ef78d24e8 req-ce3df00c-e864-460a-8624-e4e629f1426b service nova] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] No waiting events found dispatching network-vif-plugged-56a3c540-5604-47bb-b376-ff0abf5f8f5f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:35:22 user nova-compute[72201]: WARNING nova.compute.manager [req-95364585-8388-4a49-9079-274ef78d24e8 req-ce3df00c-e864-460a-8624-e4e629f1426b service nova] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Received unexpected event network-vif-plugged-56a3c540-5604-47bb-b376-ff0abf5f8f5f for instance with vm_state building and task_state spawning.
Aug 01 15:35:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:24 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904124.0663462, 5040757b-7100-4cb0-b252-7b52f35ec4ba => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:35:24 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] VM Resumed (Lifecycle Event)
Aug 01 15:35:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:35:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:35:24 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Instance spawned successfully.
Aug 01 15:35:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:35:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:35:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:35:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:35:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:35:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:35:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:35:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:35:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:35:24 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:35:24 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904124.0674534, 5040757b-7100-4cb0-b252-7b52f35ec4ba => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:35:24 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] VM Started (Lifecycle Event)
Aug 01 15:35:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:35:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:35:24 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:35:24 user nova-compute[72201]: DEBUG nova.compute.manager [req-977e6bcd-a02c-426f-802c-7e87486f355d req-6ac398a8-8343-437e-9e49-5f65fac13f08 service nova] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Received event network-vif-plugged-56a3c540-5604-47bb-b376-ff0abf5f8f5f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:35:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-977e6bcd-a02c-426f-802c-7e87486f355d req-6ac398a8-8343-437e-9e49-5f65fac13f08 service nova] Acquiring lock "5040757b-7100-4cb0-b252-7b52f35ec4ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:35:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-977e6bcd-a02c-426f-802c-7e87486f355d req-6ac398a8-8343-437e-9e49-5f65fac13f08 service nova] Lock "5040757b-7100-4cb0-b252-7b52f35ec4ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:35:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-977e6bcd-a02c-426f-802c-7e87486f355d req-6ac398a8-8343-437e-9e49-5f65fac13f08 service nova] Lock "5040757b-7100-4cb0-b252-7b52f35ec4ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:35:24 user nova-compute[72201]: DEBUG nova.compute.manager [req-977e6bcd-a02c-426f-802c-7e87486f355d req-6ac398a8-8343-437e-9e49-5f65fac13f08 service nova] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] No waiting events found dispatching network-vif-plugged-56a3c540-5604-47bb-b376-ff0abf5f8f5f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:35:24 user nova-compute[72201]: WARNING nova.compute.manager [req-977e6bcd-a02c-426f-802c-7e87486f355d req-6ac398a8-8343-437e-9e49-5f65fac13f08 service nova] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Received unexpected event network-vif-plugged-56a3c540-5604-47bb-b376-ff0abf5f8f5f for instance with vm_state building and task_state spawning.
Aug 01 15:35:24 user nova-compute[72201]: INFO nova.compute.manager [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Took 5.63 seconds to spawn the instance on the hypervisor.
Aug 01 15:35:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:35:24 user nova-compute[72201]: INFO nova.compute.manager [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Took 6.52 seconds to build instance.
Aug 01 15:35:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-597d1d3d-8bb1-4091-9ce2-dbc5cbd1aef0 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "5040757b-7100-4cb0-b252-7b52f35ec4ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.686s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:35:25 user nova-compute[72201]: INFO nova.compute.manager [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Terminating instance
Aug 01 15:35:25 user nova-compute[72201]: DEBUG nova.compute.manager [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-5ddea54f-727a-487c-a2ab-619d5a560ad3 req-880742df-bb2f-4f0a-80c3-b012a5d9a1ae service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received event network-vif-unplugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5ddea54f-727a-487c-a2ab-619d5a560ad3 req-880742df-bb2f-4f0a-80c3-b012a5d9a1ae service nova] Acquiring lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5ddea54f-727a-487c-a2ab-619d5a560ad3 req-880742df-bb2f-4f0a-80c3-b012a5d9a1ae service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5ddea54f-727a-487c-a2ab-619d5a560ad3 req-880742df-bb2f-4f0a-80c3-b012a5d9a1ae service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-5ddea54f-727a-487c-a2ab-619d5a560ad3 req-880742df-bb2f-4f0a-80c3-b012a5d9a1ae service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] No waiting events found dispatching network-vif-unplugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-5ddea54f-727a-487c-a2ab-619d5a560ad3 req-880742df-bb2f-4f0a-80c3-b012a5d9a1ae service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received event network-vif-unplugged-983acc56-f35e-463b-9792-e837ce96710d for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:25 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Instance destroyed successfully.
Aug 01 15:35:25 user nova-compute[72201]: DEBUG nova.objects.instance [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'resources' on Instance uuid 9e946b4a-9b93-459f-8e5e-d88612c4ec34 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1814665883',display_name='tempest-ServerRescueNegativeTestJSON-server-1814665883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1814665883',id=25,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5njYzs7ALDcBWQSpVvDF+8eqtD/Nud28PRDonSHT12d1GA4E+ONV1w236vrdEKCSPLvrSiG9PlbH87hDgkoI2dCf1VNNLJnIgp5Ae3jA2xzUAVN6UK1g1BY7za6MohKg==',key_name='tempest-keypair-1891226028',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:30:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f130c48f19cf4ab7803c1169b759ccb6',ramdisk_id='',reservation_id='r-d77b8fyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-773079660',owner_user_name='tempest-ServerRescueNegativeTestJSON-773079660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:32:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31a432c1165e4ff4a9a10b4d71ddc513',uuid=9e946b4a-9b93-459f-8e5e-d88612c4ec34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "983acc56-f35e-463b-9792-e837ce96710d", "address": "fa:16:3e:28:f5:cf", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983acc56-f3", "ovs_interfaceid": "983acc56-f35e-463b-9792-e837ce96710d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converting VIF {"id": "983acc56-f35e-463b-9792-e837ce96710d", "address": "fa:16:3e:28:f5:cf", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983acc56-f3", "ovs_interfaceid": "983acc56-f35e-463b-9792-e837ce96710d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:f5:cf,bridge_name='br-int',has_traffic_filtering=True,id=983acc56-f35e-463b-9792-e837ce96710d,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983acc56-f3') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG os_vif [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:f5:cf,bridge_name='br-int',has_traffic_filtering=True,id=983acc56-f35e-463b-9792-e837ce96710d,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983acc56-f3') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap983acc56-f3, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:35:25 user nova-compute[72201]: INFO os_vif [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:f5:cf,bridge_name='br-int',has_traffic_filtering=True,id=983acc56-f35e-463b-9792-e837ce96710d,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983acc56-f3')
Aug 01 15:35:25 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Deleting instance files /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34_del
Aug 01 15:35:25 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Deletion of /opt/stack/data/nova/instances/9e946b4a-9b93-459f-8e5e-d88612c4ec34_del complete
Aug 01 15:35:25 user nova-compute[72201]: INFO nova.compute.manager [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 15:35:25 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:35:26 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:35:26 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:35:26 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:35:26 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Took 0.92 seconds to deallocate network for instance.
Aug 01 15:35:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:35:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:35:27 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:35:27 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:35:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:35:27 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Deleted allocations for instance 9e946b4a-9b93-459f-8e5e-d88612c4ec34
Aug 01 15:35:27 user nova-compute[72201]: DEBUG nova.compute.manager [req-1fe9ea7b-ef16-493b-b213-8502bdf9c17e req-b7a36993-c19f-44e1-8321-d09cd4442129 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received event network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:35:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1fe9ea7b-ef16-493b-b213-8502bdf9c17e req-b7a36993-c19f-44e1-8321-d09cd4442129 service nova] Acquiring lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:35:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1fe9ea7b-ef16-493b-b213-8502bdf9c17e req-b7a36993-c19f-44e1-8321-d09cd4442129 service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:35:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1fe9ea7b-ef16-493b-b213-8502bdf9c17e req-b7a36993-c19f-44e1-8321-d09cd4442129 service nova] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:35:27 user nova-compute[72201]: DEBUG nova.compute.manager [req-1fe9ea7b-ef16-493b-b213-8502bdf9c17e req-b7a36993-c19f-44e1-8321-d09cd4442129 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] No waiting events found dispatching network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:35:27 user nova-compute[72201]: WARNING nova.compute.manager [req-1fe9ea7b-ef16-493b-b213-8502bdf9c17e req-b7a36993-c19f-44e1-8321-d09cd4442129 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received unexpected event network-vif-plugged-983acc56-f35e-463b-9792-e837ce96710d for instance with vm_state deleted and task_state None.
Aug 01 15:35:27 user nova-compute[72201]: DEBUG nova.compute.manager [req-1fe9ea7b-ef16-493b-b213-8502bdf9c17e req-b7a36993-c19f-44e1-8321-d09cd4442129 service nova] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Received event network-vif-deleted-983acc56-f35e-463b-9792-e837ce96710d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:35:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e570f8a2-3425-4a95-8901-7a4fb29ef45c tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "9e946b4a-9b93-459f-8e5e-d88612c4ec34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.371s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:35:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:35:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "bd70360d-30b8-47d5-b35e-adf0d28482dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:35:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:35:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:35:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:35:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:35:39 user nova-compute[72201]: INFO nova.compute.manager [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Terminating instance
Aug 01 15:35:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:35:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-90412317-c990-42ab-8201-196fa3ea1a68 req-17dc3c82-a648-4f70-90ca-bf0201a84040 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Received event network-vif-unplugged-9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:35:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-90412317-c990-42ab-8201-196fa3ea1a68 req-17dc3c82-a648-4f70-90ca-bf0201a84040 service nova] Acquiring lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:35:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-90412317-c990-42ab-8201-196fa3ea1a68 req-17dc3c82-a648-4f70-90ca-bf0201a84040 service nova] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:35:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-90412317-c990-42ab-8201-196fa3ea1a68 req-17dc3c82-a648-4f70-90ca-bf0201a84040 service nova] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:35:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-90412317-c990-42ab-8201-196fa3ea1a68 req-17dc3c82-a648-4f70-90ca-bf0201a84040 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] No waiting events found dispatching network-vif-unplugged-9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:35:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-90412317-c990-42ab-8201-196fa3ea1a68 req-17dc3c82-a648-4f70-90ca-bf0201a84040 service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Received event network-vif-unplugged-9640f8a6-86a4-403c-9dac-06c68368d6dd for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:35:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:40 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Instance destroyed successfully.
Aug 01 15:35:40 user nova-compute[72201]: DEBUG nova.objects.instance [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lazy-loading 'resources' on Instance uuid bd70360d-30b8-47d5-b35e-adf0d28482dd {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-831320262',display_name='tempest-ServerActionsTestOtherA-server-831320262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-831320262',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj9M7ZGdr6vvGAAN6LlX0Yd4KFWs7o7dSiIrZzG0de25MryOgdU0IQWkOsGcYGYZLChUKVpEI60JU+ZGbYHXhk4M5ia3Yx+QGjlFCbCEmncodiyKPCipVQmd8JPh2FoTg==',key_name='tempest-keypair-1499887671',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:31:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e85c7d5f159c4ff2896b5549cf73b977',ramdisk_id='',reservation_id='r-ce52lrt8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-765053637',owner_user_name='tempest-ServerActionsTestOtherA-765053637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:32:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ccd18b99219749fe8febdc0da8fc4388',uuid=bd70360d-30b8-47d5-b35e-adf0d28482dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "address": "fa:16:3e:9c:ca:83", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9640f8a6-86", "ovs_interfaceid": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converting VIF {"id": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "address": "fa:16:3e:9c:ca:83", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9640f8a6-86", "ovs_interfaceid": "9640f8a6-86a4-403c-9dac-06c68368d6dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:ca:83,bridge_name='br-int',has_traffic_filtering=True,id=9640f8a6-86a4-403c-9dac-06c68368d6dd,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9640f8a6-86') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG os_vif [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:ca:83,bridge_name='br-int',has_traffic_filtering=True,id=9640f8a6-86a4-403c-9dac-06c68368d6dd,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9640f8a6-86') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9640f8a6-86, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:40 user nova-compute[72201]: INFO os_vif [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:ca:83,bridge_name='br-int',has_traffic_filtering=True,id=9640f8a6-86a4-403c-9dac-06c68368d6dd,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9640f8a6-86')
Aug 01 15:35:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SJcMhgkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:35:40 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:35:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25b616a-26da-4b80-a149-78efdea662c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e50850-73b8-4949-a918-c5a156333dea]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:35:40 user nova-compute[72201]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:35:40 user nova-compute[72201]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)
Aug 01 15:35:40 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 (non-flash)
Aug 01 15:35:40 user nova-compute[72201]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:35:40 user nova-compute[72201]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)
Aug 01 15:35:40 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c682950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7'): ({'sdd'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Removing single pathed devices sdd {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb0dbc8-652b-4643-84eb-5d17161daf55]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fd1e86-adf6-423a-9438-289425b954d3]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Flushing IO for device /dev/sdd {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[44125bc8-b3fc-4150-be1c-371b45cb25be]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56349a0-a4b3-497b-a4a0-2772ac71ceab]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] SCSI volumes sdd have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_44dcb114', '/dev/disk/by-id/scsi-1SCST_BIO44dcb114-82c418d890c55c30', '/dev/disk/by-id/scsi-23832633431386438') {{(pid=83290) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fced58-0950-45c3-b3b6-6b79b1b4f0d8]: (4, None) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc698c30-dc9d-4116-b270-661a85e36330]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa4fa56-5a19-4887-85f9-b44eb89ea091]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7, portal: 172.16.0.220,3260]
Aug 01 15:35:40 user nova-compute[72201]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7, portal: 172.16.0.220,3260] successful.
Aug 01 15:35:40 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafe4229-fc2f-4762-9f5e-bc38736d076d]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] <== disconnect_volume: return (305ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:35:40 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Deleting instance files /opt/stack/data/nova/instances/bd70360d-30b8-47d5-b35e-adf0d28482dd_del
Aug 01 15:35:40 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Deletion of /opt/stack/data/nova/instances/bd70360d-30b8-47d5-b35e-adf0d28482dd_del complete
Aug 01 15:35:40 user nova-compute[72201]: INFO nova.compute.manager [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 01 15:35:40 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:35:40 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690904125.893917, 9e946b4a-9b93-459f-8e5e-d88612c4ec34 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:35:40 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] VM Stopped (Lifecycle Event)
Aug 01 15:35:40 user nova-compute[72201]: DEBUG nova.compute.manager [None req-54173e4d-d42e-4e1f-9c89-7c5e2fce1577 None None] [instance: 9e946b4a-9b93-459f-8e5e-d88612c4ec34] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:35:41 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:35:41 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Took 0.78 seconds to deallocate network for instance.
Aug 01 15:35:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-673e3721-e379-4eca-8382-b7f114cf13a7 req-f5cbb970-7493-4fb7-b642-bc699785e41e service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Received event network-vif-plugged-9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:35:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-673e3721-e379-4eca-8382-b7f114cf13a7 req-f5cbb970-7493-4fb7-b642-bc699785e41e service nova] Acquiring lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:35:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-673e3721-e379-4eca-8382-b7f114cf13a7 req-f5cbb970-7493-4fb7-b642-bc699785e41e service nova] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:35:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-673e3721-e379-4eca-8382-b7f114cf13a7 req-f5cbb970-7493-4fb7-b642-bc699785e41e service nova] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:35:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-673e3721-e379-4eca-8382-b7f114cf13a7 req-f5cbb970-7493-4fb7-b642-bc699785e41e service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] No waiting events found dispatching network-vif-plugged-9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:35:41 user nova-compute[72201]: WARNING nova.compute.manager [req-673e3721-e379-4eca-8382-b7f114cf13a7 req-f5cbb970-7493-4fb7-b642-bc699785e41e service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Received unexpected event network-vif-plugged-9640f8a6-86a4-403c-9dac-06c68368d6dd for instance with vm_state active and task_state deleting.
Aug 01 15:35:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-673e3721-e379-4eca-8382-b7f114cf13a7 req-f5cbb970-7493-4fb7-b642-bc699785e41e service nova] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Received event network-vif-deleted-9640f8a6-86a4-403c-9dac-06c68368d6dd {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:35:42 user nova-compute[72201]: INFO nova.compute.manager [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Took 0.75 seconds to detach 1 volumes for instance.
Aug 01 15:35:42 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Deleting volume: a3fc5574-1c65-46a3-9e0b-85f222ac4cb7 {{(pid=72201) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 15:35:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:35:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:35:42 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:35:42 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:35:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:35:42 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Deleted allocations for instance bd70360d-30b8-47d5-b35e-adf0d28482dd
Aug 01 15:35:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d632f75b-b61b-4c15-905b-f8079c7ddafa tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "bd70360d-30b8-47d5-b35e-adf0d28482dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.187s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:35:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:55 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690904140.096609, bd70360d-30b8-47d5-b35e-adf0d28482dd => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:35:55 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] VM Stopped (Lifecycle Event)
Aug 01 15:35:55 user nova-compute[72201]: DEBUG nova.compute.manager [None req-65c19439-d598-4847-a4a7-d91141d58e0c None None] [instance: bd70360d-30b8-47d5-b35e-adf0d28482dd] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:35:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:35:57 user nova-compute[72201]: DEBUG nova.compute.manager [req-b635ff0d-6ad2-4f9c-93cf-38da993c9e3d req-88b9cf97-edbc-49e3-855c-912a6e905093 service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Received event network-changed-ebb58ee4-b7ff-470c-9599-fb635cfbd89f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:35:57 user nova-compute[72201]: DEBUG nova.compute.manager [req-b635ff0d-6ad2-4f9c-93cf-38da993c9e3d req-88b9cf97-edbc-49e3-855c-912a6e905093 service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Refreshing instance network info cache due to event network-changed-ebb58ee4-b7ff-470c-9599-fb635cfbd89f. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:35:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b635ff0d-6ad2-4f9c-93cf-38da993c9e3d req-88b9cf97-edbc-49e3-855c-912a6e905093 service nova] Acquiring lock "refresh_cache-20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:35:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b635ff0d-6ad2-4f9c-93cf-38da993c9e3d req-88b9cf97-edbc-49e3-855c-912a6e905093 service nova] Acquired lock "refresh_cache-20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:35:57 user nova-compute[72201]: DEBUG nova.network.neutron [req-b635ff0d-6ad2-4f9c-93cf-38da993c9e3d req-88b9cf97-edbc-49e3-855c-912a6e905093 service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Refreshing network info cache for port ebb58ee4-b7ff-470c-9599-fb635cfbd89f {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:35:58 user nova-compute[72201]: DEBUG nova.network.neutron [req-b635ff0d-6ad2-4f9c-93cf-38da993c9e3d req-88b9cf97-edbc-49e3-855c-912a6e905093 service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Updated VIF entry in instance network info cache for port ebb58ee4-b7ff-470c-9599-fb635cfbd89f. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:35:58 user nova-compute[72201]: DEBUG nova.network.neutron [req-b635ff0d-6ad2-4f9c-93cf-38da993c9e3d req-88b9cf97-edbc-49e3-855c-912a6e905093 service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Updating instance_info_cache with network_info: [{"id": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "address": "fa:16:3e:5a:be:b2", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb58ee4-b7", "ovs_interfaceid": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:35:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b635ff0d-6ad2-4f9c-93cf-38da993c9e3d req-88b9cf97-edbc-49e3-855c-912a6e905093 service nova] Releasing lock "refresh_cache-20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:35:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:01 user nova-compute[72201]: DEBUG nova.objects.instance [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lazy-loading 'flavor' on Instance uuid 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:36:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:01 user nova-compute[72201]: INFO nova.compute.manager [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Attaching volume 5282c4d4-1f5d-41e2-a089-dec505333ebd to /dev/vdb
Aug 01 15:36:02 user nova-compute[72201]: DEBUG os_brick.utils [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:36:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed26cf43-9d5d-45bd-a4f8-47ccb38f5a20]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cbef79-2bc4-4e53-98f1-b80fc49a4ae8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47277c2-e58a-49d4-8034-46953e734e4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[043736e5-074e-41c2-bca7-b2e0c69a4244]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:36:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:36:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:36:02 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:36:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[456cddf6-34c6-4538-bbb4-41845bd329f0]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:36:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:36:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:36:02 user nova-compute[72201]: DEBUG os_brick.utils [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:36:02 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Updating existing volume attachment record: cd4dcdf5-c954-4e7f-8296-11ab80624f39 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:36:03 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:36:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:05 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:36:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:06 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:36:06 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72201) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 15:36:07 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:36:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FLQMlfoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:36:09 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:36:09 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:36:09 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a8642d-e253-4548-aa6a-cc28de532e03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:36:09 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[70811702-8700-4834-927b-6a37a1b4016d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd] added
Aug 01 15:36:09 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3867a3c0-5bcb-4e56-bb70-186a9645ccfd]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[782416b3-2eb2-4160-b607-a4b9a2df05a2]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FLQMlfoJ {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FLQMlfoJ" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Updating instance_info_cache with network_info: [{"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f617d6-78f1-48d3-b234-6f1eb5df920d]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FLQMlfoJ'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-9530577b-69a6-45bc-a33b-1dc60d69a16f" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[67809bf1-34be-4f66-b1eb-adb9c8dba51f]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d597cf-47e2-4967-9c1d-653cccc5ef1b]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:36:09 user nova-compute[72201]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)
Aug 01 15:36:09 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:36:09 user nova-compute[72201]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)
Aug 01 15:36:09 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad7d26a-ec71-43de-a1d5-c4d7df69a8a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd, portal: 172.16.0.220,3260]
Aug 01 15:36:09 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd, portal: 172.16.0.220,3260] successful.
Aug 01 15:36:09 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0ed69d-4440-4f35-909f-27bcd452bc43]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9329e6b-d354-480a-8749-4af2aa831793]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:36:09 user nova-compute[72201]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)
Aug 01 15:36:09 user nova-compute[72201]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd (non-flash)
Aug 01 15:36:09 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:36:09 user nova-compute[72201]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)
Aug 01 15:36:09 user nova-compute[72201]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd (non-flash)
Aug 01 15:36:09 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4ab32c-75ce-4e3e-a7a6-9e3587e3c2d1]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:36:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FLQMlfoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:36:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:36:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23736393230363764', 'path': '/dev/sdd'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:36:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736393230363764', 'path': '/dev/sdd'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:36:10 user nova-compute[72201]: DEBUG nova.objects.instance [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lazy-loading 'flavor' on Instance uuid 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:36:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:36:10 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:36:10 user nova-compute[72201]:   <source dev="/dev/sdd"/>
Aug 01 15:36:10 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:36:10 user nova-compute[72201]:   <serial>5282c4d4-1f5d-41e2-a089-dec505333ebd</serial>
Aug 01 15:36:10 user nova-compute[72201]: </disk>
Aug 01 15:36:10 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:36:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:36:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:36:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] No VIF found with MAC fa:16:3e:5a:be:b2, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:36:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c22013d4-2175-4f5c-ab7e-6145f3125b70 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.498s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:11 user nova-compute[72201]: INFO nova.compute.manager [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Detaching volume 5282c4d4-1f5d-41e2-a089-dec505333ebd
Aug 01 15:36:12 user nova-compute[72201]: INFO nova.virt.block_device [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Attempting to driver detach volume 5282c4d4-1f5d-41e2-a089-dec505333ebd from mountpoint /dev/vdb
Aug 01 15:36:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Attempting to detach device vdb from instance 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:36:12 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:36:12 user nova-compute[72201]:   <source dev="/dev/sdd"/>
Aug 01 15:36:12 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:36:12 user nova-compute[72201]:   <serial>5282c4d4-1f5d-41e2-a089-dec505333ebd</serial>
Aug 01 15:36:12 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:36:12 user nova-compute[72201]: </disk>
Aug 01 15:36:12 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:36:12 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Successfully detached device vdb from instance 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d from the persistent domain config.
Aug 01 15:36:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:36:12 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:36:12 user nova-compute[72201]:   <source dev="/dev/sdd"/>
Aug 01 15:36:12 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:36:12 user nova-compute[72201]:   <serial>5282c4d4-1f5d-41e2-a089-dec505333ebd</serial>
Aug 01 15:36:12 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:36:12 user nova-compute[72201]: </disk>
Aug 01 15:36:12 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690904172.4522903, 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:36:12 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Successfully detached device vdb from instance 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d from the live domain config.
Aug 01 15:36:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FLQMlfoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:36:12 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:36:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[364704fa-b8de-4d95-81f9-b047a2a820d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[25acb15e-b704-467e-a30f-73bcfed64f8b]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:36:12 user nova-compute[72201]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)
Aug 01 15:36:12 user nova-compute[72201]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd (non-flash)
Aug 01 15:36:12 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:36:12 user nova-compute[72201]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)
Aug 01 15:36:12 user nova-compute[72201]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd (non-flash)
Aug 01 15:36:12 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5444e8ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd'): ({'sdd'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Removing single pathed devices sdd {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cb184c-7259-4b62-93a2-f8fc9d73cc4e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a09840-cc72-4021-93dd-a24860820140]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Flushing IO for device /dev/sdd {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c5bf19-cb34-4117-b3da-3f59ebe1e7ec]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[84680678-5531-46ce-b2ff-a609b8b1b85a]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] SCSI volumes sdd have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afedf61-ef0f-456f-9752-5bfce4871908]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe9c75d-1f23-4f18-a49e-7bef74de4d8a]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd, portal: 172.16.0.220,3260]
Aug 01 15:36:12 user nova-compute[72201]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd, portal: 172.16.0.220,3260] successful.
Aug 01 15:36:12 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5282c4d4-1f5d-41e2-a089-dec505333ebd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79be24e-431e-4d8a-84cb-822eea0c95ff]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.245s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] <== disconnect_volume: return (246ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:36:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:36:13 user nova-compute[72201]: DEBUG nova.objects.instance [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lazy-loading 'flavor' on Instance uuid 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:36:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-864a8ddd-7775-495c-bd5f-9d32f927447e tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.500s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:14 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:36:14 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:36:14 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:36:14 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:36:15 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:36:15 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:36:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:15 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:36:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:36:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:36:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5040757b-7100-4cb0-b252-7b52f35ec4ba/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5040757b-7100-4cb0-b252-7b52f35ec4ba/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5040757b-7100-4cb0-b252-7b52f35ec4ba/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5040757b-7100-4cb0-b252-7b52f35ec4ba/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:18 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:36:18 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:36:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=7483MB free_disk=25.347393035888672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:36:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance b64f1cfb-64f2-4493-8721-fc63fcd93bb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:36:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e2ca19ea-868c-40ad-a453-f6e348cfac15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:36:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 0f059ccc-f609-4cf3-a644-c3d1305ae26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:36:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 9530577b-69a6-45bc-a33b-1dc60d69a16f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:36:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 929ed2b3-a72e-424e-94c4-352c207442ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:36:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:36:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 02353c28-57e8-4209-914a-99b61fe14ba8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:36:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance a7721f4d-4a5b-4196-9358-9126426566f0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:36:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 5040757b-7100-4cb0-b252-7b52f35ec4ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:36:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:36:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:36:18 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing inventories for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 15:36:18 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating ProviderTree inventory for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 15:36:18 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating inventory in ProviderTree for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 15:36:18 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing aggregate associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, aggregates: None {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 15:36:18 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing trait associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 15:36:18 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:36:18 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:36:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:36:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.734s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG nova.compute.manager [req-3fafcd25-13b6-40c4-8801-e6a1f1eb3918 req-4e75540c-4044-44ac-9fee-f1cc5a094e48 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Received event network-changed-c4efc73b-8686-49b1-81bc-722a3dc7c322 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG nova.compute.manager [req-3fafcd25-13b6-40c4-8801-e6a1f1eb3918 req-4e75540c-4044-44ac-9fee-f1cc5a094e48 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Refreshing instance network info cache due to event network-changed-c4efc73b-8686-49b1-81bc-722a3dc7c322. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3fafcd25-13b6-40c4-8801-e6a1f1eb3918 req-4e75540c-4044-44ac-9fee-f1cc5a094e48 service nova] Acquiring lock "refresh_cache-02353c28-57e8-4209-914a-99b61fe14ba8" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3fafcd25-13b6-40c4-8801-e6a1f1eb3918 req-4e75540c-4044-44ac-9fee-f1cc5a094e48 service nova] Acquired lock "refresh_cache-02353c28-57e8-4209-914a-99b61fe14ba8" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG nova.network.neutron [req-3fafcd25-13b6-40c4-8801-e6a1f1eb3918 req-4e75540c-4044-44ac-9fee-f1cc5a094e48 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Refreshing network info cache for port c4efc73b-8686-49b1-81bc-722a3dc7c322 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "02353c28-57e8-4209-914a-99b61fe14ba8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "02353c28-57e8-4209-914a-99b61fe14ba8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG nova.objects.instance [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lazy-loading 'flavor' on Instance uuid 02353c28-57e8-4209-914a-99b61fe14ba8 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:36:20 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Ignoring supplied device name: /dev/vdb
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "02353c28-57e8-4209-914a-99b61fe14ba8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "02353c28-57e8-4209-914a-99b61fe14ba8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "02353c28-57e8-4209-914a-99b61fe14ba8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:20 user nova-compute[72201]: INFO nova.compute.manager [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Attaching volume 7b5020f1-150a-4155-a962-c66601250540 to /dev/vdb
Aug 01 15:36:20 user nova-compute[72201]: DEBUG os_brick.utils [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef75306-eeb5-4d9b-9bb1-9dd3e4df5359]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[299d3566-d121-415c-b2e3-26849b04d3d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG nova.network.neutron [req-3fafcd25-13b6-40c4-8801-e6a1f1eb3918 req-4e75540c-4044-44ac-9fee-f1cc5a094e48 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Updated VIF entry in instance network info cache for port c4efc73b-8686-49b1-81bc-722a3dc7c322. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG nova.network.neutron [req-3fafcd25-13b6-40c4-8801-e6a1f1eb3918 req-4e75540c-4044-44ac-9fee-f1cc5a094e48 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Updating instance_info_cache with network_info: [{"id": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "address": "fa:16:3e:1b:a3:5c", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4efc73b-86", "ovs_interfaceid": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08ef243-5607-42c8-839c-18fd1f05492a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe77dd32-c456-470a-b458-248600c0c5c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3fafcd25-13b6-40c4-8801-e6a1f1eb3918 req-4e75540c-4044-44ac-9fee-f1cc5a094e48 service nova] Releasing lock "refresh_cache-02353c28-57e8-4209-914a-99b61fe14ba8" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:36:20 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:36:20 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[298b6a4a-5bdf-4a93-b547-8fd5372f4f13]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG os_brick.utils [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:36:20 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Updating existing volume attachment record: 2ab184ee-ec95-4b4d-bae0-050911094816 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid b64f1cfb-64f2-4493-8721-fc63fcd93bb6 {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid e2ca19ea-868c-40ad-a453-f6e348cfac15 {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid 0f059ccc-f609-4cf3-a644-c3d1305ae26e {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid 9530577b-69a6-45bc-a33b-1dc60d69a16f {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid 929ed2b3-a72e-424e-94c4-352c207442ec {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid 02353c28-57e8-4209-914a-99b61fe14ba8 {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid a7721f4d-4a5b-4196-9358-9126426566f0 {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid 5040757b-7100-4cb0-b252-7b52f35ec4ba {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "e2ca19ea-868c-40ad-a453-f6e348cfac15" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "9530577b-69a6-45bc-a33b-1dc60d69a16f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "929ed2b3-a72e-424e-94c4-352c207442ec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "929ed2b3-a72e-424e-94c4-352c207442ec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "02353c28-57e8-4209-914a-99b61fe14ba8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "a7721f4d-4a5b-4196-9358-9126426566f0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "a7721f4d-4a5b-4196-9358-9126426566f0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "5040757b-7100-4cb0-b252-7b52f35ec4ba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "5040757b-7100-4cb0-b252-7b52f35ec4ba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "929ed2b3-a72e-424e-94c4-352c207442ec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "5040757b-7100-4cb0-b252-7b52f35ec4ba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "a7721f4d-4a5b-4196-9358-9126426566f0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:22 user nova-compute[72201]: DEBUG nova.compute.manager [req-d1c394a1-616a-4090-9ecb-b9a0cb34e494 req-70fb9c57-c1c6-4e62-9608-2a6787172348 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received event network-changed-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:36:22 user nova-compute[72201]: DEBUG nova.compute.manager [req-d1c394a1-616a-4090-9ecb-b9a0cb34e494 req-70fb9c57-c1c6-4e62-9608-2a6787172348 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Refreshing instance network info cache due to event network-changed-3ca61173-de45-4386-a12b-9ecdf45b29d9. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:36:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d1c394a1-616a-4090-9ecb-b9a0cb34e494 req-70fb9c57-c1c6-4e62-9608-2a6787172348 service nova] Acquiring lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:36:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d1c394a1-616a-4090-9ecb-b9a0cb34e494 req-70fb9c57-c1c6-4e62-9608-2a6787172348 service nova] Acquired lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:36:22 user nova-compute[72201]: DEBUG nova.network.neutron [req-d1c394a1-616a-4090-9ecb-b9a0cb34e494 req-70fb9c57-c1c6-4e62-9608-2a6787172348 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Refreshing network info cache for port 3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:36:22 user nova-compute[72201]: DEBUG nova.network.neutron [req-d1c394a1-616a-4090-9ecb-b9a0cb34e494 req-70fb9c57-c1c6-4e62-9608-2a6787172348 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Updated VIF entry in instance network info cache for port 3ca61173-de45-4386-a12b-9ecdf45b29d9. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:36:22 user nova-compute[72201]: DEBUG nova.network.neutron [req-d1c394a1-616a-4090-9ecb-b9a0cb34e494 req-70fb9c57-c1c6-4e62-9608-2a6787172348 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Updating instance_info_cache with network_info: [{"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:36:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d1c394a1-616a-4090-9ecb-b9a0cb34e494 req-70fb9c57-c1c6-4e62-9608-2a6787172348 service nova] Releasing lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:36:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquiring lock "a7721f4d-4a5b-4196-9358-9126426566f0" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "a7721f4d-4a5b-4196-9358-9126426566f0" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:22 user nova-compute[72201]: INFO nova.compute.manager [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Shelve offloading
Aug 01 15:36:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-a1801f65-ba3e-41f1-8e2c-2fb64c89567e req-561910ec-eb29-4e0d-a9b2-b4535b3cbc39 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received event network-vif-unplugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:36:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a1801f65-ba3e-41f1-8e2c-2fb64c89567e req-561910ec-eb29-4e0d-a9b2-b4535b3cbc39 service nova] Acquiring lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a1801f65-ba3e-41f1-8e2c-2fb64c89567e req-561910ec-eb29-4e0d-a9b2-b4535b3cbc39 service nova] Lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a1801f65-ba3e-41f1-8e2c-2fb64c89567e req-561910ec-eb29-4e0d-a9b2-b4535b3cbc39 service nova] Lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-a1801f65-ba3e-41f1-8e2c-2fb64c89567e req-561910ec-eb29-4e0d-a9b2-b4535b3cbc39 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] No waiting events found dispatching network-vif-unplugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:36:23 user nova-compute[72201]: WARNING nova.compute.manager [req-a1801f65-ba3e-41f1-8e2c-2fb64c89567e req-561910ec-eb29-4e0d-a9b2-b4535b3cbc39 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received unexpected event network-vif-unplugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 for instance with vm_state active and task_state shelving.
Aug 01 15:36:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:23 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Instance destroyed successfully.
Aug 01 15:36:23 user nova-compute[72201]: DEBUG nova.compute.manager [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:36:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquiring lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:36:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquired lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:36:23 user nova-compute[72201]: DEBUG nova.network.neutron [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:36:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:24 user nova-compute[72201]: DEBUG nova.network.neutron [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Updating instance_info_cache with network_info: [{"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:36:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Releasing lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:36:25 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Instance destroyed successfully.
Aug 01 15:36:25 user nova-compute[72201]: DEBUG nova.objects.instance [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lazy-loading 'resources' on Instance uuid a7721f4d-4a5b-4196-9358-9126426566f0 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:34:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-540186684',display_name='tempest-TestShelveInstance-server-540186684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-540186684',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsS8OvfaRGk693yFtpHMMn1bjidzbjAJvJwchxy+re0xxLrLl1tBj97I2/hrLO28yDkro0x84MfikDrXYUibDS8jklejvz69Wj1Ib7AjIUqAgrXWPmcBhfFo66aXZArCw==',key_name='tempest-TestShelveInstance-1065743790',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:34:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2de91196332140e7abe9ae60574c68cc',ramdisk_id='',reservation_id='r-nugea08p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2040618803',owner_user_name='tempest-TestShelveInstance-2040618803-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:34:45Z,user_data=None,user_id='54744ee637ec4f6989f6bded4bd01a28',uuid=a7721f4d-4a5b-4196-9358-9126426566f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Converting VIF {"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:cd:b4,bridge_name='br-int',has_traffic_filtering=True,id=3ca61173-de45-4386-a12b-9ecdf45b29d9,network=Network(8a16a227-fcc9-46cf-a739-1697d1fd78e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca61173-de') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG os_vif [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:cd:b4,bridge_name='br-int',has_traffic_filtering=True,id=3ca61173-de45-4386-a12b-9ecdf45b29d9,network=Network(8a16a227-fcc9-46cf-a739-1697d1fd78e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca61173-de') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ca61173-de, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:36:25 user nova-compute[72201]: INFO os_vif [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:cd:b4,bridge_name='br-int',has_traffic_filtering=True,id=3ca61173-de45-4386-a12b-9ecdf45b29d9,network=Network(8a16a227-fcc9-46cf-a739-1697d1fd78e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca61173-de')
Aug 01 15:36:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YwXuUipm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:36:25 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:36:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1a8e80-b1ef-4044-8117-18700e09e8c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-889adb94-1915-4e3a-9d34-4f707bb63624 req-9306b5d0-6880-445d-9ade-13fdd1c51e3e service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received event network-changed-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-889adb94-1915-4e3a-9d34-4f707bb63624 req-9306b5d0-6880-445d-9ade-13fdd1c51e3e service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Refreshing instance network info cache due to event network-changed-3ca61173-de45-4386-a12b-9ecdf45b29d9. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-889adb94-1915-4e3a-9d34-4f707bb63624 req-9306b5d0-6880-445d-9ade-13fdd1c51e3e service nova] Acquiring lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-889adb94-1915-4e3a-9d34-4f707bb63624 req-9306b5d0-6880-445d-9ade-13fdd1c51e3e service nova] Acquired lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG nova.network.neutron [req-889adb94-1915-4e3a-9d34-4f707bb63624 req-9306b5d0-6880-445d-9ade-13fdd1c51e3e service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Refreshing network info cache for port 3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85ef0b6-3992-45ae-b10f-3ecdeae88e39]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:36:25 user nova-compute[72201]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)
Aug 01 15:36:25 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:36:25 user nova-compute[72201]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)
Aug 01 15:36:25 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc52c70f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1'): ({'sdc'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Removing single pathed devices sdc {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca56eb16-0fd8-449c-84b1-00d6c8101a39]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f53574e-15af-4f66-befa-9d6737228f3f]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Flushing IO for device /dev/sdc {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62416e1-49dd-4ed0-91e2-b1d184b97fd5]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-9144e897-3903-4b7a-8c61-ecff56e4a73d req-7c9be1de-f062-406a-929d-d7c5fc4c2e61 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received event network-vif-plugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9144e897-3903-4b7a-8c61-ecff56e4a73d req-7c9be1de-f062-406a-929d-d7c5fc4c2e61 service nova] Acquiring lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9144e897-3903-4b7a-8c61-ecff56e4a73d req-7c9be1de-f062-406a-929d-d7c5fc4c2e61 service nova] Lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9144e897-3903-4b7a-8c61-ecff56e4a73d req-7c9be1de-f062-406a-929d-d7c5fc4c2e61 service nova] Lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-9144e897-3903-4b7a-8c61-ecff56e4a73d req-7c9be1de-f062-406a-929d-d7c5fc4c2e61 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] No waiting events found dispatching network-vif-plugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:36:25 user nova-compute[72201]: WARNING nova.compute.manager [req-9144e897-3903-4b7a-8c61-ecff56e4a73d req-7c9be1de-f062-406a-929d-d7c5fc4c2e61 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received unexpected event network-vif-plugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 for instance with vm_state active and task_state shelving.
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f6b053-5e6e-4442-ae36-ad9919404a9d]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[588e7d79-c213-4a92-b1f7-6ee9806ca9e1]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[37960f0b-44aa-4193-8fe8-6edc12a4bab5]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1, portal: 172.16.0.220,3260]
Aug 01 15:36:25 user nova-compute[72201]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1, portal: 172.16.0.220,3260] successful.
Aug 01 15:36:25 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[310a3325-1b3b-4c7d-a5c2-d632e807ec06]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] <== disconnect_volume: return (315ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:36:25 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Deleting instance files /opt/stack/data/nova/instances/a7721f4d-4a5b-4196-9358-9126426566f0_del
Aug 01 15:36:25 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Deletion of /opt/stack/data/nova/instances/a7721f4d-4a5b-4196-9358-9126426566f0_del complete
Aug 01 15:36:25 user nova-compute[72201]: DEBUG nova.network.neutron [req-889adb94-1915-4e3a-9d34-4f707bb63624 req-9306b5d0-6880-445d-9ade-13fdd1c51e3e service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Updated VIF entry in instance network info cache for port 3ca61173-de45-4386-a12b-9ecdf45b29d9. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG nova.network.neutron [req-889adb94-1915-4e3a-9d34-4f707bb63624 req-9306b5d0-6880-445d-9ade-13fdd1c51e3e service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Updating instance_info_cache with network_info: [{"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": null, "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3ca61173-de", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:36:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-889adb94-1915-4e3a-9d34-4f707bb63624 req-9306b5d0-6880-445d-9ade-13fdd1c51e3e service nova] Releasing lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:36:26 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Deleted allocations for instance a7721f4d-4a5b-4196-9358-9126426566f0
Aug 01 15:36:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:26 user nova-compute[72201]: DEBUG nova.objects.instance [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lazy-loading 'numa_topology' on Instance uuid a7721f4d-4a5b-4196-9358-9126426566f0 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:36:26 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:36:26 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:36:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-88755cc9-803b-4726-a7d8-3c6636c9e3dc tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "a7721f4d-4a5b-4196-9358-9126426566f0" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.015s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:27 user nova-compute[72201]: INFO nova.compute.manager [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Terminating instance
Aug 01 15:36:27 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG nova.compute.manager [req-cc7cdfea-89bc-4406-a116-bd917adea37e req-5f6c0090-8c19-4d23-978b-2057e64213a5 service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Received event network-vif-unplugged-eb1fc053-fd35-4b5e-a557-4be5052de15d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cc7cdfea-89bc-4406-a116-bd917adea37e req-5f6c0090-8c19-4d23-978b-2057e64213a5 service nova] Acquiring lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cc7cdfea-89bc-4406-a116-bd917adea37e req-5f6c0090-8c19-4d23-978b-2057e64213a5 service nova] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cc7cdfea-89bc-4406-a116-bd917adea37e req-5f6c0090-8c19-4d23-978b-2057e64213a5 service nova] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG nova.compute.manager [req-cc7cdfea-89bc-4406-a116-bd917adea37e req-5f6c0090-8c19-4d23-978b-2057e64213a5 service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] No waiting events found dispatching network-vif-unplugged-eb1fc053-fd35-4b5e-a557-4be5052de15d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG nova.compute.manager [req-cc7cdfea-89bc-4406-a116-bd917adea37e req-5f6c0090-8c19-4d23-978b-2057e64213a5 service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Received event network-vif-unplugged-eb1fc053-fd35-4b5e-a557-4be5052de15d for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:36:27 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Instance destroyed successfully.
Aug 01 15:36:27 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'resources' on Instance uuid 0f059ccc-f609-4cf3-a644-c3d1305ae26e {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:20:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1512947866',display_name='tempest-ServerRescueNegativeTestJSON-server-1512947866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1512947866',id=4,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:22:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f130c48f19cf4ab7803c1169b759ccb6',ramdisk_id='',reservation_id='r-oa7fpdsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-773079660',owner_user_name='tempest-ServerRescueNegativeTestJSON-773079660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:22:11Z,user_data=None,user_id='31a432c1165e4ff4a9a10b4d71ddc513',uuid=0f059ccc-f609-4cf3-a644-c3d1305ae26e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "address": "fa:16:3e:2d:e0:8c", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1fc053-fd", "ovs_interfaceid": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converting VIF {"id": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "address": "fa:16:3e:2d:e0:8c", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1fc053-fd", "ovs_interfaceid": "eb1fc053-fd35-4b5e-a557-4be5052de15d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:e0:8c,bridge_name='br-int',has_traffic_filtering=True,id=eb1fc053-fd35-4b5e-a557-4be5052de15d,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb1fc053-fd') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG os_vif [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:e0:8c,bridge_name='br-int',has_traffic_filtering=True,id=eb1fc053-fd35-4b5e-a557-4be5052de15d,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb1fc053-fd') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb1fc053-fd, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:27 user nova-compute[72201]: INFO os_vif [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:e0:8c,bridge_name='br-int',has_traffic_filtering=True,id=eb1fc053-fd35-4b5e-a557-4be5052de15d,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb1fc053-fd')
Aug 01 15:36:27 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Deleting instance files /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e_del
Aug 01 15:36:27 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Deletion of /opt/stack/data/nova/instances/0f059ccc-f609-4cf3-a644-c3d1305ae26e_del complete
Aug 01 15:36:27 user nova-compute[72201]: INFO nova.compute.manager [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 15:36:27 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:36:27 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] There are 0 instances to clean {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmlDgoMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:36:28 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:36:28 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:36:28 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a42664-26db-41b3-a1ae-eb8319f9ff34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:36:28 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[63791c63-f74e-405c-9933-0873f2852c29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540] added
Aug 01 15:36:28 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02622ab-7ab9-4c48-bccf-57231aeb4494]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abc2576-ad92-4716-b535-f163a6d2282d]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TmlDgoMK {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TmlDgoMK" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a739651e-e773-476d-a0ad-a113171f5546]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TmlDgoMK'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1bf038-c4fc-4202-8d2a-bdcbe15fb018]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be32344-c54f-4662-9c88-05afa5f74283]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:36:28 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:36:28 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1357a9-e016-45f3-b1df-44bb6dc4cb41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540, portal: 172.16.0.220,3260]
Aug 01 15:36:28 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540, portal: 172.16.0.220,3260] successful.
Aug 01 15:36:28 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8ead83-50c7-4a99-804e-9e895fc02dc6]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:28 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Took 0.65 seconds to deallocate network for instance.
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b17c63d-f8d2-4b16-abb2-3b3250735940]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:36:28 user nova-compute[72201]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 (non-flash)
Aug 01 15:36:28 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:36:28 user nova-compute[72201]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 (non-flash)
Aug 01 15:36:28 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd6f3a8-0e69-4181-a025-bd371aee24dc]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmlDgoMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:36:28 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:36:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:29 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Deleted allocations for instance 0f059ccc-f609-4cf3-a644-c3d1305ae26e
Aug 01 15:36:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f41ecfd7-c74f-410c-9e2b-bd5e6981bde5 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.059s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:29 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:36:29 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23662343766376335', 'path': '/dev/sdc'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:36:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662343766376335', 'path': '/dev/sdc'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:36:29 user nova-compute[72201]: DEBUG nova.objects.instance [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lazy-loading 'flavor' on Instance uuid 02353c28-57e8-4209-914a-99b61fe14ba8 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:36:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:36:29 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:36:29 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 15:36:29 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:36:29 user nova-compute[72201]:   <serial>7b5020f1-150a-4155-a962-c66601250540</serial>
Aug 01 15:36:29 user nova-compute[72201]: </disk>
Aug 01 15:36:29 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:36:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-c5e85ced-bcea-4300-88d2-e4113d75be5e req-1c40b710-0223-4d52-ae71-b25aae85738d service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Received event network-vif-plugged-eb1fc053-fd35-4b5e-a557-4be5052de15d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:36:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c5e85ced-bcea-4300-88d2-e4113d75be5e req-1c40b710-0223-4d52-ae71-b25aae85738d service nova] Acquiring lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c5e85ced-bcea-4300-88d2-e4113d75be5e req-1c40b710-0223-4d52-ae71-b25aae85738d service nova] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c5e85ced-bcea-4300-88d2-e4113d75be5e req-1c40b710-0223-4d52-ae71-b25aae85738d service nova] Lock "0f059ccc-f609-4cf3-a644-c3d1305ae26e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-c5e85ced-bcea-4300-88d2-e4113d75be5e req-1c40b710-0223-4d52-ae71-b25aae85738d service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] No waiting events found dispatching network-vif-plugged-eb1fc053-fd35-4b5e-a557-4be5052de15d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:36:29 user nova-compute[72201]: WARNING nova.compute.manager [req-c5e85ced-bcea-4300-88d2-e4113d75be5e req-1c40b710-0223-4d52-ae71-b25aae85738d service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Received unexpected event network-vif-plugged-eb1fc053-fd35-4b5e-a557-4be5052de15d for instance with vm_state deleted and task_state None.
Aug 01 15:36:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-c5e85ced-bcea-4300-88d2-e4113d75be5e req-1c40b710-0223-4d52-ae71-b25aae85738d service nova] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Received event network-vif-deleted-eb1fc053-fd35-4b5e-a557-4be5052de15d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:36:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:36:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:36:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] No VIF found with MAC fa:16:3e:1b:a3:5c, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:36:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b639f459-7131-48c5-a83f-21a1a71f43c0 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "02353c28-57e8-4209-914a-99b61fe14ba8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.670s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "02353c28-57e8-4209-914a-99b61fe14ba8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.596s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "02353c28-57e8-4209-914a-99b61fe14ba8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "e2ca19ea-868c-40ad-a453-f6e348cfac15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:34 user nova-compute[72201]: INFO nova.compute.manager [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Terminating instance
Aug 01 15:36:34 user nova-compute[72201]: DEBUG nova.compute.manager [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:36:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:35 user nova-compute[72201]: DEBUG nova.compute.manager [req-c03b657a-7ac9-4f1f-99ae-73ce992c01ef req-8a5e40ee-d3cd-4df5-ae5f-08c806f639f5 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Received event network-vif-unplugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:36:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c03b657a-7ac9-4f1f-99ae-73ce992c01ef req-8a5e40ee-d3cd-4df5-ae5f-08c806f639f5 service nova] Acquiring lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c03b657a-7ac9-4f1f-99ae-73ce992c01ef req-8a5e40ee-d3cd-4df5-ae5f-08c806f639f5 service nova] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c03b657a-7ac9-4f1f-99ae-73ce992c01ef req-8a5e40ee-d3cd-4df5-ae5f-08c806f639f5 service nova] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:35 user nova-compute[72201]: DEBUG nova.compute.manager [req-c03b657a-7ac9-4f1f-99ae-73ce992c01ef req-8a5e40ee-d3cd-4df5-ae5f-08c806f639f5 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] No waiting events found dispatching network-vif-unplugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:36:35 user nova-compute[72201]: DEBUG nova.compute.manager [req-c03b657a-7ac9-4f1f-99ae-73ce992c01ef req-8a5e40ee-d3cd-4df5-ae5f-08c806f639f5 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Received event network-vif-unplugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:36:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:35 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Instance destroyed successfully.
Aug 01 15:36:35 user nova-compute[72201]: DEBUG nova.objects.instance [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lazy-loading 'resources' on Instance uuid e2ca19ea-868c-40ad-a453-f6e348cfac15 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:36:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T15:20:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-259126896',display_name='tempest-ServerActionsTestOtherA-server-1100798592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-259126896',id=3,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj9M7ZGdr6vvGAAN6LlX0Yd4KFWs7o7dSiIrZzG0de25MryOgdU0IQWkOsGcYGYZLChUKVpEI60JU+ZGbYHXhk4M5ia3Yx+QGjlFCbCEmncodiyKPCipVQmd8JPh2FoTg==',key_name='tempest-keypair-1499887671',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:24:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e85c7d5f159c4ff2896b5549cf73b977',ramdisk_id='',reservation_id='r-a8sv6s0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-765053637',owner_user_name='tempest-ServerActionsTestOtherA-765053637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:24:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ccd18b99219749fe8febdc0da8fc4388',uuid=e2ca19ea-868c-40ad-a453-f6e348cfac15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:36:35 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converting VIF {"id": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "address": "fa:16:3e:50:a8:af", "network": {"id": "27fc2520-0ab9-4d9e-a5d4-37f794f27013", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2132170896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e85c7d5f159c4ff2896b5549cf73b977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc611803-5a", "ovs_interfaceid": "bc611803-5aa5-4b8b-961b-cd6c43317b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:36:35 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:a8:af,bridge_name='br-int',has_traffic_filtering=True,id=bc611803-5aa5-4b8b-961b-cd6c43317b21,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc611803-5a') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:36:35 user nova-compute[72201]: DEBUG os_vif [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:a8:af,bridge_name='br-int',has_traffic_filtering=True,id=bc611803-5aa5-4b8b-961b-cd6c43317b21,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc611803-5a') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:36:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc611803-5a, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:36:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:35 user nova-compute[72201]: INFO os_vif [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:a8:af,bridge_name='br-int',has_traffic_filtering=True,id=bc611803-5aa5-4b8b-961b-cd6c43317b21,network=Network(27fc2520-0ab9-4d9e-a5d4-37f794f27013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc611803-5a')
Aug 01 15:36:35 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Deleting instance files /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15_del
Aug 01 15:36:35 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Deletion of /opt/stack/data/nova/instances/e2ca19ea-868c-40ad-a453-f6e348cfac15_del complete
Aug 01 15:36:35 user nova-compute[72201]: INFO nova.compute.manager [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 15:36:35 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:36:35 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:36:35 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:36:35 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:36:35 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Took 0.56 seconds to deallocate network for instance.
Aug 01 15:36:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "9530577b-69a6-45bc-a33b-1dc60d69a16f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:36 user nova-compute[72201]: INFO nova.compute.manager [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Terminating instance
Aug 01 15:36:36 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:36:36 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Deleted allocations for instance e2ca19ea-868c-40ad-a453-f6e348cfac15
Aug 01 15:36:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-533437d2-1368-4e96-b5d8-018cf0856cdd tempest-ServerActionsTestOtherA-765053637 tempest-ServerActionsTestOtherA-765053637-project-member] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.932s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG nova.compute.manager [req-2b5a627b-463e-4a85-80b1-26219004bf04 req-c7cfdee5-6344-4d99-9c39-c8d007db1220 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Received event network-vif-plugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2b5a627b-463e-4a85-80b1-26219004bf04 req-c7cfdee5-6344-4d99-9c39-c8d007db1220 service nova] Acquiring lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2b5a627b-463e-4a85-80b1-26219004bf04 req-c7cfdee5-6344-4d99-9c39-c8d007db1220 service nova] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2b5a627b-463e-4a85-80b1-26219004bf04 req-c7cfdee5-6344-4d99-9c39-c8d007db1220 service nova] Lock "e2ca19ea-868c-40ad-a453-f6e348cfac15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG nova.compute.manager [req-2b5a627b-463e-4a85-80b1-26219004bf04 req-c7cfdee5-6344-4d99-9c39-c8d007db1220 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] No waiting events found dispatching network-vif-plugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:36:36 user nova-compute[72201]: WARNING nova.compute.manager [req-2b5a627b-463e-4a85-80b1-26219004bf04 req-c7cfdee5-6344-4d99-9c39-c8d007db1220 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Received unexpected event network-vif-plugged-bc611803-5aa5-4b8b-961b-cd6c43317b21 for instance with vm_state deleted and task_state None.
Aug 01 15:36:36 user nova-compute[72201]: DEBUG nova.compute.manager [req-2b5a627b-463e-4a85-80b1-26219004bf04 req-c7cfdee5-6344-4d99-9c39-c8d007db1220 service nova] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Received event network-vif-deleted-bc611803-5aa5-4b8b-961b-cd6c43317b21 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG nova.compute.manager [req-2b5a627b-463e-4a85-80b1-26219004bf04 req-c7cfdee5-6344-4d99-9c39-c8d007db1220 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received event network-vif-unplugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2b5a627b-463e-4a85-80b1-26219004bf04 req-c7cfdee5-6344-4d99-9c39-c8d007db1220 service nova] Acquiring lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2b5a627b-463e-4a85-80b1-26219004bf04 req-c7cfdee5-6344-4d99-9c39-c8d007db1220 service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2b5a627b-463e-4a85-80b1-26219004bf04 req-c7cfdee5-6344-4d99-9c39-c8d007db1220 service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG nova.compute.manager [req-2b5a627b-463e-4a85-80b1-26219004bf04 req-c7cfdee5-6344-4d99-9c39-c8d007db1220 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] No waiting events found dispatching network-vif-unplugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG nova.compute.manager [req-2b5a627b-463e-4a85-80b1-26219004bf04 req-c7cfdee5-6344-4d99-9c39-c8d007db1220 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received event network-vif-unplugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:36 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Instance destroyed successfully.
Aug 01 15:36:36 user nova-compute[72201]: DEBUG nova.objects.instance [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lazy-loading 'resources' on Instance uuid 9530577b-69a6-45bc-a33b-1dc60d69a16f {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:27:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1658925189',display_name='tempest-ServerActionsTestOtherB-server-1658925189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1658925189',id=23,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJArwB9vrejGtK4OyRlF/OPoTmPfhsQE57Hge1qGzDjlRPweDSIgEPC9CjlFjLzOgL7v2M+GdTat2K+6ohuaRgnBN7sGvF/1T+/fwnocb98Oa2hVXX8HgqjMMybuv12ZQ==',key_name='tempest-keypair-162505840',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:34:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7d07e2a1943449baeb9ca49a3d1326f',ramdisk_id='',reservation_id='r-0d5v5zbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-2096061393',owner_user_name='tempest-ServerActionsTestOtherB-2096061393-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:34:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa902dd334b04d4cbf0ee4eb1eb582ff',uuid=9530577b-69a6-45bc-a33b-1dc60d69a16f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Converting VIF {"id": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "address": "fa:16:3e:78:0d:a8", "network": {"id": "bbd9214a-e302-4a4a-9395-f3e70e0cc888", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-988219649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d07e2a1943449baeb9ca49a3d1326f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cccc4c0-1e", "ovs_interfaceid": "2cccc4c0-1ece-49a9-9e19-065c8fe55d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:0d:a8,bridge_name='br-int',has_traffic_filtering=True,id=2cccc4c0-1ece-49a9-9e19-065c8fe55d9f,network=Network(bbd9214a-e302-4a4a-9395-f3e70e0cc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cccc4c0-1e') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG os_vif [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:0d:a8,bridge_name='br-int',has_traffic_filtering=True,id=2cccc4c0-1ece-49a9-9e19-065c8fe55d9f,network=Network(bbd9214a-e302-4a4a-9395-f3e70e0cc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cccc4c0-1e') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cccc4c0-1e, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:36:37 user nova-compute[72201]: INFO os_vif [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:0d:a8,bridge_name='br-int',has_traffic_filtering=True,id=2cccc4c0-1ece-49a9-9e19-065c8fe55d9f,network=Network(bbd9214a-e302-4a4a-9395-f3e70e0cc888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cccc4c0-1e')
Aug 01 15:36:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwmPABNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:36:37 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:36:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[429fe926-577c-4a20-9039-a82941603e14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[debfd432-b480-4147-99d2-f285cc6a2295]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:36:37 user nova-compute[72201]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 (non-flash)
Aug 01 15:36:37 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 (non-flash)
Aug 01 15:36:37 user nova-compute[72201]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 (non-flash)
Aug 01 15:36:37 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc549d536d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7'): ({'sdb'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Removing single pathed devices sdb {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fd1e97-617f-4766-9863-1c8843e2f0f1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acc2520-c2b4-4ab8-8eb6-9569a289dc81]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Flushing IO for device /dev/sdb {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4bc466-4edb-4622-9e37-e9756764decd]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3b4825-3bd8-4913-a039-36ffa1df8310]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fabf18-a831-4240-a35f-6bf28632003e]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b4efe5-d1a5-43e3-b648-34921d0a61d3]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260]
Aug 01 15:36:37 user nova-compute[72201]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7, portal: 172.16.0.220,3260] successful.
Aug 01 15:36:37 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaeddea5-fbb6-4b61-9a48-07c49f1b82b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0c23ad-efa1-4bf2-bb3b-ee1c504f2cea]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] <== disconnect_volume: return (257ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:36:37 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Deleting instance files /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f_del
Aug 01 15:36:37 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Deletion of /opt/stack/data/nova/instances/9530577b-69a6-45bc-a33b-1dc60d69a16f_del complete
Aug 01 15:36:37 user nova-compute[72201]: INFO nova.compute.manager [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 01 15:36:37 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:36:37 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:36:38 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:36:38 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Took 0.79 seconds to deallocate network for instance.
Aug 01 15:36:38 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690904183.6851113, a7721f4d-4a5b-4196-9358-9126426566f0 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:36:38 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] VM Stopped (Lifecycle Event)
Aug 01 15:36:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f52b509d-f27a-4292-9d3d-f551f2a74317 None None] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:36:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-f2e47f70-33aa-41d2-a841-b8fc979c7dfe req-2b50d9d2-d2b3-4caa-b793-8039aee88423 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received event network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:36:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f2e47f70-33aa-41d2-a841-b8fc979c7dfe req-2b50d9d2-d2b3-4caa-b793-8039aee88423 service nova] Acquiring lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f2e47f70-33aa-41d2-a841-b8fc979c7dfe req-2b50d9d2-d2b3-4caa-b793-8039aee88423 service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f2e47f70-33aa-41d2-a841-b8fc979c7dfe req-2b50d9d2-d2b3-4caa-b793-8039aee88423 service nova] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-f2e47f70-33aa-41d2-a841-b8fc979c7dfe req-2b50d9d2-d2b3-4caa-b793-8039aee88423 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] No waiting events found dispatching network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:36:38 user nova-compute[72201]: WARNING nova.compute.manager [req-f2e47f70-33aa-41d2-a841-b8fc979c7dfe req-2b50d9d2-d2b3-4caa-b793-8039aee88423 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received unexpected event network-vif-plugged-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f for instance with vm_state active and task_state deleting.
Aug 01 15:36:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-f2e47f70-33aa-41d2-a841-b8fc979c7dfe req-2b50d9d2-d2b3-4caa-b793-8039aee88423 service nova] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Received event network-vif-deleted-2cccc4c0-1ece-49a9-9e19-065c8fe55d9f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:36:38 user nova-compute[72201]: INFO nova.compute.manager [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Took 0.73 seconds to detach 1 volumes for instance.
Aug 01 15:36:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:39 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:36:39 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:36:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:39 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Deleted allocations for instance 9530577b-69a6-45bc-a33b-1dc60d69a16f
Aug 01 15:36:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0072762a-b359-4716-ad98-ae1e23db4506 tempest-ServerActionsTestOtherB-2096061393 tempest-ServerActionsTestOtherB-2096061393-project-member] Lock "9530577b-69a6-45bc-a33b-1dc60d69a16f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.105s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:42 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690904187.826332, 0f059ccc-f609-4cf3-a644-c3d1305ae26e => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:36:42 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] VM Stopped (Lifecycle Event)
Aug 01 15:36:42 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9ab5cbfc-6976-4627-bc23-744ba81dd27f None None] [instance: 0f059ccc-f609-4cf3-a644-c3d1305ae26e] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:36:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:36:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:36:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:36:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:36:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:50 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690904195.1502059, e2ca19ea-868c-40ad-a453-f6e348cfac15 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:36:50 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] VM Stopped (Lifecycle Event)
Aug 01 15:36:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-cdef2408-4736-47cf-8cc7-a36d224a7d78 None None] [instance: e2ca19ea-868c-40ad-a453-f6e348cfac15] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:36:51 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690904196.9712949, 9530577b-69a6-45bc-a33b-1dc60d69a16f => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:36:51 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] VM Stopped (Lifecycle Event)
Aug 01 15:36:52 user nova-compute[72201]: DEBUG nova.compute.manager [None req-cb39c6a8-298d-43b5-9255-58ea1a82a9fd None None] [instance: 9530577b-69a6-45bc-a33b-1dc60d69a16f] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:36:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "02353c28-57e8-4209-914a-99b61fe14ba8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "02353c28-57e8-4209-914a-99b61fe14ba8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:52 user nova-compute[72201]: INFO nova.compute.manager [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Detaching volume 7b5020f1-150a-4155-a962-c66601250540
Aug 01 15:36:52 user nova-compute[72201]: INFO nova.virt.block_device [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Attempting to driver detach volume 7b5020f1-150a-4155-a962-c66601250540 from mountpoint /dev/vdb
Aug 01 15:36:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Attempting to detach device vdb from instance 02353c28-57e8-4209-914a-99b61fe14ba8 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:36:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:36:52 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:36:52 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 15:36:52 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:36:52 user nova-compute[72201]:   <serial>7b5020f1-150a-4155-a962-c66601250540</serial>
Aug 01 15:36:52 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:36:52 user nova-compute[72201]: </disk>
Aug 01 15:36:52 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:36:52 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Successfully detached device vdb from instance 02353c28-57e8-4209-914a-99b61fe14ba8 from the persistent domain config.
Aug 01 15:36:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 02353c28-57e8-4209-914a-99b61fe14ba8 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:36:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:36:52 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:36:52 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 15:36:52 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:36:52 user nova-compute[72201]:   <serial>7b5020f1-150a-4155-a962-c66601250540</serial>
Aug 01 15:36:52 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:36:52 user nova-compute[72201]: </disk>
Aug 01 15:36:52 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:36:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "02353c28-57e8-4209-914a-99b61fe14ba8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690904213.2642882, 02353c28-57e8-4209-914a-99b61fe14ba8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 02353c28-57e8-4209-914a-99b61fe14ba8 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:36:53 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Successfully detached device vdb from instance 02353c28-57e8-4209-914a-99b61fe14ba8 from the live domain config.
Aug 01 15:36:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmlDgoMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:36:53 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:36:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07df832-d1a3-41af-abee-675b08703238]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a621b4-1c86-4238-9c4a-a38185a66785]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 (non-flash)
Aug 01 15:36:53 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 (non-flash)
Aug 01 15:36:53 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc544304820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540'): ({'sdc'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Removing single pathed devices sdc {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ed6d62-99d9-4f59-ac1e-68b40fb12ace]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dc9913-ebd0-455f-b4cc-955f504859f9]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Flushing IO for device /dev/sdc {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c3c643-6c7c-4d74-b889-eba840c54696]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a9b553-3fc0-49b5-b562-66a7c7b62a36]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89dc445-3db2-4911-87f2-fe9497a45e78]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[287010d0-90cf-4a33-bfc1-08c219c8b495]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540, portal: 172.16.0.220,3260]
Aug 01 15:36:53 user nova-compute[72201]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540, portal: 172.16.0.220,3260] successful.
Aug 01 15:36:53 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb6e90d-1368-4ec8-89ae-ccb86d1776ad]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] <== disconnect_volume: return (259ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:36:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:54 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lazy-loading 'flavor' on Instance uuid 02353c28-57e8-4209-914a-99b61fe14ba8 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:36:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a67a1582-cf6c-48dd-a9fb-4bb69a713e99 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "02353c28-57e8-4209-914a-99b61fe14ba8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.531s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "02353c28-57e8-4209-914a-99b61fe14ba8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.413s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "02353c28-57e8-4209-914a-99b61fe14ba8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "02353c28-57e8-4209-914a-99b61fe14ba8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "02353c28-57e8-4209-914a-99b61fe14ba8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:54 user nova-compute[72201]: INFO nova.compute.manager [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Terminating instance
Aug 01 15:36:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:36:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:54 user nova-compute[72201]: DEBUG nova.compute.manager [req-91bdfe90-e36b-44a5-af9b-842c90fc4c08 req-f55cd9f6-8cae-4aff-804e-65349c92a355 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Received event network-vif-unplugged-c4efc73b-8686-49b1-81bc-722a3dc7c322 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:36:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-91bdfe90-e36b-44a5-af9b-842c90fc4c08 req-f55cd9f6-8cae-4aff-804e-65349c92a355 service nova] Acquiring lock "02353c28-57e8-4209-914a-99b61fe14ba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-91bdfe90-e36b-44a5-af9b-842c90fc4c08 req-f55cd9f6-8cae-4aff-804e-65349c92a355 service nova] Lock "02353c28-57e8-4209-914a-99b61fe14ba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-91bdfe90-e36b-44a5-af9b-842c90fc4c08 req-f55cd9f6-8cae-4aff-804e-65349c92a355 service nova] Lock "02353c28-57e8-4209-914a-99b61fe14ba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:54 user nova-compute[72201]: DEBUG nova.compute.manager [req-91bdfe90-e36b-44a5-af9b-842c90fc4c08 req-f55cd9f6-8cae-4aff-804e-65349c92a355 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] No waiting events found dispatching network-vif-unplugged-c4efc73b-8686-49b1-81bc-722a3dc7c322 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:36:54 user nova-compute[72201]: DEBUG nova.compute.manager [req-91bdfe90-e36b-44a5-af9b-842c90fc4c08 req-f55cd9f6-8cae-4aff-804e-65349c92a355 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Received event network-vif-unplugged-c4efc73b-8686-49b1-81bc-722a3dc7c322 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:36:55 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Instance destroyed successfully.
Aug 01 15:36:55 user nova-compute[72201]: DEBUG nova.objects.instance [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lazy-loading 'resources' on Instance uuid 02353c28-57e8-4209-914a-99b61fe14ba8 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-349772799',display_name='tempest-VolumesSnapshotTestJSON-instance-349772799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-349772799',id=33,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+Y3oQG7k6g0/7wZk4bHmhvBHuLQuNzdZYNcXQa4aO6PS0Rux9Lhah+EVQKJWaXWUMP1pPBQGHWAZh4mhjaMtv5BJPmkE9ct0nyxiYteTgaRCNhREK2h2KPGSzURm2XHw==',key_name='tempest-keypair-2077566837',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:34:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c85969cbfd374ba484cccd0f89fcf3be',ramdisk_id='',reservation_id='r-bplxu2s6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-840662389',owner_user_name='tempest-VolumesSnapshotTestJSON-840662389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:34:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='488991a215a64482a71cb25f3ecd9f0f',uuid=02353c28-57e8-4209-914a-99b61fe14ba8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "address": "fa:16:3e:1b:a3:5c", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4efc73b-86", "ovs_interfaceid": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Converting VIF {"id": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "address": "fa:16:3e:1b:a3:5c", "network": {"id": "5b881fdd-ff08-42a6-aa9c-3ec904123af2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1171568270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85969cbfd374ba484cccd0f89fcf3be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4efc73b-86", "ovs_interfaceid": "c4efc73b-8686-49b1-81bc-722a3dc7c322", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:a3:5c,bridge_name='br-int',has_traffic_filtering=True,id=c4efc73b-8686-49b1-81bc-722a3dc7c322,network=Network(5b881fdd-ff08-42a6-aa9c-3ec904123af2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4efc73b-86') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG os_vif [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:a3:5c,bridge_name='br-int',has_traffic_filtering=True,id=c4efc73b-8686-49b1-81bc-722a3dc7c322,network=Network(5b881fdd-ff08-42a6-aa9c-3ec904123af2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4efc73b-86') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4efc73b-86, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:36:55 user nova-compute[72201]: INFO os_vif [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:a3:5c,bridge_name='br-int',has_traffic_filtering=True,id=c4efc73b-8686-49b1-81bc-722a3dc7c322,network=Network(5b881fdd-ff08-42a6-aa9c-3ec904123af2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4efc73b-86')
Aug 01 15:36:55 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmlDgoMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:36:55 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:36:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b5020f1-150a-4155-a962-c66601250540', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1397ca-bec9-4065-9b6b-41f92769e112]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:55 user nova-compute[72201]: WARNING os_brick.initiator.connectors.iscsi [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 01 15:36:55 user nova-compute[72201]: 
Aug 01 15:36:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[185329f6-281f-4085-b852-862a934ffa7d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 15:36:55 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 15:36:55 user nova-compute[72201]:  {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:36:55 user nova-compute[72201]: WARNING os_brick.initiator.connectors.iscsi [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 15:36:55 user nova-compute[72201]: 
Aug 01 15:36:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c13bbe0>, {}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Disconnecting from: [] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.042s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] <== disconnect_volume: return (43ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:36:55 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Deleting instance files /opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8_del
Aug 01 15:36:55 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Deletion of /opt/stack/data/nova/instances/02353c28-57e8-4209-914a-99b61fe14ba8_del complete
Aug 01 15:36:55 user nova-compute[72201]: INFO nova.compute.manager [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 15:36:55 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:36:55 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:36:55 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Took 0.80 seconds to deallocate network for instance.
Aug 01 15:36:56 user nova-compute[72201]: WARNING nova.volume.cinder [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Attachment 2ab184ee-ec95-4b4d-bae0-050911094816 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 2ab184ee-ec95-4b4d-bae0-050911094816. (HTTP 404) (Request-ID: req-524531e0-23e9-4d2c-b07c-a287a1ff481c)
Aug 01 15:36:56 user nova-compute[72201]: INFO nova.compute.manager [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Took 0.02 seconds to detach 1 volumes for instance.
Aug 01 15:36:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:56 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:36:56 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:36:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:56 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Deleted allocations for instance 02353c28-57e8-4209-914a-99b61fe14ba8
Aug 01 15:36:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b45b1602-bb7c-45b6-b283-819cd2cf5db7 tempest-VolumesSnapshotTestJSON-840662389 tempest-VolumesSnapshotTestJSON-840662389-project-member] Lock "02353c28-57e8-4209-914a-99b61fe14ba8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.085s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-1e8583a3-3e7c-4c58-8ef7-b488c224ab17 req-c18bdeac-24c7-47a3-aa72-39244750d320 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Received event network-vif-plugged-c4efc73b-8686-49b1-81bc-722a3dc7c322 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:36:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1e8583a3-3e7c-4c58-8ef7-b488c224ab17 req-c18bdeac-24c7-47a3-aa72-39244750d320 service nova] Acquiring lock "02353c28-57e8-4209-914a-99b61fe14ba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:36:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1e8583a3-3e7c-4c58-8ef7-b488c224ab17 req-c18bdeac-24c7-47a3-aa72-39244750d320 service nova] Lock "02353c28-57e8-4209-914a-99b61fe14ba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:36:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1e8583a3-3e7c-4c58-8ef7-b488c224ab17 req-c18bdeac-24c7-47a3-aa72-39244750d320 service nova] Lock "02353c28-57e8-4209-914a-99b61fe14ba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:36:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-1e8583a3-3e7c-4c58-8ef7-b488c224ab17 req-c18bdeac-24c7-47a3-aa72-39244750d320 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] No waiting events found dispatching network-vif-plugged-c4efc73b-8686-49b1-81bc-722a3dc7c322 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:36:56 user nova-compute[72201]: WARNING nova.compute.manager [req-1e8583a3-3e7c-4c58-8ef7-b488c224ab17 req-c18bdeac-24c7-47a3-aa72-39244750d320 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Received unexpected event network-vif-plugged-c4efc73b-8686-49b1-81bc-722a3dc7c322 for instance with vm_state deleted and task_state None.
Aug 01 15:36:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-1e8583a3-3e7c-4c58-8ef7-b488c224ab17 req-c18bdeac-24c7-47a3-aa72-39244750d320 service nova] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Received event network-vif-deleted-c4efc73b-8686-49b1-81bc-722a3dc7c322 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:37:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:02 user nova-compute[72201]: INFO nova.compute.manager [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Terminating instance
Aug 01 15:37:02 user nova-compute[72201]: DEBUG nova.compute.manager [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:37:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-461e1950-8050-4e04-85f9-0d3ef633f3cc req-bd3a1370-464c-4db3-b207-244237a3bcad service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Received event network-vif-unplugged-ebb58ee4-b7ff-470c-9599-fb635cfbd89f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:37:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-461e1950-8050-4e04-85f9-0d3ef633f3cc req-bd3a1370-464c-4db3-b207-244237a3bcad service nova] Acquiring lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-461e1950-8050-4e04-85f9-0d3ef633f3cc req-bd3a1370-464c-4db3-b207-244237a3bcad service nova] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-461e1950-8050-4e04-85f9-0d3ef633f3cc req-bd3a1370-464c-4db3-b207-244237a3bcad service nova] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-461e1950-8050-4e04-85f9-0d3ef633f3cc req-bd3a1370-464c-4db3-b207-244237a3bcad service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] No waiting events found dispatching network-vif-unplugged-ebb58ee4-b7ff-470c-9599-fb635cfbd89f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:37:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-461e1950-8050-4e04-85f9-0d3ef633f3cc req-bd3a1370-464c-4db3-b207-244237a3bcad service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Received event network-vif-unplugged-ebb58ee4-b7ff-470c-9599-fb635cfbd89f for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:37:03 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Instance destroyed successfully.
Aug 01 15:37:03 user nova-compute[72201]: DEBUG nova.objects.instance [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lazy-loading 'resources' on Instance uuid 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:37:03 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:34:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1678565475',display_name='tempest-AttachVolumeNegativeTest-server-1678565475',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1678565475',id=32,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMya1+vVBJZkwsOq2tyEFJp4qoAZCbYcjsIXTrg3PM89wXIsQI7rPphJybHGRh/eIG2R/8iFi1cFqUqQJJGHY6MOpX0dTgDgLTXydXeK/gpJN/B3nAuGvzs4ZFsNAvUfUA==',key_name='tempest-keypair-1610557227',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:34:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='548641aee9954aa48c567e798b4be247',ramdisk_id='',reservation_id='r-nyi8hb0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2028543234',owner_user_name='tempest-AttachVolumeNegativeTest-2028543234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:34:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd505dbb02e4d3d8e8f97839b25ed22',uuid=20d257a3-8f64-4e6c-b7be-b8dd8ed9610d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "address": "fa:16:3e:5a:be:b2", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb58ee4-b7", "ovs_interfaceid": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:37:03 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converting VIF {"id": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "address": "fa:16:3e:5a:be:b2", "network": {"id": "70fa3c89-7569-47c3-a671-87496b64d8b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539192739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548641aee9954aa48c567e798b4be247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb58ee4-b7", "ovs_interfaceid": "ebb58ee4-b7ff-470c-9599-fb635cfbd89f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:37:03 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:be:b2,bridge_name='br-int',has_traffic_filtering=True,id=ebb58ee4-b7ff-470c-9599-fb635cfbd89f,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb58ee4-b7') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:37:03 user nova-compute[72201]: DEBUG os_vif [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:be:b2,bridge_name='br-int',has_traffic_filtering=True,id=ebb58ee4-b7ff-470c-9599-fb635cfbd89f,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb58ee4-b7') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:37:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebb58ee4-b7, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:37:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:37:03 user nova-compute[72201]: INFO os_vif [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:be:b2,bridge_name='br-int',has_traffic_filtering=True,id=ebb58ee4-b7ff-470c-9599-fb635cfbd89f,network=Network(70fa3c89-7569-47c3-a671-87496b64d8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb58ee4-b7')
Aug 01 15:37:03 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Deleting instance files /opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d_del
Aug 01 15:37:03 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Deletion of /opt/stack/data/nova/instances/20d257a3-8f64-4e6c-b7be-b8dd8ed9610d_del complete
Aug 01 15:37:03 user nova-compute[72201]: INFO nova.compute.manager [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 01 15:37:03 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:37:03 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:37:03 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:37:03 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:37:03 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Took 0.84 seconds to deallocate network for instance.
Aug 01 15:37:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:04 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:37:04 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:37:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:04 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Deleted allocations for instance 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d
Aug 01 15:37:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-46a150f3-a57a-4d2c-9b85-cb261abf7d96 tempest-AttachVolumeNegativeTest-2028543234 tempest-AttachVolumeNegativeTest-2028543234-project-member] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.041s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-4b33e179-f561-463c-86dc-7dcc0911730d req-5e681c77-98cb-4d08-bbfe-111511e78853 service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Received event network-vif-plugged-ebb58ee4-b7ff-470c-9599-fb635cfbd89f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:37:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4b33e179-f561-463c-86dc-7dcc0911730d req-5e681c77-98cb-4d08-bbfe-111511e78853 service nova] Acquiring lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4b33e179-f561-463c-86dc-7dcc0911730d req-5e681c77-98cb-4d08-bbfe-111511e78853 service nova] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4b33e179-f561-463c-86dc-7dcc0911730d req-5e681c77-98cb-4d08-bbfe-111511e78853 service nova] Lock "20d257a3-8f64-4e6c-b7be-b8dd8ed9610d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-4b33e179-f561-463c-86dc-7dcc0911730d req-5e681c77-98cb-4d08-bbfe-111511e78853 service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] No waiting events found dispatching network-vif-plugged-ebb58ee4-b7ff-470c-9599-fb635cfbd89f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:37:04 user nova-compute[72201]: WARNING nova.compute.manager [req-4b33e179-f561-463c-86dc-7dcc0911730d req-5e681c77-98cb-4d08-bbfe-111511e78853 service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Received unexpected event network-vif-plugged-ebb58ee4-b7ff-470c-9599-fb635cfbd89f for instance with vm_state deleted and task_state None.
Aug 01 15:37:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-4b33e179-f561-463c-86dc-7dcc0911730d req-5e681c77-98cb-4d08-bbfe-111511e78853 service nova] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Received event network-vif-deleted-ebb58ee4-b7ff-470c-9599-fb635cfbd89f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:37:07 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:37:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Acquiring lock "5040757b-7100-4cb0-b252-7b52f35ec4ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "5040757b-7100-4cb0-b252-7b52f35ec4ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Acquiring lock "5040757b-7100-4cb0-b252-7b52f35ec4ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "5040757b-7100-4cb0-b252-7b52f35ec4ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "5040757b-7100-4cb0-b252-7b52f35ec4ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:07 user nova-compute[72201]: INFO nova.compute.manager [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Terminating instance
Aug 01 15:37:07 user nova-compute[72201]: DEBUG nova.compute.manager [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:37:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:08 user nova-compute[72201]: DEBUG nova.compute.manager [req-69655dd6-4a70-4583-ba94-6c8b184b8c90 req-bfed0c2b-f549-4df8-b108-f5cc581efc78 service nova] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Received event network-vif-unplugged-56a3c540-5604-47bb-b376-ff0abf5f8f5f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:37:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-69655dd6-4a70-4583-ba94-6c8b184b8c90 req-bfed0c2b-f549-4df8-b108-f5cc581efc78 service nova] Acquiring lock "5040757b-7100-4cb0-b252-7b52f35ec4ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-69655dd6-4a70-4583-ba94-6c8b184b8c90 req-bfed0c2b-f549-4df8-b108-f5cc581efc78 service nova] Lock "5040757b-7100-4cb0-b252-7b52f35ec4ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-69655dd6-4a70-4583-ba94-6c8b184b8c90 req-bfed0c2b-f549-4df8-b108-f5cc581efc78 service nova] Lock "5040757b-7100-4cb0-b252-7b52f35ec4ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:08 user nova-compute[72201]: DEBUG nova.compute.manager [req-69655dd6-4a70-4583-ba94-6c8b184b8c90 req-bfed0c2b-f549-4df8-b108-f5cc581efc78 service nova] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] No waiting events found dispatching network-vif-unplugged-56a3c540-5604-47bb-b376-ff0abf5f8f5f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:37:08 user nova-compute[72201]: DEBUG nova.compute.manager [req-69655dd6-4a70-4583-ba94-6c8b184b8c90 req-bfed0c2b-f549-4df8-b108-f5cc581efc78 service nova] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Received event network-vif-unplugged-56a3c540-5604-47bb-b376-ff0abf5f8f5f for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:37:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:08 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Instance destroyed successfully.
Aug 01 15:37:08 user nova-compute[72201]: DEBUG nova.objects.instance [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lazy-loading 'resources' on Instance uuid 5040757b-7100-4cb0-b252-7b52f35ec4ba {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:37:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:35:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1671225041',display_name='tempest-ServersNegativeTestJSON-server-1671225041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1671225041',id=35,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:35:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce0e2836d3794cd8b26b8f54a73af7e7',ramdisk_id='',reservation_id='r-kkzblg7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-592631034',owner_user_name='tempest-ServersNegativeTestJSON-592631034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:35:24Z,user_data=None,user_id='382a20da0cdd454181d19da58d22551a',uuid=5040757b-7100-4cb0-b252-7b52f35ec4ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56a3c540-5604-47bb-b376-ff0abf5f8f5f", "address": "fa:16:3e:69:5b:84", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a3c540-56", "ovs_interfaceid": "56a3c540-5604-47bb-b376-ff0abf5f8f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:37:08 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Converting VIF {"id": "56a3c540-5604-47bb-b376-ff0abf5f8f5f", "address": "fa:16:3e:69:5b:84", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a3c540-56", "ovs_interfaceid": "56a3c540-5604-47bb-b376-ff0abf5f8f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:37:08 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:5b:84,bridge_name='br-int',has_traffic_filtering=True,id=56a3c540-5604-47bb-b376-ff0abf5f8f5f,network=Network(76e721f1-1135-4932-9d27-41c013b3c149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56a3c540-56') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:37:08 user nova-compute[72201]: DEBUG os_vif [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:5b:84,bridge_name='br-int',has_traffic_filtering=True,id=56a3c540-5604-47bb-b376-ff0abf5f8f5f,network=Network(76e721f1-1135-4932-9d27-41c013b3c149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56a3c540-56') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:37:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56a3c540-56, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:37:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:37:08 user nova-compute[72201]: INFO os_vif [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:5b:84,bridge_name='br-int',has_traffic_filtering=True,id=56a3c540-5604-47bb-b376-ff0abf5f8f5f,network=Network(76e721f1-1135-4932-9d27-41c013b3c149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56a3c540-56')
Aug 01 15:37:08 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Deleting instance files /opt/stack/data/nova/instances/5040757b-7100-4cb0-b252-7b52f35ec4ba_del
Aug 01 15:37:08 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Deletion of /opt/stack/data/nova/instances/5040757b-7100-4cb0-b252-7b52f35ec4ba_del complete
Aug 01 15:37:08 user nova-compute[72201]: INFO nova.compute.manager [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Took 0.64 seconds to destroy the instance on the hypervisor.
Aug 01 15:37:08 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:37:08 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:37:08 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:37:09 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:37:09 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:37:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-3d378c82-306d-4187-b0e9-36ef9f65ca0a req-d28861fd-377d-448e-8bb5-f027fc1406e8 service nova] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Received event network-vif-deleted-56a3c540-5604-47bb-b376-ff0abf5f8f5f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:37:09 user nova-compute[72201]: INFO nova.compute.manager [req-3d378c82-306d-4187-b0e9-36ef9f65ca0a req-d28861fd-377d-448e-8bb5-f027fc1406e8 service nova] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Neutron deleted interface 56a3c540-5604-47bb-b376-ff0abf5f8f5f; detaching it from the instance and deleting it from the info cache
Aug 01 15:37:09 user nova-compute[72201]: DEBUG nova.network.neutron [req-3d378c82-306d-4187-b0e9-36ef9f65ca0a req-d28861fd-377d-448e-8bb5-f027fc1406e8 service nova] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:37:09 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Took 0.82 seconds to deallocate network for instance.
Aug 01 15:37:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-3d378c82-306d-4187-b0e9-36ef9f65ca0a req-d28861fd-377d-448e-8bb5-f027fc1406e8 service nova] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Detach interface failed, port_id=56a3c540-5604-47bb-b376-ff0abf5f8f5f, reason: Instance 5040757b-7100-4cb0-b252-7b52f35ec4ba could not be found. {{(pid=72201) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 15:37:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:09 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:37:09 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:37:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:09 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Deleted allocations for instance 5040757b-7100-4cb0-b252-7b52f35ec4ba
Aug 01 15:37:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-193d106f-e9b7-43f7-a1d6-93009fda9c08 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "5040757b-7100-4cb0-b252-7b52f35ec4ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.776s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:10 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690904215.0390518, 02353c28-57e8-4209-914a-99b61fe14ba8 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:37:10 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] VM Stopped (Lifecycle Event)
Aug 01 15:37:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3a36bd52-1740-4cba-ae19-4592298be132 None None] [instance: 02353c28-57e8-4209-914a-99b61fe14ba8] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:37:10 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:37:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:37:10 user nova-compute[72201]: DEBUG nova.compute.manager [req-8c1b0cc7-6418-41dd-91e1-63f0cc26e415 req-39a06fc8-6f6a-4c4a-82e3-a194b29cf483 service nova] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Received event network-vif-plugged-56a3c540-5604-47bb-b376-ff0abf5f8f5f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:37:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8c1b0cc7-6418-41dd-91e1-63f0cc26e415 req-39a06fc8-6f6a-4c4a-82e3-a194b29cf483 service nova] Acquiring lock "5040757b-7100-4cb0-b252-7b52f35ec4ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8c1b0cc7-6418-41dd-91e1-63f0cc26e415 req-39a06fc8-6f6a-4c4a-82e3-a194b29cf483 service nova] Lock "5040757b-7100-4cb0-b252-7b52f35ec4ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8c1b0cc7-6418-41dd-91e1-63f0cc26e415 req-39a06fc8-6f6a-4c4a-82e3-a194b29cf483 service nova] Lock "5040757b-7100-4cb0-b252-7b52f35ec4ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:10 user nova-compute[72201]: DEBUG nova.compute.manager [req-8c1b0cc7-6418-41dd-91e1-63f0cc26e415 req-39a06fc8-6f6a-4c4a-82e3-a194b29cf483 service nova] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] No waiting events found dispatching network-vif-plugged-56a3c540-5604-47bb-b376-ff0abf5f8f5f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:37:10 user nova-compute[72201]: WARNING nova.compute.manager [req-8c1b0cc7-6418-41dd-91e1-63f0cc26e415 req-39a06fc8-6f6a-4c4a-82e3-a194b29cf483 service nova] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Received unexpected event network-vif-plugged-56a3c540-5604-47bb-b376-ff0abf5f8f5f for instance with vm_state deleted and task_state None.
Aug 01 15:37:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Didn't find any instances for network info cache update. {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 15:37:12 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:37:13 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:37:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:15 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:37:15 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:37:15 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:37:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:15 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:37:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:37:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:37:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:37:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:37:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:37:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:37:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:37:15 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:37:16 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:37:16 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:37:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8396MB free_disk=25.489200592041016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:37:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance b64f1cfb-64f2-4493-8721-fc63fcd93bb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:37:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 929ed2b3-a72e-424e-94c4-352c207442ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:37:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:37:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:37:16 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:37:16 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:37:16 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:37:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:17 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:37:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:37:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:17 user nova-compute[72201]: INFO nova.compute.manager [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Terminating instance
Aug 01 15:37:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:37:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:17 user nova-compute[72201]: DEBUG nova.compute.manager [req-d3106661-9f6f-4384-ae7c-4c98fcf05f89 req-35fa80e4-741f-467d-929a-163a1d3ed68d service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received event network-vif-unplugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:37:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d3106661-9f6f-4384-ae7c-4c98fcf05f89 req-35fa80e4-741f-467d-929a-163a1d3ed68d service nova] Acquiring lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d3106661-9f6f-4384-ae7c-4c98fcf05f89 req-35fa80e4-741f-467d-929a-163a1d3ed68d service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d3106661-9f6f-4384-ae7c-4c98fcf05f89 req-35fa80e4-741f-467d-929a-163a1d3ed68d service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:17 user nova-compute[72201]: DEBUG nova.compute.manager [req-d3106661-9f6f-4384-ae7c-4c98fcf05f89 req-35fa80e4-741f-467d-929a-163a1d3ed68d service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] No waiting events found dispatching network-vif-unplugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:37:17 user nova-compute[72201]: DEBUG nova.compute.manager [req-d3106661-9f6f-4384-ae7c-4c98fcf05f89 req-35fa80e4-741f-467d-929a-163a1d3ed68d service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received event network-vif-unplugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:37:18 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690904223.03811, 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:37:18 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] VM Stopped (Lifecycle Event)
Aug 01 15:37:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-683eccff-15e8-4317-b488-febd16d6c3f4 None None] [instance: 20d257a3-8f64-4e6c-b7be-b8dd8ed9610d] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:37:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:18 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Instance destroyed successfully.
Aug 01 15:37:18 user nova-compute[72201]: DEBUG nova.objects.instance [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lazy-loading 'resources' on Instance uuid b64f1cfb-64f2-4493-8721-fc63fcd93bb6 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:37:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1810047219',display_name='tempest-ServerRescueNegativeTestJSON-server-1810047219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1810047219',id=2,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:25:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f130c48f19cf4ab7803c1169b759ccb6',ramdisk_id='',reservation_id='r-9or02wpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-773079660',owner_user_name='tempest-ServerRescueNegativeTestJSON-773079660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:26:56Z,user_data=None,user_id='31a432c1165e4ff4a9a10b4d71ddc513',uuid=b64f1cfb-64f2-4493-8721-fc63fcd93bb6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "address": "fa:16:3e:5d:24:e6", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8b84b-6b", "ovs_interfaceid": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:37:18 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converting VIF {"id": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "address": "fa:16:3e:5d:24:e6", "network": {"id": "3cc94027-7ae9-4ae4-a54a-73c2bd504819", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1293266512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f130c48f19cf4ab7803c1169b759ccb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc8b84b-6b", "ovs_interfaceid": "ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:37:18 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:24:e6,bridge_name='br-int',has_traffic_filtering=True,id=ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc8b84b-6b') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:37:18 user nova-compute[72201]: DEBUG os_vif [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:24:e6,bridge_name='br-int',has_traffic_filtering=True,id=ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc8b84b-6b') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:37:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebc8b84b-6b, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:37:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:37:18 user nova-compute[72201]: INFO os_vif [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:24:e6,bridge_name='br-int',has_traffic_filtering=True,id=ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583,network=Network(3cc94027-7ae9-4ae4-a54a-73c2bd504819),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc8b84b-6b')
Aug 01 15:37:18 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Deleting instance files /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6_del
Aug 01 15:37:18 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Deletion of /opt/stack/data/nova/instances/b64f1cfb-64f2-4493-8721-fc63fcd93bb6_del complete
Aug 01 15:37:18 user nova-compute[72201]: INFO nova.compute.manager [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 01 15:37:18 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:37:18 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:37:18 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:37:18 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:37:18 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Took 0.58 seconds to deallocate network for instance.
Aug 01 15:37:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:19 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:37:19 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:37:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:19 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Deleted allocations for instance b64f1cfb-64f2-4493-8721-fc63fcd93bb6
Aug 01 15:37:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b55b1446-4042-4c73-9ce7-0153e115a415 tempest-ServerRescueNegativeTestJSON-773079660 tempest-ServerRescueNegativeTestJSON-773079660-project-member] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.773s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:19 user nova-compute[72201]: DEBUG nova.compute.manager [req-5db62dfb-70cb-46b2-acb1-8e646371177b req-8c23166a-d90f-4046-a205-11bdaf5714e6 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received event network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:37:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5db62dfb-70cb-46b2-acb1-8e646371177b req-8c23166a-d90f-4046-a205-11bdaf5714e6 service nova] Acquiring lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5db62dfb-70cb-46b2-acb1-8e646371177b req-8c23166a-d90f-4046-a205-11bdaf5714e6 service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5db62dfb-70cb-46b2-acb1-8e646371177b req-8c23166a-d90f-4046-a205-11bdaf5714e6 service nova] Lock "b64f1cfb-64f2-4493-8721-fc63fcd93bb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:19 user nova-compute[72201]: DEBUG nova.compute.manager [req-5db62dfb-70cb-46b2-acb1-8e646371177b req-8c23166a-d90f-4046-a205-11bdaf5714e6 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] No waiting events found dispatching network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:37:19 user nova-compute[72201]: WARNING nova.compute.manager [req-5db62dfb-70cb-46b2-acb1-8e646371177b req-8c23166a-d90f-4046-a205-11bdaf5714e6 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received unexpected event network-vif-plugged-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 for instance with vm_state deleted and task_state None.
Aug 01 15:37:19 user nova-compute[72201]: DEBUG nova.compute.manager [req-5db62dfb-70cb-46b2-acb1-8e646371177b req-8c23166a-d90f-4046-a205-11bdaf5714e6 service nova] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Received event network-vif-deleted-ebc8b84b-6ba7-46a8-ae79-ced5c9c9c583 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:37:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:23 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690904228.3856294, 5040757b-7100-4cb0-b252-7b52f35ec4ba => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:37:23 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] VM Stopped (Lifecycle Event)
Aug 01 15:37:23 user nova-compute[72201]: DEBUG nova.compute.manager [None req-b954df86-a99b-427f-946f-2ebc6ff1810b None None] [instance: 5040757b-7100-4cb0-b252-7b52f35ec4ba] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:37:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:37:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:37:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:37:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:37:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:33 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690904238.2672458, b64f1cfb-64f2-4493-8721-fc63fcd93bb6 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:37:33 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] VM Stopped (Lifecycle Event)
Aug 01 15:37:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:33 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9df0ece1-105e-497e-95d2-695ea8d66414 None None] [instance: b64f1cfb-64f2-4493-8721-fc63fcd93bb6] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:37:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "f0743332-223f-4507-b8b1-40d63b7b5e80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:37:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:38 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:37:38 user nova-compute[72201]: INFO nova.compute.claims [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Claim successful on node user
Aug 01 15:37:38 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:37:38 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:37:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:37:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:37:38 user nova-compute[72201]: DEBUG nova.network.neutron [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:37:38 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:37:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:37:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:37:38 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:37:38 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Creating image(s)
Aug 01 15:37:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "/opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "/opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:37:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:39 user nova-compute[72201]: DEBUG nova.policy [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75b0cb34dac64c61a235470454e0c6bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed7463cb6f84c4a8cf1ef0437eca988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:37:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.137s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:37:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:37:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.132s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:37:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:37:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk 1073741824" returned: 0 in 0.048s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:37:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:37:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.129s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:37:39 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:37:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:37:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:37:39 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Cannot resize image /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:37:39 user nova-compute[72201]: DEBUG nova.objects.instance [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'migration_context' on Instance uuid f0743332-223f-4507-b8b1-40d63b7b5e80 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:37:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:37:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Ensure instance console log exists: /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:37:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:40 user nova-compute[72201]: DEBUG nova.network.neutron [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Successfully created port: 6062f511-7140-4d9d-b36d-148a2f8a7fb5 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:37:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:41 user nova-compute[72201]: DEBUG nova.network.neutron [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Successfully updated port: 6062f511-7140-4d9d-b36d-148a2f8a7fb5 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:37:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:37:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquired lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:37:41 user nova-compute[72201]: DEBUG nova.network.neutron [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:37:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-e3df4245-41a8-4593-87dc-2c5a0ff429f4 req-0a7d5c34-0edb-4d23-a791-e7b760ecdbb6 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Received event network-changed-6062f511-7140-4d9d-b36d-148a2f8a7fb5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:37:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-e3df4245-41a8-4593-87dc-2c5a0ff429f4 req-0a7d5c34-0edb-4d23-a791-e7b760ecdbb6 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Refreshing instance network info cache due to event network-changed-6062f511-7140-4d9d-b36d-148a2f8a7fb5. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:37:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e3df4245-41a8-4593-87dc-2c5a0ff429f4 req-0a7d5c34-0edb-4d23-a791-e7b760ecdbb6 service nova] Acquiring lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:37:41 user nova-compute[72201]: DEBUG nova.network.neutron [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.network.neutron [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Updating instance_info_cache with network_info: [{"id": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "address": "fa:16:3e:6a:5e:e0", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6062f511-71", "ovs_interfaceid": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Releasing lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Instance network_info: |[{"id": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "address": "fa:16:3e:6a:5e:e0", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6062f511-71", "ovs_interfaceid": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e3df4245-41a8-4593-87dc-2c5a0ff429f4 req-0a7d5c34-0edb-4d23-a791-e7b760ecdbb6 service nova] Acquired lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.network.neutron [req-e3df4245-41a8-4593-87dc-2c5a0ff429f4 req-0a7d5c34-0edb-4d23-a791-e7b760ecdbb6 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Refreshing network info cache for port 6062f511-7140-4d9d-b36d-148a2f8a7fb5 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Start _get_guest_xml network_info=[{"id": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "address": "fa:16:3e:6a:5e:e0", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6062f511-71", "ovs_interfaceid": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:37:42 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:37:42 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1796964185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1796964185',id=36,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ed7463cb6f84c4a8cf1ef0437eca988',ramdisk_id='',reservation_id='r-m9zq30r6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:37:39Z,user_data=None,user_id='75b0cb34dac64c61a235470454e0c6bf',uuid=f0743332-223f-4507-b8b1-40d63b7b5e80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "address": "fa:16:3e:6a:5e:e0", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6062f511-71", "ovs_interfaceid": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converting VIF {"id": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "address": "fa:16:3e:6a:5e:e0", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6062f511-71", "ovs_interfaceid": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:5e:e0,bridge_name='br-int',has_traffic_filtering=True,id=6062f511-7140-4d9d-b36d-148a2f8a7fb5,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6062f511-71') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.objects.instance [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'pci_devices' on Instance uuid f0743332-223f-4507-b8b1-40d63b7b5e80 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:37:42 user nova-compute[72201]:   <uuid>f0743332-223f-4507-b8b1-40d63b7b5e80</uuid>
Aug 01 15:37:42 user nova-compute[72201]:   <name>instance-00000024</name>
Aug 01 15:37:42 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:37:42 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:37:42 user nova-compute[72201]:   <metadata>
Aug 01 15:37:42 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:37:42 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:37:42 user nova-compute[72201]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1796964185</nova:name>
Aug 01 15:37:42 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:37:42</nova:creationTime>
Aug 01 15:37:42 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:37:42 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:37:42 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:37:42 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:37:42 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:37:42 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:37:42 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:37:42 user nova-compute[72201]:       <nova:owner>
Aug 01 15:37:42 user nova-compute[72201]:         <nova:user uuid="75b0cb34dac64c61a235470454e0c6bf">tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member</nova:user>
Aug 01 15:37:42 user nova-compute[72201]:         <nova:project uuid="2ed7463cb6f84c4a8cf1ef0437eca988">tempest-ServerBootFromVolumeStableRescueTest-1836467291</nova:project>
Aug 01 15:37:42 user nova-compute[72201]:       </nova:owner>
Aug 01 15:37:42 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:37:42 user nova-compute[72201]:       <nova:ports>
Aug 01 15:37:42 user nova-compute[72201]:         <nova:port uuid="6062f511-7140-4d9d-b36d-148a2f8a7fb5">
Aug 01 15:37:42 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 15:37:42 user nova-compute[72201]:         </nova:port>
Aug 01 15:37:42 user nova-compute[72201]:       </nova:ports>
Aug 01 15:37:42 user nova-compute[72201]:     </nova:instance>
Aug 01 15:37:42 user nova-compute[72201]:   </metadata>
Aug 01 15:37:42 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:37:42 user nova-compute[72201]:     <system>
Aug 01 15:37:42 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:37:42 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:37:42 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:37:42 user nova-compute[72201]:       <entry name="serial">f0743332-223f-4507-b8b1-40d63b7b5e80</entry>
Aug 01 15:37:42 user nova-compute[72201]:       <entry name="uuid">f0743332-223f-4507-b8b1-40d63b7b5e80</entry>
Aug 01 15:37:42 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:37:42 user nova-compute[72201]:     </system>
Aug 01 15:37:42 user nova-compute[72201]:   </sysinfo>
Aug 01 15:37:42 user nova-compute[72201]:   <os>
Aug 01 15:37:42 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:37:42 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:37:42 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:37:42 user nova-compute[72201]:   </os>
Aug 01 15:37:42 user nova-compute[72201]:   <features>
Aug 01 15:37:42 user nova-compute[72201]:     <acpi/>
Aug 01 15:37:42 user nova-compute[72201]:     <apic/>
Aug 01 15:37:42 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:37:42 user nova-compute[72201]:   </features>
Aug 01 15:37:42 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:37:42 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:37:42 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:37:42 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:37:42 user nova-compute[72201]:   </clock>
Aug 01 15:37:42 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:37:42 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:37:42 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:37:42 user nova-compute[72201]:   </cpu>
Aug 01 15:37:42 user nova-compute[72201]:   <devices>
Aug 01 15:37:42 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:37:42 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:37:42 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk"/>
Aug 01 15:37:42 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:37:42 user nova-compute[72201]:     </disk>
Aug 01 15:37:42 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:37:42 user nova-compute[72201]:       <mac address="fa:16:3e:6a:5e:e0"/>
Aug 01 15:37:42 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:37:42 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:37:42 user nova-compute[72201]:       <target dev="tap6062f511-71"/>
Aug 01 15:37:42 user nova-compute[72201]:     </interface>
Aug 01 15:37:42 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:37:42 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/console.log" append="off"/>
Aug 01 15:37:42 user nova-compute[72201]:     </serial>
Aug 01 15:37:42 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:37:42 user nova-compute[72201]:     <video>
Aug 01 15:37:42 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:37:42 user nova-compute[72201]:     </video>
Aug 01 15:37:42 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:37:42 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:37:42 user nova-compute[72201]:     </rng>
Aug 01 15:37:42 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:37:42 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:37:42 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:37:42 user nova-compute[72201]:     </memballoon>
Aug 01 15:37:42 user nova-compute[72201]:   </devices>
Aug 01 15:37:42 user nova-compute[72201]: </domain>
Aug 01 15:37:42 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1796964185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1796964185',id=36,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ed7463cb6f84c4a8cf1ef0437eca988',ramdisk_id='',reservation_id='r-m9zq30r6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:37:39Z,user_data=None,user_id='75b0cb34dac64c61a235470454e0c6bf',uuid=f0743332-223f-4507-b8b1-40d63b7b5e80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "address": "fa:16:3e:6a:5e:e0", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6062f511-71", "ovs_interfaceid": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converting VIF {"id": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "address": "fa:16:3e:6a:5e:e0", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6062f511-71", "ovs_interfaceid": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:5e:e0,bridge_name='br-int',has_traffic_filtering=True,id=6062f511-7140-4d9d-b36d-148a2f8a7fb5,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6062f511-71') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG os_vif [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:5e:e0,bridge_name='br-int',has_traffic_filtering=True,id=6062f511-7140-4d9d-b36d-148a2f8a7fb5,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6062f511-71') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6062f511-71, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6062f511-71, col_values=(('external_ids', {'iface-id': '6062f511-7140-4d9d-b36d-148a2f8a7fb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:5e:e0', 'vm-uuid': 'f0743332-223f-4507-b8b1-40d63b7b5e80'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:42 user nova-compute[72201]: INFO os_vif [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:5e:e0,bridge_name='br-int',has_traffic_filtering=True,id=6062f511-7140-4d9d-b36d-148a2f8a7fb5,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6062f511-71')
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] No VIF found with MAC fa:16:3e:6a:5e:e0, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.network.neutron [req-e3df4245-41a8-4593-87dc-2c5a0ff429f4 req-0a7d5c34-0edb-4d23-a791-e7b760ecdbb6 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Updated VIF entry in instance network info cache for port 6062f511-7140-4d9d-b36d-148a2f8a7fb5. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG nova.network.neutron [req-e3df4245-41a8-4593-87dc-2c5a0ff429f4 req-0a7d5c34-0edb-4d23-a791-e7b760ecdbb6 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Updating instance_info_cache with network_info: [{"id": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "address": "fa:16:3e:6a:5e:e0", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6062f511-71", "ovs_interfaceid": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:37:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e3df4245-41a8-4593-87dc-2c5a0ff429f4 req-0a7d5c34-0edb-4d23-a791-e7b760ecdbb6 service nova] Releasing lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:37:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-3f8bbd04-06e8-4af3-859e-2efc8f34b5f4 req-5bdbeb26-c6ec-40bb-aba9-545ff787cf2c service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Received event network-vif-plugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:37:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3f8bbd04-06e8-4af3-859e-2efc8f34b5f4 req-5bdbeb26-c6ec-40bb-aba9-545ff787cf2c service nova] Acquiring lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3f8bbd04-06e8-4af3-859e-2efc8f34b5f4 req-5bdbeb26-c6ec-40bb-aba9-545ff787cf2c service nova] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3f8bbd04-06e8-4af3-859e-2efc8f34b5f4 req-5bdbeb26-c6ec-40bb-aba9-545ff787cf2c service nova] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-3f8bbd04-06e8-4af3-859e-2efc8f34b5f4 req-5bdbeb26-c6ec-40bb-aba9-545ff787cf2c service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] No waiting events found dispatching network-vif-plugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:37:43 user nova-compute[72201]: WARNING nova.compute.manager [req-3f8bbd04-06e8-4af3-859e-2efc8f34b5f4 req-5bdbeb26-c6ec-40bb-aba9-545ff787cf2c service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Received unexpected event network-vif-plugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 for instance with vm_state building and task_state spawning.
Aug 01 15:37:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:45 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904265.7558975, f0743332-223f-4507-b8b1-40d63b7b5e80 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:37:45 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] VM Resumed (Lifecycle Event)
Aug 01 15:37:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:37:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:37:45 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Instance spawned successfully.
Aug 01 15:37:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:37:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:37:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:37:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:37:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:37:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:37:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:37:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:37:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:37:45 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:37:45 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904265.7580569, f0743332-223f-4507-b8b1-40d63b7b5e80 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:37:45 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] VM Started (Lifecycle Event)
Aug 01 15:37:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:37:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:37:45 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:37:45 user nova-compute[72201]: INFO nova.compute.manager [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Took 6.92 seconds to spawn the instance on the hypervisor.
Aug 01 15:37:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:37:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-9f837167-852d-4af8-bde2-c1c07ea8a09d req-52f57dd2-2676-43d1-b6c2-c2ebb6730308 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Received event network-vif-plugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:37:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9f837167-852d-4af8-bde2-c1c07ea8a09d req-52f57dd2-2676-43d1-b6c2-c2ebb6730308 service nova] Acquiring lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9f837167-852d-4af8-bde2-c1c07ea8a09d req-52f57dd2-2676-43d1-b6c2-c2ebb6730308 service nova] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9f837167-852d-4af8-bde2-c1c07ea8a09d req-52f57dd2-2676-43d1-b6c2-c2ebb6730308 service nova] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-9f837167-852d-4af8-bde2-c1c07ea8a09d req-52f57dd2-2676-43d1-b6c2-c2ebb6730308 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] No waiting events found dispatching network-vif-plugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:37:45 user nova-compute[72201]: WARNING nova.compute.manager [req-9f837167-852d-4af8-bde2-c1c07ea8a09d req-52f57dd2-2676-43d1-b6c2-c2ebb6730308 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Received unexpected event network-vif-plugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 for instance with vm_state building and task_state spawning.
Aug 01 15:37:45 user nova-compute[72201]: INFO nova.compute.manager [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Took 7.43 seconds to build instance.
Aug 01 15:37:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d8b0625d-3ad7-4bac-9df9-6d88dcb7dffc tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.517s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:47 user nova-compute[72201]: DEBUG nova.compute.manager [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:37:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:47 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:37:47 user nova-compute[72201]: INFO nova.compute.claims [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Claim successful on node user
Aug 01 15:37:47 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:37:47 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:37:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.261s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:47 user nova-compute[72201]: DEBUG nova.compute.manager [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:37:47 user nova-compute[72201]: DEBUG nova.compute.manager [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:37:47 user nova-compute[72201]: DEBUG nova.network.neutron [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:37:47 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:37:47 user nova-compute[72201]: DEBUG nova.compute.manager [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:37:47 user nova-compute[72201]: DEBUG nova.policy [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2caf51668cff454284097f6e91661c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe1b0601b564f789cbd45138114e95b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:37:47 user nova-compute[72201]: DEBUG nova.compute.manager [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:37:47 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:37:47 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Creating image(s)
Aug 01 15:37:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "/opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "/opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.157s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.144s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk 1073741824" returned: 0 in 0.053s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.157s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Cannot resize image /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG nova.objects.instance [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'migration_context' on Instance uuid d2fda4cb-e06e-4aad-9c8d-454eb8ed578d {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Ensure instance console log exists: /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG nova.network.neutron [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Successfully created port: a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:37:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:49 user nova-compute[72201]: DEBUG nova.network.neutron [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Successfully updated port: a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:37:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "refresh_cache-d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:37:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquired lock "refresh_cache-d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:37:49 user nova-compute[72201]: DEBUG nova.network.neutron [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:37:49 user nova-compute[72201]: DEBUG nova.compute.manager [req-4b2d4900-5a5b-4b76-869c-a6e27e081d4f req-1053030b-e3dd-4a61-a724-87d9d3847d58 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Received event network-changed-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:37:49 user nova-compute[72201]: DEBUG nova.compute.manager [req-4b2d4900-5a5b-4b76-869c-a6e27e081d4f req-1053030b-e3dd-4a61-a724-87d9d3847d58 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Refreshing instance network info cache due to event network-changed-a0dad7e0-1c01-4c8f-abc1-72650c5390d4. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:37:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4b2d4900-5a5b-4b76-869c-a6e27e081d4f req-1053030b-e3dd-4a61-a724-87d9d3847d58 service nova] Acquiring lock "refresh_cache-d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:37:49 user nova-compute[72201]: DEBUG nova.network.neutron [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:37:49 user nova-compute[72201]: DEBUG nova.network.neutron [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Updating instance_info_cache with network_info: [{"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:37:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Releasing lock "refresh_cache-d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:37:49 user nova-compute[72201]: DEBUG nova.compute.manager [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Instance network_info: |[{"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:37:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4b2d4900-5a5b-4b76-869c-a6e27e081d4f req-1053030b-e3dd-4a61-a724-87d9d3847d58 service nova] Acquired lock "refresh_cache-d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:37:49 user nova-compute[72201]: DEBUG nova.network.neutron [req-4b2d4900-5a5b-4b76-869c-a6e27e081d4f req-1053030b-e3dd-4a61-a724-87d9d3847d58 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Refreshing network info cache for port a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:37:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Start _get_guest_xml network_info=[{"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:37:49 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:37:49 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:37:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:37:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:37:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:37:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:37:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:37:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1409369655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1409369655',id=37,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1UwRi2DLxVkCy7f6TeJOq3Esxx8EN67AgUIDTYqNjKiFyedgrt4A4GVJf/i9wFUBHnDxvju/m05DMK0cWUmOSdPmtX6heks7S/3CnY/EItVPiAFtvpneGJhC02WW+9gA==',key_name='tempest-keypair-348355751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbe1b0601b564f789cbd45138114e95b',ramdisk_id='',reservation_id='r-fn43bruo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-858719582',owner_user_name='tempest-AttachVolumeShelveTestJSON-858719582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2caf51668cff454284097f6e91661c17',uuid=d2fda4cb-e06e-4aad-9c8d-454eb8ed578d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converting VIF {"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:69:03,bridge_name='br-int',has_traffic_filtering=True,id=a0dad7e0-1c01-4c8f-abc1-72650c5390d4,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0dad7e0-1c') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.objects.instance [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'pci_devices' on Instance uuid d2fda4cb-e06e-4aad-9c8d-454eb8ed578d {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:37:50 user nova-compute[72201]:   <uuid>d2fda4cb-e06e-4aad-9c8d-454eb8ed578d</uuid>
Aug 01 15:37:50 user nova-compute[72201]:   <name>instance-00000025</name>
Aug 01 15:37:50 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:37:50 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:37:50 user nova-compute[72201]:   <metadata>
Aug 01 15:37:50 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:37:50 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:37:50 user nova-compute[72201]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1409369655</nova:name>
Aug 01 15:37:50 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:37:49</nova:creationTime>
Aug 01 15:37:50 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:37:50 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:37:50 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:37:50 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:37:50 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:37:50 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:37:50 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:37:50 user nova-compute[72201]:       <nova:owner>
Aug 01 15:37:50 user nova-compute[72201]:         <nova:user uuid="2caf51668cff454284097f6e91661c17">tempest-AttachVolumeShelveTestJSON-858719582-project-member</nova:user>
Aug 01 15:37:50 user nova-compute[72201]:         <nova:project uuid="fbe1b0601b564f789cbd45138114e95b">tempest-AttachVolumeShelveTestJSON-858719582</nova:project>
Aug 01 15:37:50 user nova-compute[72201]:       </nova:owner>
Aug 01 15:37:50 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:37:50 user nova-compute[72201]:       <nova:ports>
Aug 01 15:37:50 user nova-compute[72201]:         <nova:port uuid="a0dad7e0-1c01-4c8f-abc1-72650c5390d4">
Aug 01 15:37:50 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 15:37:50 user nova-compute[72201]:         </nova:port>
Aug 01 15:37:50 user nova-compute[72201]:       </nova:ports>
Aug 01 15:37:50 user nova-compute[72201]:     </nova:instance>
Aug 01 15:37:50 user nova-compute[72201]:   </metadata>
Aug 01 15:37:50 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:37:50 user nova-compute[72201]:     <system>
Aug 01 15:37:50 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:37:50 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:37:50 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:37:50 user nova-compute[72201]:       <entry name="serial">d2fda4cb-e06e-4aad-9c8d-454eb8ed578d</entry>
Aug 01 15:37:50 user nova-compute[72201]:       <entry name="uuid">d2fda4cb-e06e-4aad-9c8d-454eb8ed578d</entry>
Aug 01 15:37:50 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:37:50 user nova-compute[72201]:     </system>
Aug 01 15:37:50 user nova-compute[72201]:   </sysinfo>
Aug 01 15:37:50 user nova-compute[72201]:   <os>
Aug 01 15:37:50 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:37:50 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:37:50 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:37:50 user nova-compute[72201]:   </os>
Aug 01 15:37:50 user nova-compute[72201]:   <features>
Aug 01 15:37:50 user nova-compute[72201]:     <acpi/>
Aug 01 15:37:50 user nova-compute[72201]:     <apic/>
Aug 01 15:37:50 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:37:50 user nova-compute[72201]:   </features>
Aug 01 15:37:50 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:37:50 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:37:50 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:37:50 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:37:50 user nova-compute[72201]:   </clock>
Aug 01 15:37:50 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:37:50 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:37:50 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:37:50 user nova-compute[72201]:   </cpu>
Aug 01 15:37:50 user nova-compute[72201]:   <devices>
Aug 01 15:37:50 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:37:50 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:37:50 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk"/>
Aug 01 15:37:50 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:37:50 user nova-compute[72201]:     </disk>
Aug 01 15:37:50 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:37:50 user nova-compute[72201]:       <mac address="fa:16:3e:c6:69:03"/>
Aug 01 15:37:50 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:37:50 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:37:50 user nova-compute[72201]:       <target dev="tapa0dad7e0-1c"/>
Aug 01 15:37:50 user nova-compute[72201]:     </interface>
Aug 01 15:37:50 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:37:50 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/console.log" append="off"/>
Aug 01 15:37:50 user nova-compute[72201]:     </serial>
Aug 01 15:37:50 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:37:50 user nova-compute[72201]:     <video>
Aug 01 15:37:50 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:37:50 user nova-compute[72201]:     </video>
Aug 01 15:37:50 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:37:50 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:37:50 user nova-compute[72201]:     </rng>
Aug 01 15:37:50 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:37:50 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:37:50 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:37:50 user nova-compute[72201]:     </memballoon>
Aug 01 15:37:50 user nova-compute[72201]:   </devices>
Aug 01 15:37:50 user nova-compute[72201]: </domain>
Aug 01 15:37:50 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1409369655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1409369655',id=37,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1UwRi2DLxVkCy7f6TeJOq3Esxx8EN67AgUIDTYqNjKiFyedgrt4A4GVJf/i9wFUBHnDxvju/m05DMK0cWUmOSdPmtX6heks7S/3CnY/EItVPiAFtvpneGJhC02WW+9gA==',key_name='tempest-keypair-348355751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbe1b0601b564f789cbd45138114e95b',ramdisk_id='',reservation_id='r-fn43bruo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-858719582',owner_user_name='tempest-AttachVolumeShelveTestJSON-858719582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2caf51668cff454284097f6e91661c17',uuid=d2fda4cb-e06e-4aad-9c8d-454eb8ed578d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converting VIF {"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:69:03,bridge_name='br-int',has_traffic_filtering=True,id=a0dad7e0-1c01-4c8f-abc1-72650c5390d4,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0dad7e0-1c') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG os_vif [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:69:03,bridge_name='br-int',has_traffic_filtering=True,id=a0dad7e0-1c01-4c8f-abc1-72650c5390d4,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0dad7e0-1c') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0dad7e0-1c, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa0dad7e0-1c, col_values=(('external_ids', {'iface-id': 'a0dad7e0-1c01-4c8f-abc1-72650c5390d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:69:03', 'vm-uuid': 'd2fda4cb-e06e-4aad-9c8d-454eb8ed578d'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:50 user nova-compute[72201]: INFO os_vif [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:69:03,bridge_name='br-int',has_traffic_filtering=True,id=a0dad7e0-1c01-4c8f-abc1-72650c5390d4,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0dad7e0-1c')
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] No VIF found with MAC fa:16:3e:c6:69:03, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.network.neutron [req-4b2d4900-5a5b-4b76-869c-a6e27e081d4f req-1053030b-e3dd-4a61-a724-87d9d3847d58 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Updated VIF entry in instance network info cache for port a0dad7e0-1c01-4c8f-abc1-72650c5390d4. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG nova.network.neutron [req-4b2d4900-5a5b-4b76-869c-a6e27e081d4f req-1053030b-e3dd-4a61-a724-87d9d3847d58 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Updating instance_info_cache with network_info: [{"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:37:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4b2d4900-5a5b-4b76-869c-a6e27e081d4f req-1053030b-e3dd-4a61-a724-87d9d3847d58 service nova] Releasing lock "refresh_cache-d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:37:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:51 user nova-compute[72201]: DEBUG nova.compute.manager [req-a6eefe37-76fa-426c-9496-4db6a3756c7e req-dd020afa-dd05-47c7-9b14-340896d532e9 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Received event network-vif-plugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:37:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6eefe37-76fa-426c-9496-4db6a3756c7e req-dd020afa-dd05-47c7-9b14-340896d532e9 service nova] Acquiring lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6eefe37-76fa-426c-9496-4db6a3756c7e req-dd020afa-dd05-47c7-9b14-340896d532e9 service nova] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a6eefe37-76fa-426c-9496-4db6a3756c7e req-dd020afa-dd05-47c7-9b14-340896d532e9 service nova] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:51 user nova-compute[72201]: DEBUG nova.compute.manager [req-a6eefe37-76fa-426c-9496-4db6a3756c7e req-dd020afa-dd05-47c7-9b14-340896d532e9 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] No waiting events found dispatching network-vif-plugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:37:51 user nova-compute[72201]: WARNING nova.compute.manager [req-a6eefe37-76fa-426c-9496-4db6a3756c7e req-dd020afa-dd05-47c7-9b14-340896d532e9 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Received unexpected event network-vif-plugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 for instance with vm_state building and task_state spawning.
Aug 01 15:37:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:53 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904273.6820726, d2fda4cb-e06e-4aad-9c8d-454eb8ed578d => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:37:53 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] VM Resumed (Lifecycle Event)
Aug 01 15:37:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:37:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:37:53 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Instance spawned successfully.
Aug 01 15:37:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:37:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:37:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:37:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:37:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:37:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:37:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:37:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:37:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:37:53 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:37:53 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904273.682909, d2fda4cb-e06e-4aad-9c8d-454eb8ed578d => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:37:53 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] VM Started (Lifecycle Event)
Aug 01 15:37:53 user nova-compute[72201]: DEBUG nova.compute.manager [req-58c4f15b-5c3d-4dff-ab86-f9b3f5765139 req-c1118f0e-b7f1-4e96-ba31-ead654733a8c service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Received event network-vif-plugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:37:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-58c4f15b-5c3d-4dff-ab86-f9b3f5765139 req-c1118f0e-b7f1-4e96-ba31-ead654733a8c service nova] Acquiring lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:37:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-58c4f15b-5c3d-4dff-ab86-f9b3f5765139 req-c1118f0e-b7f1-4e96-ba31-ead654733a8c service nova] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:37:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-58c4f15b-5c3d-4dff-ab86-f9b3f5765139 req-c1118f0e-b7f1-4e96-ba31-ead654733a8c service nova] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:53 user nova-compute[72201]: DEBUG nova.compute.manager [req-58c4f15b-5c3d-4dff-ab86-f9b3f5765139 req-c1118f0e-b7f1-4e96-ba31-ead654733a8c service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] No waiting events found dispatching network-vif-plugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:37:53 user nova-compute[72201]: WARNING nova.compute.manager [req-58c4f15b-5c3d-4dff-ab86-f9b3f5765139 req-c1118f0e-b7f1-4e96-ba31-ead654733a8c service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Received unexpected event network-vif-plugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 for instance with vm_state building and task_state spawning.
Aug 01 15:37:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:37:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:37:53 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:37:53 user nova-compute[72201]: INFO nova.compute.manager [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Took 5.87 seconds to spawn the instance on the hypervisor.
Aug 01 15:37:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:37:53 user nova-compute[72201]: INFO nova.compute.manager [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Took 6.54 seconds to build instance.
Aug 01 15:37:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-02545a82-8a23-497f-acdf-f39fa4d4241e tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.632s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:37:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:37:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:38:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:11 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:38:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:38:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 15:38:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-929ed2b3-a72e-424e-94c4-352c207442ec" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:38:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-929ed2b3-a72e-424e-94c4-352c207442ec" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:38:11 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:38:11 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid 929ed2b3-a72e-424e-94c4-352c207442ec {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:38:11 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Updating instance_info_cache with network_info: [{"id": "112cdddb-0763-476b-a269-aed7d05c7856", "address": "fa:16:3e:66:f3:81", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112cdddb-07", "ovs_interfaceid": "112cdddb-0763-476b-a269-aed7d05c7856", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:38:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-929ed2b3-a72e-424e-94c4-352c207442ec" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:38:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:38:11 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:38:13 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:38:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquiring lock "a7721f4d-4a5b-4196-9358-9126426566f0" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "a7721f4d-4a5b-4196-9358-9126426566f0" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:38:14 user nova-compute[72201]: INFO nova.compute.manager [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Unshelving
Aug 01 15:38:14 user nova-compute[72201]: INFO nova.virt.block_device [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Booting with volume c7de637b-e39e-4bad-af19-bb86cdba4ac1 at /dev/vda
Aug 01 15:38:14 user nova-compute[72201]: DEBUG os_brick.utils [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1a7f02-cb00-4b25-9f04-4c3e0b0b8a35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc660b3d-7184-42b9-ad31-0274279c88e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4bed7b-9737-4f26-9f80-9c42433ddc01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d576e9e2-b3e6-4471-b683-d43b00a76ae3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:38:14 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:38:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6a5dc1-f24f-4c85-90f6-e64ef8edc874]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG os_brick.utils [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:38:14 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Updating existing volume attachment record: 0cd96381-0f1c-40d5-8967-7f1d560d84ce {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:38:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:17 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:38:17 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:38:17 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:38:17 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:38:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:38:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:38:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:38:17 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:38:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:18 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:18 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:38:18 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:38:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8149MB free_disk=25.44760513305664GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:38:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:38:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:38:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 929ed2b3-a72e-424e-94c4-352c207442ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:38:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f0743332-223f-4507-b8b1-40d63b7b5e80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:38:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance d2fda4cb-e06e-4aad-9c8d-454eb8ed578d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:38:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance a7721f4d-4a5b-4196-9358-9126426566f0 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 01 15:38:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:38:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:38:18 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:38:18 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:38:18 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:38:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.343s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:38:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:19 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:38:19 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:38:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:38:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:38:22 user nova-compute[72201]: DEBUG nova.objects.instance [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lazy-loading 'pci_requests' on Instance uuid a7721f4d-4a5b-4196-9358-9126426566f0 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:38:22 user nova-compute[72201]: DEBUG nova.objects.instance [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lazy-loading 'numa_topology' on Instance uuid a7721f4d-4a5b-4196-9358-9126426566f0 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:38:22 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:38:22 user nova-compute[72201]: INFO nova.compute.claims [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Claim successful on node user
Aug 01 15:38:22 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:38:22 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:38:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:38:22 user nova-compute[72201]: INFO nova.network.neutron [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Updating port 3ca61173-de45-4386-a12b-9ecdf45b29d9 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 15:38:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:38:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:38:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:38:23 user nova-compute[72201]: INFO nova.compute.claims [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Claim successful on node user
Aug 01 15:38:23 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG nova.compute.manager [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG nova.compute.manager [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG nova.network.neutron [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:38:23 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:38:23 user nova-compute[72201]: DEBUG nova.compute.manager [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG nova.policy [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '243e1aae552d43b7b892618022460e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9978ab74a743b6870f1a86469debb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG nova.compute.manager [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:38:23 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Creating image(s)
Aug 01 15:38:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "/opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "/opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "/opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquiring lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquired lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG nova.network.neutron [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-1fc0aa4c-8e24-46ba-9ac5-6bb2e704c590 req-c13b9c1e-e07d-4eba-916d-0802f7efb477 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received event network-changed-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-1fc0aa4c-8e24-46ba-9ac5-6bb2e704c590 req-c13b9c1e-e07d-4eba-916d-0802f7efb477 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Refreshing instance network info cache due to event network-changed-3ca61173-de45-4386-a12b-9ecdf45b29d9. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1fc0aa4c-8e24-46ba-9ac5-6bb2e704c590 req-c13b9c1e-e07d-4eba-916d-0802f7efb477 service nova] Acquiring lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.145s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.168s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk 1073741824" returned: 0 in 0.063s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Checking if we can resize image /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.network.neutron [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Successfully created port: 1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Cannot resize image /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.objects.instance [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'migration_context' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Ensure instance console log exists: /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.network.neutron [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Updating instance_info_cache with network_info: [{"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Releasing lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:38:24 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Creating image(s)
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Did not create local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Ensure instance console log exists: /opt/stack/data/nova/instances/a7721f4d-4a5b-4196-9358-9126426566f0/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Start _get_guest_xml network_info=[{"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YwXuUipm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a7721f4d-4a5b-4196-9358-9126426566f0', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7de637b-e39e-4bad-af19-bb86cdba4ac1', 'serial': 'c7de637b-e39e-4bad-af19-bb86cdba4ac1'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '0cd96381-0f1c-40d5-8967-7f1d560d84ce', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1fc0aa4c-8e24-46ba-9ac5-6bb2e704c590 req-c13b9c1e-e07d-4eba-916d-0802f7efb477 service nova] Acquired lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.network.neutron [req-1fc0aa4c-8e24-46ba-9ac5-6bb2e704c590 req-c13b9c1e-e07d-4eba-916d-0802f7efb477 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Refreshing network info cache for port 3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:38:24 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:38:24 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.objects.instance [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lazy-loading 'vcpu_model' on Instance uuid a7721f4d-4a5b-4196-9358-9126426566f0 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YwXuUipm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:38:24 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:38:24 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:38:24 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df03d43-31ef-4feb-9df8-332384a40ba1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:38:24 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[27222822-8869-4c0b-aa1b-4ea8238edf2d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1] added
Aug 01 15:38:24 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9503298-b578-4bb8-a4fc-20c7b6e2b235]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3d2c67-f441-4383-89c8-c5c483516b86]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YwXuUipm {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YwXuUipm" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee71131-55a7-4285-9e21-3258bc8e03bd]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YwXuUipm'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd8d5cc-acd6-4f26-91a1-77398f77b75a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[72872d2c-84ed-4d6d-b795-d1f684a8f550]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 15:38:24 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 15:38:24 user nova-compute[72201]:  {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:38:24 user nova-compute[72201]: WARNING os_brick.initiator.connectors.iscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 15:38:24 user nova-compute[72201]: 
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a22e6bb-fc9b-4882-a46b-90dba2a69aea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1, portal: 172.16.0.220,3260]
Aug 01 15:38:24 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1, portal: 172.16.0.220,3260] successful.
Aug 01 15:38:24 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f114299e-9b4c-4a05-8b52-32a72d9888d7]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[28db27d6-6e2d-4c89-a592-b1414680d048]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)
Aug 01 15:38:24 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)
Aug 01 15:38:24 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe7e76e-6510-4c4a-a58b-8d92c1d1b22e]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:38:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YwXuUipm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.network.neutron [req-1fc0aa4c-8e24-46ba-9ac5-6bb2e704c590 req-c13b9c1e-e07d-4eba-916d-0802f7efb477 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Updated VIF entry in instance network info cache for port 3ca61173-de45-4386-a12b-9ecdf45b29d9. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.network.neutron [req-1fc0aa4c-8e24-46ba-9ac5-6bb2e704c590 req-c13b9c1e-e07d-4eba-916d-0802f7efb477 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Updating instance_info_cache with network_info: [{"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1fc0aa4c-8e24-46ba-9ac5-6bb2e704c590 req-c13b9c1e-e07d-4eba-916d-0802f7efb477 service nova] Releasing lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.network.neutron [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Successfully updated port: 1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "refresh_cache-801f5645-aff6-41ea-bb28-34e8dcacfe20" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquired lock "refresh_cache-801f5645-aff6-41ea-bb28-34e8dcacfe20" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.network.neutron [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-e21975aa-88a4-458f-82ad-3010d3c976d2 req-6db147e4-4987-472e-acd6-33aad3ba4335 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received event network-changed-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-e21975aa-88a4-458f-82ad-3010d3c976d2 req-6db147e4-4987-472e-acd6-33aad3ba4335 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Refreshing instance network info cache due to event network-changed-1ad27823-4773-4b78-bbe0-1378855554c8. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e21975aa-88a4-458f-82ad-3010d3c976d2 req-6db147e4-4987-472e-acd6-33aad3ba4335 service nova] Acquiring lock "refresh_cache-801f5645-aff6-41ea-bb28-34e8dcacfe20" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.network.neutron [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.network.neutron [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Updating instance_info_cache with network_info: [{"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Releasing lock "refresh_cache-801f5645-aff6-41ea-bb28-34e8dcacfe20" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.compute.manager [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Instance network_info: |[{"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e21975aa-88a4-458f-82ad-3010d3c976d2 req-6db147e4-4987-472e-acd6-33aad3ba4335 service nova] Acquired lock "refresh_cache-801f5645-aff6-41ea-bb28-34e8dcacfe20" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.network.neutron [req-e21975aa-88a4-458f-82ad-3010d3c976d2 req-6db147e4-4987-472e-acd6-33aad3ba4335 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Refreshing network info cache for port 1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Start _get_guest_xml network_info=[{"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:38:25 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:38:25 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1438545025',display_name='tempest-AttachVolumeTestJSON-server-1438545025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1438545025',id=38,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5sTybeqRu+KrWZIs2Qy17OX/PCK/I5EFDxt6til1PIQ3CSrY0rgKAekgLbUup6BgzQOCUtfNIUY2C5P7VWdfbkUmmeezeVSiWHDBAhmzUEyBhfgdTIHXtComrkv3PWWQ==',key_name='tempest-keypair-634092699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b9978ab74a743b6870f1a86469debb4',ramdisk_id='',reservation_id='r-k1ayhqoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-570587534',owner_user_name='tempest-AttachVolumeTestJSON-570587534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='243e1aae552d43b7b892618022460e1b',uuid=801f5645-aff6-41ea-bb28-34e8dcacfe20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converting VIF {"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:d3:89,bridge_name='br-int',has_traffic_filtering=True,id=1ad27823-4773-4b78-bbe0-1378855554c8,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad27823-47') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.objects.instance [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'pci_devices' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:38:25 user nova-compute[72201]:   <uuid>801f5645-aff6-41ea-bb28-34e8dcacfe20</uuid>
Aug 01 15:38:25 user nova-compute[72201]:   <name>instance-00000026</name>
Aug 01 15:38:25 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:38:25 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:38:25 user nova-compute[72201]:   <metadata>
Aug 01 15:38:25 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:38:25 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:38:25 user nova-compute[72201]:       <nova:name>tempest-AttachVolumeTestJSON-server-1438545025</nova:name>
Aug 01 15:38:25 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:38:25</nova:creationTime>
Aug 01 15:38:25 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:38:25 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:38:25 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:38:25 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:38:25 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:38:25 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:38:25 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:38:25 user nova-compute[72201]:       <nova:owner>
Aug 01 15:38:25 user nova-compute[72201]:         <nova:user uuid="243e1aae552d43b7b892618022460e1b">tempest-AttachVolumeTestJSON-570587534-project-member</nova:user>
Aug 01 15:38:25 user nova-compute[72201]:         <nova:project uuid="1b9978ab74a743b6870f1a86469debb4">tempest-AttachVolumeTestJSON-570587534</nova:project>
Aug 01 15:38:25 user nova-compute[72201]:       </nova:owner>
Aug 01 15:38:25 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:38:25 user nova-compute[72201]:       <nova:ports>
Aug 01 15:38:25 user nova-compute[72201]:         <nova:port uuid="1ad27823-4773-4b78-bbe0-1378855554c8">
Aug 01 15:38:25 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 15:38:25 user nova-compute[72201]:         </nova:port>
Aug 01 15:38:25 user nova-compute[72201]:       </nova:ports>
Aug 01 15:38:25 user nova-compute[72201]:     </nova:instance>
Aug 01 15:38:25 user nova-compute[72201]:   </metadata>
Aug 01 15:38:25 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:38:25 user nova-compute[72201]:     <system>
Aug 01 15:38:25 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:38:25 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:38:25 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:38:25 user nova-compute[72201]:       <entry name="serial">801f5645-aff6-41ea-bb28-34e8dcacfe20</entry>
Aug 01 15:38:25 user nova-compute[72201]:       <entry name="uuid">801f5645-aff6-41ea-bb28-34e8dcacfe20</entry>
Aug 01 15:38:25 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:38:25 user nova-compute[72201]:     </system>
Aug 01 15:38:25 user nova-compute[72201]:   </sysinfo>
Aug 01 15:38:25 user nova-compute[72201]:   <os>
Aug 01 15:38:25 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:38:25 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:38:25 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:38:25 user nova-compute[72201]:   </os>
Aug 01 15:38:25 user nova-compute[72201]:   <features>
Aug 01 15:38:25 user nova-compute[72201]:     <acpi/>
Aug 01 15:38:25 user nova-compute[72201]:     <apic/>
Aug 01 15:38:25 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:38:25 user nova-compute[72201]:   </features>
Aug 01 15:38:25 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:38:25 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:38:25 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:38:25 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:38:25 user nova-compute[72201]:   </clock>
Aug 01 15:38:25 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:38:25 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:38:25 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:38:25 user nova-compute[72201]:   </cpu>
Aug 01 15:38:25 user nova-compute[72201]:   <devices>
Aug 01 15:38:25 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:38:25 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:38:25 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk"/>
Aug 01 15:38:25 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:38:25 user nova-compute[72201]:     </disk>
Aug 01 15:38:25 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:38:25 user nova-compute[72201]:       <mac address="fa:16:3e:f7:d3:89"/>
Aug 01 15:38:25 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:38:25 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:38:25 user nova-compute[72201]:       <target dev="tap1ad27823-47"/>
Aug 01 15:38:25 user nova-compute[72201]:     </interface>
Aug 01 15:38:25 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:38:25 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/console.log" append="off"/>
Aug 01 15:38:25 user nova-compute[72201]:     </serial>
Aug 01 15:38:25 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:38:25 user nova-compute[72201]:     <video>
Aug 01 15:38:25 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:38:25 user nova-compute[72201]:     </video>
Aug 01 15:38:25 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:38:25 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:38:25 user nova-compute[72201]:     </rng>
Aug 01 15:38:25 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:38:25 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:38:25 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:38:25 user nova-compute[72201]:     </memballoon>
Aug 01 15:38:25 user nova-compute[72201]:   </devices>
Aug 01 15:38:25 user nova-compute[72201]: </domain>
Aug 01 15:38:25 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1438545025',display_name='tempest-AttachVolumeTestJSON-server-1438545025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1438545025',id=38,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5sTybeqRu+KrWZIs2Qy17OX/PCK/I5EFDxt6til1PIQ3CSrY0rgKAekgLbUup6BgzQOCUtfNIUY2C5P7VWdfbkUmmeezeVSiWHDBAhmzUEyBhfgdTIHXtComrkv3PWWQ==',key_name='tempest-keypair-634092699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b9978ab74a743b6870f1a86469debb4',ramdisk_id='',reservation_id='r-k1ayhqoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-570587534',owner_user_name='tempest-AttachVolumeTestJSON-570587534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='243e1aae552d43b7b892618022460e1b',uuid=801f5645-aff6-41ea-bb28-34e8dcacfe20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converting VIF {"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:d3:89,bridge_name='br-int',has_traffic_filtering=True,id=1ad27823-4773-4b78-bbe0-1378855554c8,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad27823-47') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG os_vif [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:d3:89,bridge_name='br-int',has_traffic_filtering=True,id=1ad27823-4773-4b78-bbe0-1378855554c8,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad27823-47') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ad27823-47, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ad27823-47, col_values=(('external_ids', {'iface-id': '1ad27823-4773-4b78-bbe0-1378855554c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:d3:89', 'vm-uuid': '801f5645-aff6-41ea-bb28-34e8dcacfe20'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:25 user nova-compute[72201]: INFO os_vif [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:d3:89,bridge_name='br-int',has_traffic_filtering=True,id=1ad27823-4773-4b78-bbe0-1378855554c8,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad27823-47')
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] No VIF found with MAC fa:16:3e:f7:d3:89, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23733343631666234', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733343631666234', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T15:34:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-540186684',display_name='tempest-TestShelveInstance-server-540186684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-540186684',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1065743790',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:34:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2de91196332140e7abe9ae60574c68cc',ramdisk_id='',reservation_id='r-nugea08p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2040618803',owner_user_name='tempest-TestShelveInstance-2040618803-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:38:14Z,user_data=None,user_id='54744ee637ec4f6989f6bded4bd01a28',uuid=a7721f4d-4a5b-4196-9358-9126426566f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Converting VIF {"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:cd:b4,bridge_name='br-int',has_traffic_filtering=True,id=3ca61173-de45-4386-a12b-9ecdf45b29d9,network=Network(8a16a227-fcc9-46cf-a739-1697d1fd78e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca61173-de') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.objects.instance [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lazy-loading 'pci_devices' on Instance uuid a7721f4d-4a5b-4196-9358-9126426566f0 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:38:25 user nova-compute[72201]:   <uuid>a7721f4d-4a5b-4196-9358-9126426566f0</uuid>
Aug 01 15:38:25 user nova-compute[72201]:   <name>instance-00000022</name>
Aug 01 15:38:25 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:38:25 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:38:25 user nova-compute[72201]:   <metadata>
Aug 01 15:38:25 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:38:25 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:38:25 user nova-compute[72201]:       <nova:name>tempest-TestShelveInstance-server-540186684</nova:name>
Aug 01 15:38:25 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:38:24</nova:creationTime>
Aug 01 15:38:25 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:38:25 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:38:25 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:38:25 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:38:25 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:38:25 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:38:25 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:38:25 user nova-compute[72201]:       <nova:owner>
Aug 01 15:38:25 user nova-compute[72201]:         <nova:user uuid="54744ee637ec4f6989f6bded4bd01a28">tempest-TestShelveInstance-2040618803-project-member</nova:user>
Aug 01 15:38:25 user nova-compute[72201]:         <nova:project uuid="2de91196332140e7abe9ae60574c68cc">tempest-TestShelveInstance-2040618803</nova:project>
Aug 01 15:38:25 user nova-compute[72201]:       </nova:owner>
Aug 01 15:38:25 user nova-compute[72201]:       <nova:ports>
Aug 01 15:38:25 user nova-compute[72201]:         <nova:port uuid="3ca61173-de45-4386-a12b-9ecdf45b29d9">
Aug 01 15:38:25 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 15:38:25 user nova-compute[72201]:         </nova:port>
Aug 01 15:38:25 user nova-compute[72201]:       </nova:ports>
Aug 01 15:38:25 user nova-compute[72201]:     </nova:instance>
Aug 01 15:38:25 user nova-compute[72201]:   </metadata>
Aug 01 15:38:25 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:38:25 user nova-compute[72201]:     <system>
Aug 01 15:38:25 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:38:25 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:38:25 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:38:25 user nova-compute[72201]:       <entry name="serial">a7721f4d-4a5b-4196-9358-9126426566f0</entry>
Aug 01 15:38:25 user nova-compute[72201]:       <entry name="uuid">a7721f4d-4a5b-4196-9358-9126426566f0</entry>
Aug 01 15:38:25 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:38:25 user nova-compute[72201]:     </system>
Aug 01 15:38:25 user nova-compute[72201]:   </sysinfo>
Aug 01 15:38:25 user nova-compute[72201]:   <os>
Aug 01 15:38:25 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:38:25 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:38:25 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:38:25 user nova-compute[72201]:   </os>
Aug 01 15:38:25 user nova-compute[72201]:   <features>
Aug 01 15:38:25 user nova-compute[72201]:     <acpi/>
Aug 01 15:38:25 user nova-compute[72201]:     <apic/>
Aug 01 15:38:25 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:38:25 user nova-compute[72201]:   </features>
Aug 01 15:38:25 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:38:25 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:38:25 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:38:25 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:38:25 user nova-compute[72201]:   </clock>
Aug 01 15:38:25 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:38:25 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:38:25 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:38:25 user nova-compute[72201]:   </cpu>
Aug 01 15:38:25 user nova-compute[72201]:   <devices>
Aug 01 15:38:25 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:38:25 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:38:25 user nova-compute[72201]:       <source dev="/dev/sdb"/>
Aug 01 15:38:25 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:38:25 user nova-compute[72201]:       <serial>c7de637b-e39e-4bad-af19-bb86cdba4ac1</serial>
Aug 01 15:38:25 user nova-compute[72201]:     </disk>
Aug 01 15:38:25 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:38:25 user nova-compute[72201]:       <mac address="fa:16:3e:48:cd:b4"/>
Aug 01 15:38:25 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:38:25 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:38:25 user nova-compute[72201]:       <target dev="tap3ca61173-de"/>
Aug 01 15:38:25 user nova-compute[72201]:     </interface>
Aug 01 15:38:25 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:38:25 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/a7721f4d-4a5b-4196-9358-9126426566f0/console.log" append="off"/>
Aug 01 15:38:25 user nova-compute[72201]:     </serial>
Aug 01 15:38:25 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:38:25 user nova-compute[72201]:     <video>
Aug 01 15:38:25 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:38:25 user nova-compute[72201]:     </video>
Aug 01 15:38:25 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:38:25 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:38:25 user nova-compute[72201]:     </rng>
Aug 01 15:38:25 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:38:25 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:38:25 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:38:25 user nova-compute[72201]:     </memballoon>
Aug 01 15:38:25 user nova-compute[72201]:   </devices>
Aug 01 15:38:25 user nova-compute[72201]: </domain>
Aug 01 15:38:25 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T15:34:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-540186684',display_name='tempest-TestShelveInstance-server-540186684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-540186684',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1065743790',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:34:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2de91196332140e7abe9ae60574c68cc',ramdisk_id='',reservation_id='r-nugea08p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2040618803',owner_user_name='tempest-TestShelveInstance-2040618803-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:38:14Z,user_data=None,user_id='54744ee637ec4f6989f6bded4bd01a28',uuid=a7721f4d-4a5b-4196-9358-9126426566f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Converting VIF {"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:cd:b4,bridge_name='br-int',has_traffic_filtering=True,id=3ca61173-de45-4386-a12b-9ecdf45b29d9,network=Network(8a16a227-fcc9-46cf-a739-1697d1fd78e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca61173-de') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG os_vif [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:cd:b4,bridge_name='br-int',has_traffic_filtering=True,id=3ca61173-de45-4386-a12b-9ecdf45b29d9,network=Network(8a16a227-fcc9-46cf-a739-1697d1fd78e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca61173-de') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ca61173-de, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3ca61173-de, col_values=(('external_ids', {'iface-id': '3ca61173-de45-4386-a12b-9ecdf45b29d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:cd:b4', 'vm-uuid': 'a7721f4d-4a5b-4196-9358-9126426566f0'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.network.neutron [req-e21975aa-88a4-458f-82ad-3010d3c976d2 req-6db147e4-4987-472e-acd6-33aad3ba4335 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Updated VIF entry in instance network info cache for port 1ad27823-4773-4b78-bbe0-1378855554c8. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.network.neutron [req-e21975aa-88a4-458f-82ad-3010d3c976d2 req-6db147e4-4987-472e-acd6-33aad3ba4335 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Updating instance_info_cache with network_info: [{"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:25 user nova-compute[72201]: INFO os_vif [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:cd:b4,bridge_name='br-int',has_traffic_filtering=True,id=3ca61173-de45-4386-a12b-9ecdf45b29d9,network=Network(8a16a227-fcc9-46cf-a739-1697d1fd78e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca61173-de')
Aug 01 15:38:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e21975aa-88a4-458f-82ad-3010d3c976d2 req-6db147e4-4987-472e-acd6-33aad3ba4335 service nova] Releasing lock "refresh_cache-801f5645-aff6-41ea-bb28-34e8dcacfe20" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:38:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] No VIF found with MAC fa:16:3e:48:cd:b4, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:38:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:28 user nova-compute[72201]: DEBUG nova.compute.manager [req-f3cd1941-930b-475e-9fd1-3869cdf8b45d req-9e002b36-059c-4f9a-b29e-b13e360f5d71 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received event network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:38:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f3cd1941-930b-475e-9fd1-3869cdf8b45d req-9e002b36-059c-4f9a-b29e-b13e360f5d71 service nova] Acquiring lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:38:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f3cd1941-930b-475e-9fd1-3869cdf8b45d req-9e002b36-059c-4f9a-b29e-b13e360f5d71 service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:38:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f3cd1941-930b-475e-9fd1-3869cdf8b45d req-9e002b36-059c-4f9a-b29e-b13e360f5d71 service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:38:28 user nova-compute[72201]: DEBUG nova.compute.manager [req-f3cd1941-930b-475e-9fd1-3869cdf8b45d req-9e002b36-059c-4f9a-b29e-b13e360f5d71 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] No waiting events found dispatching network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:38:28 user nova-compute[72201]: WARNING nova.compute.manager [req-f3cd1941-930b-475e-9fd1-3869cdf8b45d req-9e002b36-059c-4f9a-b29e-b13e360f5d71 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received unexpected event network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 for instance with vm_state building and task_state spawning.
Aug 01 15:38:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:28 user nova-compute[72201]: DEBUG nova.compute.manager [req-86c3e914-0562-4dfd-a89d-f3da9f8fef44 req-5a222358-6121-4d3d-86df-bba6ae885011 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received event network-vif-plugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:38:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-86c3e914-0562-4dfd-a89d-f3da9f8fef44 req-5a222358-6121-4d3d-86df-bba6ae885011 service nova] Acquiring lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:38:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-86c3e914-0562-4dfd-a89d-f3da9f8fef44 req-5a222358-6121-4d3d-86df-bba6ae885011 service nova] Lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:38:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-86c3e914-0562-4dfd-a89d-f3da9f8fef44 req-5a222358-6121-4d3d-86df-bba6ae885011 service nova] Lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:38:28 user nova-compute[72201]: DEBUG nova.compute.manager [req-86c3e914-0562-4dfd-a89d-f3da9f8fef44 req-5a222358-6121-4d3d-86df-bba6ae885011 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] No waiting events found dispatching network-vif-plugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:38:28 user nova-compute[72201]: WARNING nova.compute.manager [req-86c3e914-0562-4dfd-a89d-f3da9f8fef44 req-5a222358-6121-4d3d-86df-bba6ae885011 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received unexpected event network-vif-plugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 15:38:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.compute.manager [req-9b90210a-4411-40dc-be74-ec872070aa5c req-9bfc4dba-9ea7-4448-bfeb-9e52ab7b0214 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received event network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9b90210a-4411-40dc-be74-ec872070aa5c req-9bfc4dba-9ea7-4448-bfeb-9e52ab7b0214 service nova] Acquiring lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9b90210a-4411-40dc-be74-ec872070aa5c req-9bfc4dba-9ea7-4448-bfeb-9e52ab7b0214 service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9b90210a-4411-40dc-be74-ec872070aa5c req-9bfc4dba-9ea7-4448-bfeb-9e52ab7b0214 service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.compute.manager [req-9b90210a-4411-40dc-be74-ec872070aa5c req-9bfc4dba-9ea7-4448-bfeb-9e52ab7b0214 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] No waiting events found dispatching network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:38:30 user nova-compute[72201]: WARNING nova.compute.manager [req-9b90210a-4411-40dc-be74-ec872070aa5c req-9bfc4dba-9ea7-4448-bfeb-9e52ab7b0214 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received unexpected event network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 for instance with vm_state building and task_state spawning.
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.compute.manager [req-98056d2c-9b6a-4761-82be-078c16e26b10 req-b8b9d1f3-e1c3-414f-bf91-370efd05d48b service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received event network-vif-plugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-98056d2c-9b6a-4761-82be-078c16e26b10 req-b8b9d1f3-e1c3-414f-bf91-370efd05d48b service nova] Acquiring lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-98056d2c-9b6a-4761-82be-078c16e26b10 req-b8b9d1f3-e1c3-414f-bf91-370efd05d48b service nova] Lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-98056d2c-9b6a-4761-82be-078c16e26b10 req-b8b9d1f3-e1c3-414f-bf91-370efd05d48b service nova] Lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.compute.manager [req-98056d2c-9b6a-4761-82be-078c16e26b10 req-b8b9d1f3-e1c3-414f-bf91-370efd05d48b service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] No waiting events found dispatching network-vif-plugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:38:30 user nova-compute[72201]: WARNING nova.compute.manager [req-98056d2c-9b6a-4761-82be-078c16e26b10 req-b8b9d1f3-e1c3-414f-bf91-370efd05d48b service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received unexpected event network-vif-plugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904310.6725795, 801f5645-aff6-41ea-bb28-34e8dcacfe20 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:38:30 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] VM Resumed (Lifecycle Event)
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.compute.manager [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.compute.manager [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:38:30 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Instance spawned successfully.
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:38:30 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Instance spawned successfully.
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.compute.manager [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:38:30 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904310.6738136, 801f5645-aff6-41ea-bb28-34e8dcacfe20 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:38:30 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] VM Started (Lifecycle Event)
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-960fe464-1a9b-4952-bb16-c271e6def163 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "a7721f4d-4a5b-4196-9358-9126426566f0" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.452s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:38:30 user nova-compute[72201]: INFO nova.compute.manager [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Took 7.22 seconds to spawn the instance on the hypervisor.
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.compute.manager [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:38:30 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904310.6795623, a7721f4d-4a5b-4196-9358-9126426566f0 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:38:30 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] VM Resumed (Lifecycle Event)
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904310.6838756, a7721f4d-4a5b-4196-9358-9126426566f0 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:38:30 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] VM Started (Lifecycle Event)
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:38:30 user nova-compute[72201]: INFO nova.compute.manager [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Took 7.94 seconds to build instance.
Aug 01 15:38:30 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:38:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-de77f440-9bab-472a-be37-753fe9a00258 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.117s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:38:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:38:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:38:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:09 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:39:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:12 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:39:13 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:39:13 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:39:13 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:39:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:39:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:39:13 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:39:13 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Updating instance_info_cache with network_info: [{"id": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "address": "fa:16:3e:6a:5e:e0", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6062f511-71", "ovs_interfaceid": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:39:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:39:13 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:39:14 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:39:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:39:17 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:39:18 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:39:19 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:39:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:39:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:39:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:39:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:39:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:39:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:39:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:39:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:39:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:39:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:39:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:39:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:39:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:39:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:39:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:39:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:39:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:39:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:39:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:39:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:39:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:39:20 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:39:20 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:39:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8052MB free_disk=25.41321563720703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:39:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:39:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:39:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 929ed2b3-a72e-424e-94c4-352c207442ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:39:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f0743332-223f-4507-b8b1-40d63b7b5e80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:39:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance d2fda4cb-e06e-4aad-9c8d-454eb8ed578d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:39:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance a7721f4d-4a5b-4196-9358-9126426566f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:39:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 801f5645-aff6-41ea-bb28-34e8dcacfe20 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:39:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:39:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:39:21 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:39:21 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:39:21 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:39:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:39:22 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:39:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:39:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:39:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-2c1c046c-317a-4ba1-a4a4-db5e246ce50f tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:39:29 user nova-compute[72201]: INFO nova.compute.manager [None req-2c1c046c-317a-4ba1-a4a4-db5e246ce50f tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] instance snapshotting
Aug 01 15:39:29 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-2c1c046c-317a-4ba1-a4a4-db5e246ce50f tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Beginning live snapshot process
Aug 01 15:39:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2c1c046c-317a-4ba1-a4a4-db5e246ce50f tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json -f qcow2 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:39:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2c1c046c-317a-4ba1-a4a4-db5e246ce50f tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json -f qcow2" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:39:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2c1c046c-317a-4ba1-a4a4-db5e246ce50f tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json -f qcow2 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:39:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2c1c046c-317a-4ba1-a4a4-db5e246ce50f tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:39:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2c1c046c-317a-4ba1-a4a4-db5e246ce50f tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:39:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2c1c046c-317a-4ba1-a4a4-db5e246ce50f tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.132s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:39:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2c1c046c-317a-4ba1-a4a4-db5e246ce50f tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvp2iro71/56a0f568d45b4c5aa7e9082bf360d704.delta 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:39:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2c1c046c-317a-4ba1-a4a4-db5e246ce50f tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvp2iro71/56a0f568d45b4c5aa7e9082bf360d704.delta 1073741824" returned: 0 in 0.048s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:39:30 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-2c1c046c-317a-4ba1-a4a4-db5e246ce50f tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 15:39:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-2c1c046c-317a-4ba1-a4a4-db5e246ce50f tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:39:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:31 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-2c1c046c-317a-4ba1-a4a4-db5e246ce50f tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:39:31 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-2c1c046c-317a-4ba1-a4a4-db5e246ce50f tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 15:39:31 user nova-compute[72201]: DEBUG nova.privsep.utils [None req-2c1c046c-317a-4ba1-a4a4-db5e246ce50f tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72201) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 15:39:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2c1c046c-317a-4ba1-a4a4-db5e246ce50f tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvp2iro71/56a0f568d45b4c5aa7e9082bf360d704.delta /opt/stack/data/nova/instances/snapshots/tmpvp2iro71/56a0f568d45b4c5aa7e9082bf360d704 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:39:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2c1c046c-317a-4ba1-a4a4-db5e246ce50f tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvp2iro71/56a0f568d45b4c5aa7e9082bf360d704.delta /opt/stack/data/nova/instances/snapshots/tmpvp2iro71/56a0f568d45b4c5aa7e9082bf360d704" returned: 0 in 0.599s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:39:32 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-2c1c046c-317a-4ba1-a4a4-db5e246ce50f tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Snapshot extracted, beginning image upload
Aug 01 15:39:34 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-2c1c046c-317a-4ba1-a4a4-db5e246ce50f tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Snapshot image upload complete
Aug 01 15:39:34 user nova-compute[72201]: INFO nova.compute.manager [None req-2c1c046c-317a-4ba1-a4a4-db5e246ce50f tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Took 5.02 seconds to snapshot the instance on the hypervisor.
Aug 01 15:39:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:39:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-ac1dfafe-33f5-492d-a8dd-6447a2b4e7f2 req-4ed51b55-e727-40ec-b319-f9a23d93c307 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Received event network-changed-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:39:38 user nova-compute[72201]: DEBUG nova.compute.manager [req-ac1dfafe-33f5-492d-a8dd-6447a2b4e7f2 req-4ed51b55-e727-40ec-b319-f9a23d93c307 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Refreshing instance network info cache due to event network-changed-a0dad7e0-1c01-4c8f-abc1-72650c5390d4. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:39:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ac1dfafe-33f5-492d-a8dd-6447a2b4e7f2 req-4ed51b55-e727-40ec-b319-f9a23d93c307 service nova] Acquiring lock "refresh_cache-d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:39:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ac1dfafe-33f5-492d-a8dd-6447a2b4e7f2 req-4ed51b55-e727-40ec-b319-f9a23d93c307 service nova] Acquired lock "refresh_cache-d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:39:38 user nova-compute[72201]: DEBUG nova.network.neutron [req-ac1dfafe-33f5-492d-a8dd-6447a2b4e7f2 req-4ed51b55-e727-40ec-b319-f9a23d93c307 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Refreshing network info cache for port a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:39:38 user nova-compute[72201]: DEBUG nova.network.neutron [req-ac1dfafe-33f5-492d-a8dd-6447a2b4e7f2 req-4ed51b55-e727-40ec-b319-f9a23d93c307 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Updated VIF entry in instance network info cache for port a0dad7e0-1c01-4c8f-abc1-72650c5390d4. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:39:38 user nova-compute[72201]: DEBUG nova.network.neutron [req-ac1dfafe-33f5-492d-a8dd-6447a2b4e7f2 req-4ed51b55-e727-40ec-b319-f9a23d93c307 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Updating instance_info_cache with network_info: [{"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:39:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ac1dfafe-33f5-492d-a8dd-6447a2b4e7f2 req-4ed51b55-e727-40ec-b319-f9a23d93c307 service nova] Releasing lock "refresh_cache-d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:39:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:39:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:39:43 user nova-compute[72201]: INFO nova.compute.manager [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Shelving
Aug 01 15:39:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-ede8ef31-11eb-4393-b920-6fe6ac08227a req-ff7ae38f-f478-45c0-b6a4-7aa8f9cb4753 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Received event network-vif-unplugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:39:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ede8ef31-11eb-4393-b920-6fe6ac08227a req-ff7ae38f-f478-45c0-b6a4-7aa8f9cb4753 service nova] Acquiring lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:39:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ede8ef31-11eb-4393-b920-6fe6ac08227a req-ff7ae38f-f478-45c0-b6a4-7aa8f9cb4753 service nova] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:39:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ede8ef31-11eb-4393-b920-6fe6ac08227a req-ff7ae38f-f478-45c0-b6a4-7aa8f9cb4753 service nova] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:39:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-ede8ef31-11eb-4393-b920-6fe6ac08227a req-ff7ae38f-f478-45c0-b6a4-7aa8f9cb4753 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] No waiting events found dispatching network-vif-unplugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:39:43 user nova-compute[72201]: WARNING nova.compute.manager [req-ede8ef31-11eb-4393-b920-6fe6ac08227a req-ff7ae38f-f478-45c0-b6a4-7aa8f9cb4753 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Received unexpected event network-vif-unplugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 for instance with vm_state active and task_state shelving.
Aug 01 15:39:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:44 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Instance destroyed successfully.
Aug 01 15:39:44 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Beginning cold snapshot process
Aug 01 15:39:44 user nova-compute[72201]: DEBUG nova.privsep.utils [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72201) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 15:39:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk /opt/stack/data/nova/instances/snapshots/tmptjhcknff/736fd30990974a0195ef6a50a7c8827b {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:39:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk /opt/stack/data/nova/instances/snapshots/tmptjhcknff/736fd30990974a0195ef6a50a7c8827b" returned: 0 in 0.387s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:39:44 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Snapshot extracted, beginning image upload
Aug 01 15:39:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-3e9255f0-b455-413e-b106-7c7aba96da71 req-5f095cb6-0492-4908-8d59-ccf6f3e8bc1a service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Received event network-vif-plugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:39:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3e9255f0-b455-413e-b106-7c7aba96da71 req-5f095cb6-0492-4908-8d59-ccf6f3e8bc1a service nova] Acquiring lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:39:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3e9255f0-b455-413e-b106-7c7aba96da71 req-5f095cb6-0492-4908-8d59-ccf6f3e8bc1a service nova] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:39:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3e9255f0-b455-413e-b106-7c7aba96da71 req-5f095cb6-0492-4908-8d59-ccf6f3e8bc1a service nova] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:39:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-3e9255f0-b455-413e-b106-7c7aba96da71 req-5f095cb6-0492-4908-8d59-ccf6f3e8bc1a service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] No waiting events found dispatching network-vif-plugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:39:45 user nova-compute[72201]: WARNING nova.compute.manager [req-3e9255f0-b455-413e-b106-7c7aba96da71 req-5f095cb6-0492-4908-8d59-ccf6f3e8bc1a service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Received unexpected event network-vif-plugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 for instance with vm_state active and task_state shelving_image_uploading.
Aug 01 15:39:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:47 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Snapshot image upload complete
Aug 01 15:39:47 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:39:47 user nova-compute[72201]: INFO nova.compute.manager [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Shelve offloading
Aug 01 15:39:47 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Instance destroyed successfully.
Aug 01 15:39:47 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:39:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "refresh_cache-d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:39:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquired lock "refresh_cache-d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:39:47 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:39:47 user nova-compute[72201]: DEBUG nova.network.neutron [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Updating instance_info_cache with network_info: [{"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:39:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Releasing lock "refresh_cache-d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:39:48 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Instance destroyed successfully.
Aug 01 15:39:48 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'resources' on Instance uuid d2fda4cb-e06e-4aad-9c8d-454eb8ed578d {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:39:48 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1409369655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1409369655',id=37,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1UwRi2DLxVkCy7f6TeJOq3Esxx8EN67AgUIDTYqNjKiFyedgrt4A4GVJf/i9wFUBHnDxvju/m05DMK0cWUmOSdPmtX6heks7S/3CnY/EItVPiAFtvpneGJhC02WW+9gA==',key_name='tempest-keypair-348355751',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:37:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fbe1b0601b564f789cbd45138114e95b',ramdisk_id='',reservation_id='r-fn43bruo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-858719582',owner_user_name='tempest-AttachVolumeShelveTestJSON-858719582-project-member',shelved_at='2023-08-01T15:39:47.051938',shelved_host='user',shelved_image_id='8124a1cc-0015-4e27-83b6-0f4508a5e179'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:39:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2caf51668cff454284097f6e91661c17',uuid=d2fda4cb-e06e-4aad-9c8d-454eb8ed578d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:39:48 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converting VIF {"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:39:48 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:69:03,bridge_name='br-int',has_traffic_filtering=True,id=a0dad7e0-1c01-4c8f-abc1-72650c5390d4,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0dad7e0-1c') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:39:48 user nova-compute[72201]: DEBUG os_vif [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:69:03,bridge_name='br-int',has_traffic_filtering=True,id=a0dad7e0-1c01-4c8f-abc1-72650c5390d4,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0dad7e0-1c') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:39:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0dad7e0-1c, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:39:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:48 user nova-compute[72201]: DEBUG nova.compute.manager [req-73ee66a3-fd29-4efa-91a6-62168b1ac4bd req-ab697931-f2c0-4271-b9d4-949e71596b9c service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Received event network-changed-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:39:48 user nova-compute[72201]: DEBUG nova.compute.manager [req-73ee66a3-fd29-4efa-91a6-62168b1ac4bd req-ab697931-f2c0-4271-b9d4-949e71596b9c service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Refreshing instance network info cache due to event network-changed-a0dad7e0-1c01-4c8f-abc1-72650c5390d4. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:39:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-73ee66a3-fd29-4efa-91a6-62168b1ac4bd req-ab697931-f2c0-4271-b9d4-949e71596b9c service nova] Acquiring lock "refresh_cache-d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:39:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-73ee66a3-fd29-4efa-91a6-62168b1ac4bd req-ab697931-f2c0-4271-b9d4-949e71596b9c service nova] Acquired lock "refresh_cache-d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:39:48 user nova-compute[72201]: DEBUG nova.network.neutron [req-73ee66a3-fd29-4efa-91a6-62168b1ac4bd req-ab697931-f2c0-4271-b9d4-949e71596b9c service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Refreshing network info cache for port a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:39:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:39:48 user nova-compute[72201]: INFO os_vif [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:69:03,bridge_name='br-int',has_traffic_filtering=True,id=a0dad7e0-1c01-4c8f-abc1-72650c5390d4,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0dad7e0-1c')
Aug 01 15:39:48 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Deleting instance files /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d_del
Aug 01 15:39:48 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Deletion of /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d_del complete
Aug 01 15:39:48 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Deleted allocations for instance d2fda4cb-e06e-4aad-9c8d-454eb8ed578d
Aug 01 15:39:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:39:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:39:48 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'numa_topology' on Instance uuid d2fda4cb-e06e-4aad-9c8d-454eb8ed578d {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:39:49 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:39:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:49 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:39:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:39:49 user nova-compute[72201]: DEBUG nova.network.neutron [req-73ee66a3-fd29-4efa-91a6-62168b1ac4bd req-ab697931-f2c0-4271-b9d4-949e71596b9c service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Updated VIF entry in instance network info cache for port a0dad7e0-1c01-4c8f-abc1-72650c5390d4. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:39:49 user nova-compute[72201]: DEBUG nova.network.neutron [req-73ee66a3-fd29-4efa-91a6-62168b1ac4bd req-ab697931-f2c0-4271-b9d4-949e71596b9c service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Updating instance_info_cache with network_info: [{"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:39:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a51afe6d-0720-4cdf-8393-29a0390c49e3 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.877s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:39:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-73ee66a3-fd29-4efa-91a6-62168b1ac4bd req-ab697931-f2c0-4271-b9d4-949e71596b9c service nova] Releasing lock "refresh_cache-d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:39:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:39:59 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690904384.060481, d2fda4cb-e06e-4aad-9c8d-454eb8ed578d => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:39:59 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] VM Stopped (Lifecycle Event)
Aug 01 15:39:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-475b6130-aeeb-4b12-a1ab-0aa5154c37ed None None] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:40:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-c1c6ca4e-fd36-484f-9192-78c11518a028 req-aa440ca8-b052-4485-bbbe-a27593397460 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received event network-changed-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:40:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-c1c6ca4e-fd36-484f-9192-78c11518a028 req-aa440ca8-b052-4485-bbbe-a27593397460 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Refreshing instance network info cache due to event network-changed-3ca61173-de45-4386-a12b-9ecdf45b29d9. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:40:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c1c6ca4e-fd36-484f-9192-78c11518a028 req-aa440ca8-b052-4485-bbbe-a27593397460 service nova] Acquiring lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:40:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c1c6ca4e-fd36-484f-9192-78c11518a028 req-aa440ca8-b052-4485-bbbe-a27593397460 service nova] Acquired lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:40:05 user nova-compute[72201]: DEBUG nova.network.neutron [req-c1c6ca4e-fd36-484f-9192-78c11518a028 req-aa440ca8-b052-4485-bbbe-a27593397460 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Refreshing network info cache for port 3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquiring lock "a7721f4d-4a5b-4196-9358-9126426566f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "a7721f4d-4a5b-4196-9358-9126426566f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquiring lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:40:06 user nova-compute[72201]: INFO nova.compute.manager [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Terminating instance
Aug 01 15:40:06 user nova-compute[72201]: DEBUG nova.compute.manager [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:06 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Instance destroyed successfully.
Aug 01 15:40:06 user nova-compute[72201]: DEBUG nova.objects.instance [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lazy-loading 'resources' on Instance uuid a7721f4d-4a5b-4196-9358-9126426566f0 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T15:34:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-540186684',display_name='tempest-TestShelveInstance-server-540186684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-540186684',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsS8OvfaRGk693yFtpHMMn1bjidzbjAJvJwchxy+re0xxLrLl1tBj97I2/hrLO28yDkro0x84MfikDrXYUibDS8jklejvz69Wj1Ib7AjIUqAgrXWPmcBhfFo66aXZArCw==',key_name='tempest-TestShelveInstance-1065743790',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:38:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2de91196332140e7abe9ae60574c68cc',ramdisk_id='',reservation_id='r-nugea08p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2040618803',owner_user_name='tempest-TestShelveInstance-2040618803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:38:31Z,user_data=None,user_id='54744ee637ec4f6989f6bded4bd01a28',uuid=a7721f4d-4a5b-4196-9358-9126426566f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Converting VIF {"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:cd:b4,bridge_name='br-int',has_traffic_filtering=True,id=3ca61173-de45-4386-a12b-9ecdf45b29d9,network=Network(8a16a227-fcc9-46cf-a739-1697d1fd78e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca61173-de') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG os_vif [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:cd:b4,bridge_name='br-int',has_traffic_filtering=True,id=3ca61173-de45-4386-a12b-9ecdf45b29d9,network=Network(8a16a227-fcc9-46cf-a739-1697d1fd78e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca61173-de') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ca61173-de, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:06 user nova-compute[72201]: INFO os_vif [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:cd:b4,bridge_name='br-int',has_traffic_filtering=True,id=3ca61173-de45-4386-a12b-9ecdf45b29d9,network=Network(8a16a227-fcc9-46cf-a739-1697d1fd78e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca61173-de')
Aug 01 15:40:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YwXuUipm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:40:06 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:40:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bf11d8-2adb-43a8-9884-33874f65a98d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[212819ec-47a8-4f79-ae72-fe5cf6536a1f]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)
Aug 01 15:40:06 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 (non-flash)
Aug 01 15:40:06 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5440b5990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1'): ({'sdb'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Removing single pathed devices sdb {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[82092cb9-75a6-4edd-b71e-cfa3708ae0d3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.031s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e2a2d3-1594-4c8b-9ffc-5cd4b0e7d76b]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Flushing IO for device /dev/sdb {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dde065-2c13-4494-a5c9-2258ac035bce]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:40:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37bae4b-739d-4c30-b13e-c0e14941b486]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO50d5ce0f-73461fb418c8a56d', '/dev/disk/by-id/scsi-23733343631666234', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_50d5ce0f') {{(pid=83290) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccde446-e1af-4955-818d-3c5f6c560800]: (4, None) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc103910-95ad-4b14-a158-6cb466b7d8ee]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG nova.network.neutron [req-c1c6ca4e-fd36-484f-9192-78c11518a028 req-aa440ca8-b052-4485-bbbe-a27593397460 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Updated VIF entry in instance network info cache for port 3ca61173-de45-4386-a12b-9ecdf45b29d9. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG nova.network.neutron [req-c1c6ca4e-fd36-484f-9192-78c11518a028 req-aa440ca8-b052-4485-bbbe-a27593397460 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Updating instance_info_cache with network_info: [{"id": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "address": "fa:16:3e:48:cd:b4", "network": {"id": "8a16a227-fcc9-46cf-a739-1697d1fd78e0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773037211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2de91196332140e7abe9ae60574c68cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca61173-de", "ovs_interfaceid": "3ca61173-de45-4386-a12b-9ecdf45b29d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c1c6ca4e-fd36-484f-9192-78c11518a028 req-aa440ca8-b052-4485-bbbe-a27593397460 service nova] Releasing lock "refresh_cache-a7721f4d-4a5b-4196-9358-9126426566f0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a23c79-e923-4324-b8aa-e72709ef12b9]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1, portal: 172.16.0.220,3260]
Aug 01 15:40:07 user nova-compute[72201]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1, portal: 172.16.0.220,3260] successful.
Aug 01 15:40:07 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7de637b-e39e-4bad-af19-bb86cdba4ac1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[782d4630-e88c-4aae-a141-95ed48f6af44]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] <== disconnect_volume: return (304ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:40:07 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Deleting instance files /opt/stack/data/nova/instances/a7721f4d-4a5b-4196-9358-9126426566f0_del
Aug 01 15:40:07 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Deletion of /opt/stack/data/nova/instances/a7721f4d-4a5b-4196-9358-9126426566f0_del complete
Aug 01 15:40:07 user nova-compute[72201]: INFO nova.compute.manager [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-cb7b1f33-b8d6-4f50-a5e9-c6f2772d8935 req-4042316f-38ee-4a12-9ece-eae7a38a2c58 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received event network-vif-unplugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cb7b1f33-b8d6-4f50-a5e9-c6f2772d8935 req-4042316f-38ee-4a12-9ece-eae7a38a2c58 service nova] Acquiring lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cb7b1f33-b8d6-4f50-a5e9-c6f2772d8935 req-4042316f-38ee-4a12-9ece-eae7a38a2c58 service nova] Lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cb7b1f33-b8d6-4f50-a5e9-c6f2772d8935 req-4042316f-38ee-4a12-9ece-eae7a38a2c58 service nova] Lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-cb7b1f33-b8d6-4f50-a5e9-c6f2772d8935 req-4042316f-38ee-4a12-9ece-eae7a38a2c58 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] No waiting events found dispatching network-vif-unplugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-cb7b1f33-b8d6-4f50-a5e9-c6f2772d8935 req-4042316f-38ee-4a12-9ece-eae7a38a2c58 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received event network-vif-unplugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-cb7b1f33-b8d6-4f50-a5e9-c6f2772d8935 req-4042316f-38ee-4a12-9ece-eae7a38a2c58 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received event network-vif-plugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cb7b1f33-b8d6-4f50-a5e9-c6f2772d8935 req-4042316f-38ee-4a12-9ece-eae7a38a2c58 service nova] Acquiring lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cb7b1f33-b8d6-4f50-a5e9-c6f2772d8935 req-4042316f-38ee-4a12-9ece-eae7a38a2c58 service nova] Lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cb7b1f33-b8d6-4f50-a5e9-c6f2772d8935 req-4042316f-38ee-4a12-9ece-eae7a38a2c58 service nova] Lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-cb7b1f33-b8d6-4f50-a5e9-c6f2772d8935 req-4042316f-38ee-4a12-9ece-eae7a38a2c58 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] No waiting events found dispatching network-vif-plugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:40:07 user nova-compute[72201]: WARNING nova.compute.manager [req-cb7b1f33-b8d6-4f50-a5e9-c6f2772d8935 req-4042316f-38ee-4a12-9ece-eae7a38a2c58 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received unexpected event network-vif-plugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 for instance with vm_state active and task_state deleting.
Aug 01 15:40:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-cb7b1f33-b8d6-4f50-a5e9-c6f2772d8935 req-4042316f-38ee-4a12-9ece-eae7a38a2c58 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received event network-vif-plugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cb7b1f33-b8d6-4f50-a5e9-c6f2772d8935 req-4042316f-38ee-4a12-9ece-eae7a38a2c58 service nova] Acquiring lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cb7b1f33-b8d6-4f50-a5e9-c6f2772d8935 req-4042316f-38ee-4a12-9ece-eae7a38a2c58 service nova] Lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cb7b1f33-b8d6-4f50-a5e9-c6f2772d8935 req-4042316f-38ee-4a12-9ece-eae7a38a2c58 service nova] Lock "a7721f4d-4a5b-4196-9358-9126426566f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:40:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-cb7b1f33-b8d6-4f50-a5e9-c6f2772d8935 req-4042316f-38ee-4a12-9ece-eae7a38a2c58 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] No waiting events found dispatching network-vif-plugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:40:07 user nova-compute[72201]: WARNING nova.compute.manager [req-cb7b1f33-b8d6-4f50-a5e9-c6f2772d8935 req-4042316f-38ee-4a12-9ece-eae7a38a2c58 service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received unexpected event network-vif-plugged-3ca61173-de45-4386-a12b-9ecdf45b29d9 for instance with vm_state active and task_state deleting.
Aug 01 15:40:08 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:40:08 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Took 0.90 seconds to deallocate network for instance.
Aug 01 15:40:08 user nova-compute[72201]: INFO nova.compute.manager [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Took 0.72 seconds to detach 1 volumes for instance.
Aug 01 15:40:08 user nova-compute[72201]: DEBUG nova.compute.manager [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Deleting volume: c7de637b-e39e-4bad-af19-bb86cdba4ac1 {{(pid=72201) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 15:40:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:09 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:40:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:40:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:40:09 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:40:09 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:40:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:40:09 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Deleted allocations for instance a7721f4d-4a5b-4196-9358-9126426566f0
Aug 01 15:40:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-95cb76e5-7084-43d3-ab60-22ffb3487a78 tempest-TestShelveInstance-2040618803 tempest-TestShelveInstance-2040618803-project-member] Lock "a7721f4d-4a5b-4196-9358-9126426566f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.443s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:40:10 user nova-compute[72201]: DEBUG nova.compute.manager [req-4be1714f-a1d9-4a2b-b121-1d5587ac3cf8 req-89a0bbbc-144c-44a3-8704-9dec9b5c759d service nova] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Received event network-vif-deleted-3ca61173-de45-4386-a12b-9ecdf45b29d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:40:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:14 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:40:14 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:40:14 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:40:14 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Skipping network cache update for instance because it has been migrated to another host. {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 01 15:40:14 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Didn't find any instances for network info cache update. {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 15:40:14 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:40:14 user nova-compute[72201]: DEBUG nova.compute.manager [req-f8a4328a-9228-4da2-b383-d8e51fa5cf43 req-1cb19bad-f1b6-4d4b-92df-5a936b4db3b8 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received event network-changed-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:40:14 user nova-compute[72201]: DEBUG nova.compute.manager [req-f8a4328a-9228-4da2-b383-d8e51fa5cf43 req-1cb19bad-f1b6-4d4b-92df-5a936b4db3b8 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Refreshing instance network info cache due to event network-changed-1ad27823-4773-4b78-bbe0-1378855554c8. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:40:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f8a4328a-9228-4da2-b383-d8e51fa5cf43 req-1cb19bad-f1b6-4d4b-92df-5a936b4db3b8 service nova] Acquiring lock "refresh_cache-801f5645-aff6-41ea-bb28-34e8dcacfe20" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:40:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f8a4328a-9228-4da2-b383-d8e51fa5cf43 req-1cb19bad-f1b6-4d4b-92df-5a936b4db3b8 service nova] Acquired lock "refresh_cache-801f5645-aff6-41ea-bb28-34e8dcacfe20" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:40:14 user nova-compute[72201]: DEBUG nova.network.neutron [req-f8a4328a-9228-4da2-b383-d8e51fa5cf43 req-1cb19bad-f1b6-4d4b-92df-5a936b4db3b8 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Refreshing network info cache for port 1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:40:14 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:40:14 user nova-compute[72201]: DEBUG nova.network.neutron [req-f8a4328a-9228-4da2-b383-d8e51fa5cf43 req-1cb19bad-f1b6-4d4b-92df-5a936b4db3b8 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Updated VIF entry in instance network info cache for port 1ad27823-4773-4b78-bbe0-1378855554c8. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:40:14 user nova-compute[72201]: DEBUG nova.network.neutron [req-f8a4328a-9228-4da2-b383-d8e51fa5cf43 req-1cb19bad-f1b6-4d4b-92df-5a936b4db3b8 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Updating instance_info_cache with network_info: [{"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:40:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f8a4328a-9228-4da2-b383-d8e51fa5cf43 req-1cb19bad-f1b6-4d4b-92df-5a936b4db3b8 service nova] Releasing lock "refresh_cache-801f5645-aff6-41ea-bb28-34e8dcacfe20" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:40:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:18 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG nova.objects.instance [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'flavor' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:40:19 user nova-compute[72201]: INFO nova.compute.manager [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Attaching volume a4bd1d23-73c6-42e5-9999-feac531e50b3 to /dev/vdb
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG os_brick.utils [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40e3436-6994-4a28-9189-e6220ba204b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fe13d9-1b81-454c-a309-65acd298d442]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c13347e-bbe6-40ec-bf40-a1cf531ee89d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f5dc9f-52fa-4134-b074-0be873bdf12b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:40:19 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dccdfe7-921f-4c38-9d57-892e3af03bf0]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG os_brick.utils [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Updating existing volume attachment record: ae7199a7-27ff-414f-afc1-136b790529af {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:20 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:40:20 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:40:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8389MB free_disk=25.333049774169922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:40:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:40:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:40:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 929ed2b3-a72e-424e-94c4-352c207442ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:40:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f0743332-223f-4507-b8b1-40d63b7b5e80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:40:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 801f5645-aff6-41ea-bb28-34e8dcacfe20 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:40:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:40:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:40:20 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:40:20 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:40:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:40:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:40:21 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690904406.7620628, a7721f4d-4a5b-4196-9358-9126426566f0 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:40:21 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] VM Stopped (Lifecycle Event)
Aug 01 15:40:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-82b0d181-322c-4841-9af6-9e5e6c4678d0 None None] [instance: a7721f4d-4a5b-4196-9358-9126426566f0] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:40:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:21 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:40:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:40:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkAfZxjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:40:26 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:40:26 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:40:26 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[525a4f63-1dc9-454f-b25f-40a110fee8bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:40:26 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0db28e9-70ee-410d-9132-d0076eacdc74]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3] added
Aug 01 15:40:26 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e936f5-3f1b-4a78-9d80-ab53baf62a3b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cd0da8-6058-48ec-adfa-7cebfb93403b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkAfZxjw {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkAfZxjw" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32095db-a2ff-4402-94cb-5638d1bd75c4]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JkAfZxjw'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d425886e-4023-4b83-b59a-4043ea9b786d]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d363765-8a10-4e56-93bc-1a9f53380084]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 15:40:26 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 15:40:26 user nova-compute[72201]:  {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:40:26 user nova-compute[72201]: WARNING os_brick.initiator.connectors.iscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 15:40:26 user nova-compute[72201]: 
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[69719481-2928-4e6c-ae4f-33a4456ef190]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3, portal: 172.16.0.220,3260]
Aug 01 15:40:26 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3, portal: 172.16.0.220,3260] successful.
Aug 01 15:40:26 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb782845-0149-402f-a242-26326e1fa4a4]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67f2d83-23ba-46b1-a084-2025f56ff204]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)
Aug 01 15:40:26 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)
Aug 01 15:40:26 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[49986c69-7042-4f94-aea4-6cebd21e1a67]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:40:26 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:40:27 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:40:27 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkAfZxjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:40:27 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:40:27 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26564363431316462', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:40:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564363431316462', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:40:27 user nova-compute[72201]: DEBUG nova.objects.instance [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'flavor' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:40:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:40:27 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:40:27 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 15:40:27 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:40:27 user nova-compute[72201]:   <serial>a4bd1d23-73c6-42e5-9999-feac531e50b3</serial>
Aug 01 15:40:27 user nova-compute[72201]: </disk>
Aug 01 15:40:27 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:40:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:40:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:40:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] No VIF found with MAC fa:16:3e:f7:d3:89, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:40:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-01698447-3081-4a88-83a8-fd78eda9ccbf tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.943s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:40:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4c8ca993-ee26-4d1c-bc59-f7e88adff197 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:40:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4c8ca993-ee26-4d1c-bc59-f7e88adff197 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:40:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4c8ca993-ee26-4d1c-bc59-f7e88adff197 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:40:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4c8ca993-ee26-4d1c-bc59-f7e88adff197 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72201) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 01 15:40:29 user nova-compute[72201]: DEBUG nova.objects.instance [None req-4c8ca993-ee26-4d1c-bc59-f7e88adff197 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'flavor' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:40:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-f8292870-e888-475e-b273-87cc7b64fff9 req-8df76f3a-6e2a-4b53-8477-6ae9304abcec service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received event network-vif-unplugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:40:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f8292870-e888-475e-b273-87cc7b64fff9 req-8df76f3a-6e2a-4b53-8477-6ae9304abcec service nova] Acquiring lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:40:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f8292870-e888-475e-b273-87cc7b64fff9 req-8df76f3a-6e2a-4b53-8477-6ae9304abcec service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:40:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f8292870-e888-475e-b273-87cc7b64fff9 req-8df76f3a-6e2a-4b53-8477-6ae9304abcec service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:40:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-f8292870-e888-475e-b273-87cc7b64fff9 req-8df76f3a-6e2a-4b53-8477-6ae9304abcec service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] No waiting events found dispatching network-vif-unplugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:40:29 user nova-compute[72201]: WARNING nova.compute.manager [req-f8292870-e888-475e-b273-87cc7b64fff9 req-8df76f3a-6e2a-4b53-8477-6ae9304abcec service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received unexpected event network-vif-unplugged-1ad27823-4773-4b78-bbe0-1378855554c8 for instance with vm_state active and task_state powering-off.
Aug 01 15:40:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:30 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Instance destroyed successfully.
Aug 01 15:40:30 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4c8ca993-ee26-4d1c-bc59-f7e88adff197 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:40:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4c8ca993-ee26-4d1c-bc59-f7e88adff197 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.867s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:40:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-9905713d-24f4-4e07-8747-af21fa537817 req-1973d45a-298a-4852-9d16-c8c20c9adb27 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received event network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:40:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9905713d-24f4-4e07-8747-af21fa537817 req-1973d45a-298a-4852-9d16-c8c20c9adb27 service nova] Acquiring lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:40:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9905713d-24f4-4e07-8747-af21fa537817 req-1973d45a-298a-4852-9d16-c8c20c9adb27 service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:40:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-9905713d-24f4-4e07-8747-af21fa537817 req-1973d45a-298a-4852-9d16-c8c20c9adb27 service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:40:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-9905713d-24f4-4e07-8747-af21fa537817 req-1973d45a-298a-4852-9d16-c8c20c9adb27 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] No waiting events found dispatching network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:40:31 user nova-compute[72201]: WARNING nova.compute.manager [req-9905713d-24f4-4e07-8747-af21fa537817 req-1973d45a-298a-4852-9d16-c8c20c9adb27 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received unexpected event network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 for instance with vm_state stopped and task_state None.
Aug 01 15:40:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:40:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:40:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:40:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:40:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:40:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:40:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:40:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:40:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:45 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690904430.1309109, 801f5645-aff6-41ea-bb28-34e8dcacfe20 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:40:45 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] VM Stopped (Lifecycle Event)
Aug 01 15:40:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-38cedcbd-7e6d-412a-bac7-1c410193593f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:40:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-38cedcbd-7e6d-412a-bac7-1c410193593f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:40:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:40:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:40:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:40:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:40:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:40:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:07 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:41:07 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72201) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 15:41:09 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:41:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:41:14 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:41:15 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:41:15 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:41:15 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 15:41:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-929ed2b3-a72e-424e-94c4-352c207442ec" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:41:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-929ed2b3-a72e-424e-94c4-352c207442ec" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:41:15 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:41:15 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid 929ed2b3-a72e-424e-94c4-352c207442ec {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:41:15 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Updating instance_info_cache with network_info: [{"id": "112cdddb-0763-476b-a269-aed7d05c7856", "address": "fa:16:3e:66:f3:81", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112cdddb-07", "ovs_interfaceid": "112cdddb-0763-476b-a269-aed7d05c7856", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:41:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-929ed2b3-a72e-424e-94c4-352c207442ec" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:41:15 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:41:15 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:41:16 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:41:16 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:41:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:41:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:41:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:41:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:41:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:41:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:19 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:41:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:41:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:41:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:41:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:41:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:41:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:20 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:41:20 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:41:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8488MB free_disk=25.331138610839844GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:41:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:41:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:41:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 929ed2b3-a72e-424e-94c4-352c207442ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:41:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f0743332-223f-4507-b8b1-40d63b7b5e80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:41:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 801f5645-aff6-41ea-bb28-34e8dcacfe20 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:41:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:41:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:41:20 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing inventories for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 15:41:20 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating ProviderTree inventory for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 15:41:20 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating inventory in ProviderTree for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 15:41:20 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing aggregate associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, aggregates: None {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 15:41:20 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing trait associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 15:41:21 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:41:21 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:41:21 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:41:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:41:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:41:22 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:41:22 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:41:22 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:41:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:41:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:41:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:41:26 user nova-compute[72201]: DEBUG nova.compute.manager [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:41:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:41:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:41:26 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:41:26 user nova-compute[72201]: INFO nova.compute.claims [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Claim successful on node user
Aug 01 15:41:26 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:41:26 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:41:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.283s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:41:26 user nova-compute[72201]: DEBUG nova.compute.manager [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:41:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:26 user nova-compute[72201]: DEBUG nova.compute.manager [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:41:26 user nova-compute[72201]: DEBUG nova.network.neutron [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:41:26 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:41:26 user nova-compute[72201]: DEBUG nova.compute.manager [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:41:27 user nova-compute[72201]: INFO nova.virt.block_device [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Booting with blank volume at /dev/vda
Aug 01 15:41:27 user nova-compute[72201]: DEBUG nova.policy [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75b0cb34dac64c61a235470454e0c6bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed7463cb6f84c4a8cf1ef0437eca988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:41:27 user nova-compute[72201]: DEBUG nova.network.neutron [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Successfully created port: fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:41:28 user nova-compute[72201]: DEBUG nova.network.neutron [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Successfully updated port: fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:41:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:41:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquired lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:41:28 user nova-compute[72201]: DEBUG nova.network.neutron [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:41:28 user nova-compute[72201]: DEBUG nova.network.neutron [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:41:28 user nova-compute[72201]: DEBUG nova.compute.manager [req-fe197b49-c3d9-4bc4-9593-9404d5b6237c req-f4926109-3acc-4270-8a2e-31304b3edf06 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received event network-changed-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:41:28 user nova-compute[72201]: DEBUG nova.compute.manager [req-fe197b49-c3d9-4bc4-9593-9404d5b6237c req-f4926109-3acc-4270-8a2e-31304b3edf06 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Refreshing instance network info cache due to event network-changed-fa130bf4-53dc-43f7-8932-0aec318054d9. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:41:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-fe197b49-c3d9-4bc4-9593-9404d5b6237c req-f4926109-3acc-4270-8a2e-31304b3edf06 service nova] Acquiring lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:41:28 user nova-compute[72201]: DEBUG nova.network.neutron [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Updating instance_info_cache with network_info: [{"id": "fa130bf4-53dc-43f7-8932-0aec318054d9", "address": "fa:16:3e:92:e7:b2", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa130bf4-53", "ovs_interfaceid": "fa130bf4-53dc-43f7-8932-0aec318054d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:41:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Releasing lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:41:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Instance network_info: |[{"id": "fa130bf4-53dc-43f7-8932-0aec318054d9", "address": "fa:16:3e:92:e7:b2", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa130bf4-53", "ovs_interfaceid": "fa130bf4-53dc-43f7-8932-0aec318054d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:41:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-fe197b49-c3d9-4bc4-9593-9404d5b6237c req-f4926109-3acc-4270-8a2e-31304b3edf06 service nova] Acquired lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:41:28 user nova-compute[72201]: DEBUG nova.network.neutron [req-fe197b49-c3d9-4bc4-9593-9404d5b6237c req-f4926109-3acc-4270-8a2e-31304b3edf06 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Refreshing network info cache for port fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:41:29 user nova-compute[72201]: DEBUG nova.network.neutron [req-fe197b49-c3d9-4bc4-9593-9404d5b6237c req-f4926109-3acc-4270-8a2e-31304b3edf06 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Updated VIF entry in instance network info cache for port fa130bf4-53dc-43f7-8932-0aec318054d9. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:41:29 user nova-compute[72201]: DEBUG nova.network.neutron [req-fe197b49-c3d9-4bc4-9593-9404d5b6237c req-f4926109-3acc-4270-8a2e-31304b3edf06 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Updating instance_info_cache with network_info: [{"id": "fa130bf4-53dc-43f7-8932-0aec318054d9", "address": "fa:16:3e:92:e7:b2", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa130bf4-53", "ovs_interfaceid": "fa130bf4-53dc-43f7-8932-0aec318054d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:41:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-fe197b49-c3d9-4bc4-9593-9404d5b6237c req-f4926109-3acc-4270-8a2e-31304b3edf06 service nova] Releasing lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:41:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:32 user nova-compute[72201]: DEBUG os_brick.utils [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:41:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b398f9-81ee-4036-b878-b831d85826e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa586d73-7fe0-4b5f-b654-161be7e39982]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62e970c-8f67-42a5-b7d4-aac15170c5a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fef7f5-436b-4fae-a4a2-6451ea4fd8ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:41:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:41:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:41:32 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:41:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd7f567-5ac4-4c4f-bff1-5230202604e5]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:41:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:41:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:41:32 user nova-compute[72201]: DEBUG os_brick.utils [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:41:32 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Updating existing volume attachment record: 8ecec86f-281e-4715-b991-72ad3c1a589e {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:41:33 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:41:33 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 15:41:33 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] There are 0 instances to clean {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:41:35 user nova-compute[72201]: INFO nova.compute.manager [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Unshelving
Aug 01 15:41:35 user nova-compute[72201]: INFO nova.virt.block_device [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Booting with volume 23d0b2b9-f9ab-4038-affe-b876256fc682 at /dev/vdc
Aug 01 15:41:35 user nova-compute[72201]: DEBUG os_brick.utils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6bf24c-604a-49e6-8264-01dd91d1db04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[07544213-6308-46a1-8628-e083181199b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dce7ce-dc36-4dfa-9751-16af77494204]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[172a7ee6-2c7e-435c-9a2f-16892ab8a448]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:41:35 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:41:35 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7263a544-7e53-463d-abf6-db4332848689]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG os_brick.utils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:41:35 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Updating existing volume attachment record: 5e108713-ec2d-4723-96ae-3f2b7076632c {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:41:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:41:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:41:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:41:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:41:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.compute.manager [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:41:40 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Creating image(s)
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Did not create local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Ensure instance console log exists: /opt/stack/data/nova/instances/7e0642bf-a60d-4882-b7fb-38bbcdf69ee5/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Start _get_guest_xml network_info=[{"id": "fa130bf4-53dc-43f7-8932-0aec318054d9", "address": "fa:16:3e:92:e7:b2", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa130bf4-53", "ovs_interfaceid": "fa130bf4-53dc-43f7-8932-0aec318054d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vqZNjAls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7e0642bf-a60d-4882-b7fb-38bbcdf69ee5', 'attached_at': '', 'detached_at': '', 'volume_id': '73a13640-d808-40a7-8670-a2a67ea37f92', 'serial': '73a13640-d808-40a7-8670-a2a67ea37f92'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '8ecec86f-281e-4715-b991-72ad3c1a589e', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:41:40 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:41:40 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vqZNjAls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:41:40 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:41:40 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:41:40 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[572306b9-50f2-4403-9139-a0a387db363f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:41:40 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[89da482e-b5e0-49f9-885d-11ff8fcbe558]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92] added
Aug 01 15:41:40 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cc1d93-bee1-4795-853c-bd3df9c529cd]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3092ff-dc7a-403b-a7d1-47d4e879b8b8]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vqZNjAls {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vqZNjAls" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e53747-f719-4bcf-bcb0-20fe2aa2dbcc]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vqZNjAls'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5978b73e-c315-4ece-af31-77b41801f7a1]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc57f510-c6d0-439f-a322-e43638eabfd0]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)
Aug 01 15:41:40 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)
Aug 01 15:41:40 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[358c81d7-7ea1-4fcb-8cc5-c3abfae5ad0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92, portal: 172.16.0.220,3260]
Aug 01 15:41:40 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92, portal: 172.16.0.220,3260] successful.
Aug 01 15:41:40 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ebf88f-fe70-4414-906c-84e956bc5fca]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e336818-0b2f-46b3-8ac6-e1d6dfe683cd]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)
Aug 01 15:41:40 user nova-compute[72201]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:41:40 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)
Aug 01 15:41:40 user nova-compute[72201]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:41:40 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21de29e-39c3-4e25-bf7a-f29e7edaa7d0]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:40 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vqZNjAls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26162343637366338', 'path': '/dev/sdc'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162343637366338', 'path': '/dev/sdc'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1571805310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1571805310',id=39,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ed7463cb6f84c4a8cf1ef0437eca988',ramdisk_id='',reservation_id='r-pl830pzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:41:27Z,user_data=None,user_id='75b0cb34dac64c61a235470454e0c6bf',uuid=7e0642bf-a60d-4882-b7fb-38bbcdf69ee5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa130bf4-53dc-43f7-8932-0aec318054d9", "address": "fa:16:3e:92:e7:b2", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa130bf4-53", "ovs_interfaceid": "fa130bf4-53dc-43f7-8932-0aec318054d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converting VIF {"id": "fa130bf4-53dc-43f7-8932-0aec318054d9", "address": "fa:16:3e:92:e7:b2", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa130bf4-53", "ovs_interfaceid": "fa130bf4-53dc-43f7-8932-0aec318054d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:e7:b2,bridge_name='br-int',has_traffic_filtering=True,id=fa130bf4-53dc-43f7-8932-0aec318054d9,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa130bf4-53') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG nova.objects.instance [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:41:41 user nova-compute[72201]:   <uuid>7e0642bf-a60d-4882-b7fb-38bbcdf69ee5</uuid>
Aug 01 15:41:41 user nova-compute[72201]:   <name>instance-00000027</name>
Aug 01 15:41:41 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:41:41 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:41:41 user nova-compute[72201]:   <metadata>
Aug 01 15:41:41 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:41:41 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:41:41 user nova-compute[72201]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1571805310</nova:name>
Aug 01 15:41:41 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:41:40</nova:creationTime>
Aug 01 15:41:41 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:41:41 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:41:41 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:41:41 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:41:41 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:41:41 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:41:41 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:41:41 user nova-compute[72201]:       <nova:owner>
Aug 01 15:41:41 user nova-compute[72201]:         <nova:user uuid="75b0cb34dac64c61a235470454e0c6bf">tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member</nova:user>
Aug 01 15:41:41 user nova-compute[72201]:         <nova:project uuid="2ed7463cb6f84c4a8cf1ef0437eca988">tempest-ServerBootFromVolumeStableRescueTest-1836467291</nova:project>
Aug 01 15:41:41 user nova-compute[72201]:       </nova:owner>
Aug 01 15:41:41 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:41:41 user nova-compute[72201]:       <nova:ports>
Aug 01 15:41:41 user nova-compute[72201]:         <nova:port uuid="fa130bf4-53dc-43f7-8932-0aec318054d9">
Aug 01 15:41:41 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 15:41:41 user nova-compute[72201]:         </nova:port>
Aug 01 15:41:41 user nova-compute[72201]:       </nova:ports>
Aug 01 15:41:41 user nova-compute[72201]:     </nova:instance>
Aug 01 15:41:41 user nova-compute[72201]:   </metadata>
Aug 01 15:41:41 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:41:41 user nova-compute[72201]:     <system>
Aug 01 15:41:41 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:41:41 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:41:41 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:41:41 user nova-compute[72201]:       <entry name="serial">7e0642bf-a60d-4882-b7fb-38bbcdf69ee5</entry>
Aug 01 15:41:41 user nova-compute[72201]:       <entry name="uuid">7e0642bf-a60d-4882-b7fb-38bbcdf69ee5</entry>
Aug 01 15:41:41 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:41:41 user nova-compute[72201]:     </system>
Aug 01 15:41:41 user nova-compute[72201]:   </sysinfo>
Aug 01 15:41:41 user nova-compute[72201]:   <os>
Aug 01 15:41:41 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:41:41 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:41:41 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:41:41 user nova-compute[72201]:   </os>
Aug 01 15:41:41 user nova-compute[72201]:   <features>
Aug 01 15:41:41 user nova-compute[72201]:     <acpi/>
Aug 01 15:41:41 user nova-compute[72201]:     <apic/>
Aug 01 15:41:41 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:41:41 user nova-compute[72201]:   </features>
Aug 01 15:41:41 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:41:41 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:41:41 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:41:41 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:41:41 user nova-compute[72201]:   </clock>
Aug 01 15:41:41 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:41:41 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:41:41 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:41:41 user nova-compute[72201]:   </cpu>
Aug 01 15:41:41 user nova-compute[72201]:   <devices>
Aug 01 15:41:41 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:41:41 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:41:41 user nova-compute[72201]:       <source dev="/dev/sdc"/>
Aug 01 15:41:41 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:41:41 user nova-compute[72201]:       <serial>73a13640-d808-40a7-8670-a2a67ea37f92</serial>
Aug 01 15:41:41 user nova-compute[72201]:     </disk>
Aug 01 15:41:41 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:41:41 user nova-compute[72201]:       <mac address="fa:16:3e:92:e7:b2"/>
Aug 01 15:41:41 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:41:41 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:41:41 user nova-compute[72201]:       <target dev="tapfa130bf4-53"/>
Aug 01 15:41:41 user nova-compute[72201]:     </interface>
Aug 01 15:41:41 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:41:41 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/7e0642bf-a60d-4882-b7fb-38bbcdf69ee5/console.log" append="off"/>
Aug 01 15:41:41 user nova-compute[72201]:     </serial>
Aug 01 15:41:41 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:41:41 user nova-compute[72201]:     <video>
Aug 01 15:41:41 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:41:41 user nova-compute[72201]:     </video>
Aug 01 15:41:41 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:41:41 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:41:41 user nova-compute[72201]:     </rng>
Aug 01 15:41:41 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:41:41 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:41:41 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:41:41 user nova-compute[72201]:     </memballoon>
Aug 01 15:41:41 user nova-compute[72201]:   </devices>
Aug 01 15:41:41 user nova-compute[72201]: </domain>
Aug 01 15:41:41 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1571805310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1571805310',id=39,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ed7463cb6f84c4a8cf1ef0437eca988',ramdisk_id='',reservation_id='r-pl830pzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:41:27Z,user_data=None,user_id='75b0cb34dac64c61a235470454e0c6bf',uuid=7e0642bf-a60d-4882-b7fb-38bbcdf69ee5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa130bf4-53dc-43f7-8932-0aec318054d9", "address": "fa:16:3e:92:e7:b2", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa130bf4-53", "ovs_interfaceid": "fa130bf4-53dc-43f7-8932-0aec318054d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converting VIF {"id": "fa130bf4-53dc-43f7-8932-0aec318054d9", "address": "fa:16:3e:92:e7:b2", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa130bf4-53", "ovs_interfaceid": "fa130bf4-53dc-43f7-8932-0aec318054d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:e7:b2,bridge_name='br-int',has_traffic_filtering=True,id=fa130bf4-53dc-43f7-8932-0aec318054d9,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa130bf4-53') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG os_vif [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e7:b2,bridge_name='br-int',has_traffic_filtering=True,id=fa130bf4-53dc-43f7-8932-0aec318054d9,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa130bf4-53') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa130bf4-53, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa130bf4-53, col_values=(('external_ids', {'iface-id': 'fa130bf4-53dc-43f7-8932-0aec318054d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:e7:b2', 'vm-uuid': '7e0642bf-a60d-4882-b7fb-38bbcdf69ee5'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:41 user nova-compute[72201]: INFO os_vif [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e7:b2,bridge_name='br-int',has_traffic_filtering=True,id=fa130bf4-53dc-43f7-8932-0aec318054d9,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa130bf4-53')
Aug 01 15:41:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:41:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] No VIF found with MAC fa:16:3e:92:e7:b2, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:41:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:41:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:41:42 user nova-compute[72201]: DEBUG nova.objects.instance [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'pci_requests' on Instance uuid d2fda4cb-e06e-4aad-9c8d-454eb8ed578d {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:41:42 user nova-compute[72201]: DEBUG nova.objects.instance [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'numa_topology' on Instance uuid d2fda4cb-e06e-4aad-9c8d-454eb8ed578d {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:41:42 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:41:42 user nova-compute[72201]: INFO nova.compute.claims [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Claim successful on node user
Aug 01 15:41:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:43 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:41:43 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:41:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:41:43 user nova-compute[72201]: INFO nova.network.neutron [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Updating port a0dad7e0-1c01-4c8f-abc1-72650c5390d4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 15:41:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-d25de6d4-7117-4aab-95d7-f51198d72a13 req-554c406a-b3ca-4246-97a2-bed07eb2c483 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received event network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:41:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d25de6d4-7117-4aab-95d7-f51198d72a13 req-554c406a-b3ca-4246-97a2-bed07eb2c483 service nova] Acquiring lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:41:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d25de6d4-7117-4aab-95d7-f51198d72a13 req-554c406a-b3ca-4246-97a2-bed07eb2c483 service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:41:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d25de6d4-7117-4aab-95d7-f51198d72a13 req-554c406a-b3ca-4246-97a2-bed07eb2c483 service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:41:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-d25de6d4-7117-4aab-95d7-f51198d72a13 req-554c406a-b3ca-4246-97a2-bed07eb2c483 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] No waiting events found dispatching network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:41:43 user nova-compute[72201]: WARNING nova.compute.manager [req-d25de6d4-7117-4aab-95d7-f51198d72a13 req-554c406a-b3ca-4246-97a2-bed07eb2c483 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received unexpected event network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 for instance with vm_state building and task_state spawning.
Aug 01 15:41:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "refresh_cache-d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:41:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquired lock "refresh_cache-d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:41:44 user nova-compute[72201]: DEBUG nova.network.neutron [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:41:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-7c322695-2250-4431-82aa-d598ab483513 req-abc789de-5dc2-48a5-82b3-66c453aa43a9 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Received event network-changed-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:41:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-7c322695-2250-4431-82aa-d598ab483513 req-abc789de-5dc2-48a5-82b3-66c453aa43a9 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Refreshing instance network info cache due to event network-changed-a0dad7e0-1c01-4c8f-abc1-72650c5390d4. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:41:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7c322695-2250-4431-82aa-d598ab483513 req-abc789de-5dc2-48a5-82b3-66c453aa43a9 service nova] Acquiring lock "refresh_cache-d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:41:45 user nova-compute[72201]: DEBUG nova.network.neutron [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Updating instance_info_cache with network_info: [{"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:41:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Releasing lock "refresh_cache-d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:41:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:41:45 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Creating image(s)
Aug 01 15:41:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:41:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "/opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:41:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "/opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:41:45 user nova-compute[72201]: DEBUG nova.objects.instance [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'trusted_certs' on Instance uuid d2fda4cb-e06e-4aad-9c8d-454eb8ed578d {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:41:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7c322695-2250-4431-82aa-d598ab483513 req-abc789de-5dc2-48a5-82b3-66c453aa43a9 service nova] Acquired lock "refresh_cache-d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:41:45 user nova-compute[72201]: DEBUG nova.network.neutron [req-7c322695-2250-4431-82aa-d598ab483513 req-abc789de-5dc2-48a5-82b3-66c453aa43a9 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Refreshing network info cache for port a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:41:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "7055a2c58ffadeca14624ba5cf3b89224d970429" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:41:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "7055a2c58ffadeca14624ba5cf3b89224d970429" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7055a2c58ffadeca14624ba5cf3b89224d970429.part --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904505.5199122, 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:41:46 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] VM Resumed (Lifecycle Event)
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.compute.manager [req-ac933769-b0c8-473c-a15f-72b29550f886 req-970ef9fe-8a81-4032-b689-2122cda5a413 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received event network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ac933769-b0c8-473c-a15f-72b29550f886 req-970ef9fe-8a81-4032-b689-2122cda5a413 service nova] Acquiring lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ac933769-b0c8-473c-a15f-72b29550f886 req-970ef9fe-8a81-4032-b689-2122cda5a413 service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ac933769-b0c8-473c-a15f-72b29550f886 req-970ef9fe-8a81-4032-b689-2122cda5a413 service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.compute.manager [req-ac933769-b0c8-473c-a15f-72b29550f886 req-970ef9fe-8a81-4032-b689-2122cda5a413 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] No waiting events found dispatching network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:41:46 user nova-compute[72201]: WARNING nova.compute.manager [req-ac933769-b0c8-473c-a15f-72b29550f886 req-970ef9fe-8a81-4032-b689-2122cda5a413 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received unexpected event network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 for instance with vm_state building and task_state spawning.
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:41:46 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Instance spawned successfully.
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:41:46 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904505.52128, 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:41:46 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] VM Started (Lifecycle Event)
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7055a2c58ffadeca14624ba5cf3b89224d970429.part --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.virt.images [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] 8124a1cc-0015-4e27-83b6-0f4508a5e179 was qcow2, converting to raw {{(pid=72201) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.privsep.utils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72201) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7055a2c58ffadeca14624ba5cf3b89224d970429.part /opt/stack/data/nova/instances/_base/7055a2c58ffadeca14624ba5cf3b89224d970429.converted {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:46 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:41:46 user nova-compute[72201]: INFO nova.compute.manager [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Took 5.92 seconds to spawn the instance on the hypervisor.
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:41:46 user nova-compute[72201]: INFO nova.compute.manager [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Took 19.93 seconds to build instance.
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.network.neutron [req-7c322695-2250-4431-82aa-d598ab483513 req-abc789de-5dc2-48a5-82b3-66c453aa43a9 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Updated VIF entry in instance network info cache for port a0dad7e0-1c01-4c8f-abc1-72650c5390d4. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG nova.network.neutron [req-7c322695-2250-4431-82aa-d598ab483513 req-abc789de-5dc2-48a5-82b3-66c453aa43a9 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Updating instance_info_cache with network_info: [{"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-27a117f9-592a-4757-9278-619e17e099bf tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.096s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7c322695-2250-4431-82aa-d598ab483513 req-abc789de-5dc2-48a5-82b3-66c453aa43a9 service nova] Releasing lock "refresh_cache-d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7055a2c58ffadeca14624ba5cf3b89224d970429.part /opt/stack/data/nova/instances/_base/7055a2c58ffadeca14624ba5cf3b89224d970429.converted" returned: 0 in 0.343s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7055a2c58ffadeca14624ba5cf3b89224d970429.converted --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7055a2c58ffadeca14624ba5cf3b89224d970429.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "7055a2c58ffadeca14624ba5cf3b89224d970429" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.494s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7055a2c58ffadeca14624ba5cf3b89224d970429 --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7055a2c58ffadeca14624ba5cf3b89224d970429 --force-share --output=json" returned: 0 in 0.144s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "7055a2c58ffadeca14624ba5cf3b89224d970429" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "7055a2c58ffadeca14624ba5cf3b89224d970429" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:41:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7055a2c58ffadeca14624ba5cf3b89224d970429 --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7055a2c58ffadeca14624ba5cf3b89224d970429 --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7055a2c58ffadeca14624ba5cf3b89224d970429,backing_fmt=raw /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7055a2c58ffadeca14624ba5cf3b89224d970429,backing_fmt=raw /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk 1073741824" returned: 0 in 0.053s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "7055a2c58ffadeca14624ba5cf3b89224d970429" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:41:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7055a2c58ffadeca14624ba5cf3b89224d970429 --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7055a2c58ffadeca14624ba5cf3b89224d970429 --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:47 user nova-compute[72201]: DEBUG nova.objects.instance [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'migration_context' on Instance uuid d2fda4cb-e06e-4aad-9c8d-454eb8ed578d {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:41:47 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Rebasing disk image.
Aug 01 15:41:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba -F raw /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba -F raw /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk" returned: 0 in 1.958s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Ensure instance console log exists: /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Start _get_guest_xml network_info=[{"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='271209187980816a8f833f68b133f109',container_format='bare',created_at=2023-08-01T15:39:43Z,direct_url=<?>,disk_format='qcow2',id=8124a1cc-0015-4e27-83b6-0f4508a5e179,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1409369655-shelved',owner='fbe1b0601b564f789cbd45138114e95b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T15:39:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ArsNcDfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'd2fda4cb-e06e-4aad-9c8d-454eb8ed578d', 'attached_at': '', 'detached_at': '', 'volume_id': '23d0b2b9-f9ab-4038-affe-b876256fc682', 'serial': '23d0b2b9-f9ab-4038-affe-b876256fc682'}, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '5e108713-ec2d-4723-96ae-3f2b7076632c', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:41:49 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:41:49 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:41:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='271209187980816a8f833f68b133f109',container_format='bare',created_at=2023-08-01T15:39:43Z,direct_url=<?>,disk_format='qcow2',id=8124a1cc-0015-4e27-83b6-0f4508a5e179,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1409369655-shelved',owner='fbe1b0601b564f789cbd45138114e95b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T15:39:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG nova.objects.instance [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'vcpu_model' on Instance uuid d2fda4cb-e06e-4aad-9c8d-454eb8ed578d {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ArsNcDfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:41:49 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:41:49 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:41:49 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59e73e1-0c65-46d8-93a8-3f5cd85837ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:41:49 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de54c1b-eeee-4ec3-bfe1-088cb520ddfc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682] added
Aug 01 15:41:49 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccbf1ab-10bb-4828-beee-83cd5d503d37]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8353a6b5-12e2-4cd8-bc7b-acc83c56b795]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ArsNcDfg {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ArsNcDfg" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[30850a0f-fc58-4659-b79d-084f01135c83]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ArsNcDfg'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9f3e7b-e795-485f-a0bb-5327409c0462]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6851f9-76a4-4cb5-8b71-25d43ab70bf2]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)
Aug 01 15:41:49 user nova-compute[72201]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:41:49 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)
Aug 01 15:41:49 user nova-compute[72201]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:41:49 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4695f1-c750-49b2-8052-ec00f9823135]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682, portal: 172.16.0.220,3260]
Aug 01 15:41:49 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682, portal: 172.16.0.220,3260] successful.
Aug 01 15:41:49 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[139b7181-2e50-4f3e-8b3e-8609e98b00ab]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6923fb78-aa9b-4353-a5d7-cdc3f4076d64]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)
Aug 01 15:41:49 user nova-compute[72201]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:41:49 user nova-compute[72201]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 (non-flash)
Aug 01 15:41:49 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)
Aug 01 15:41:49 user nova-compute[72201]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:41:49 user nova-compute[72201]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 (non-flash)
Aug 01 15:41:49 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d552ab3-2aa2-49ad-8e24-192b7ed7a23b]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:41:49 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: None {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ArsNcDfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26130623137333761', 'path': '/dev/sdd'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130623137333761', 'path': '/dev/sdd'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T15:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1409369655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1409369655',id=37,image_ref='8124a1cc-0015-4e27-83b6-0f4508a5e179',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-348355751',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:37:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fbe1b0601b564f789cbd45138114e95b',ramdisk_id='',reservation_id='r-fn43bruo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-858719582',owner_user_name='tempest-AttachVolumeShelveTestJSON-858719582-project-member',shelved_at='2023-08-01T15:39:47.051938',shelved_host='user',shelved_image_id='8124a1cc-0015-4e27-83b6-0f4508a5e179'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:41:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2caf51668cff454284097f6e91661c17',uuid=d2fda4cb-e06e-4aad-9c8d-454eb8ed578d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converting VIF {"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:69:03,bridge_name='br-int',has_traffic_filtering=True,id=a0dad7e0-1c01-4c8f-abc1-72650c5390d4,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0dad7e0-1c') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG nova.objects.instance [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'pci_devices' on Instance uuid d2fda4cb-e06e-4aad-9c8d-454eb8ed578d {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:41:50 user nova-compute[72201]:   <uuid>d2fda4cb-e06e-4aad-9c8d-454eb8ed578d</uuid>
Aug 01 15:41:50 user nova-compute[72201]:   <name>instance-00000025</name>
Aug 01 15:41:50 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:41:50 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:41:50 user nova-compute[72201]:   <metadata>
Aug 01 15:41:50 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:41:50 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:41:50 user nova-compute[72201]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1409369655</nova:name>
Aug 01 15:41:50 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:41:49</nova:creationTime>
Aug 01 15:41:50 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:41:50 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:41:50 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:41:50 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:41:50 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:41:50 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:41:50 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:41:50 user nova-compute[72201]:       <nova:owner>
Aug 01 15:41:50 user nova-compute[72201]:         <nova:user uuid="2caf51668cff454284097f6e91661c17">tempest-AttachVolumeShelveTestJSON-858719582-project-member</nova:user>
Aug 01 15:41:50 user nova-compute[72201]:         <nova:project uuid="fbe1b0601b564f789cbd45138114e95b">tempest-AttachVolumeShelveTestJSON-858719582</nova:project>
Aug 01 15:41:50 user nova-compute[72201]:       </nova:owner>
Aug 01 15:41:50 user nova-compute[72201]:       <nova:root type="image" uuid="8124a1cc-0015-4e27-83b6-0f4508a5e179"/>
Aug 01 15:41:50 user nova-compute[72201]:       <nova:ports>
Aug 01 15:41:50 user nova-compute[72201]:         <nova:port uuid="a0dad7e0-1c01-4c8f-abc1-72650c5390d4">
Aug 01 15:41:50 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 15:41:50 user nova-compute[72201]:         </nova:port>
Aug 01 15:41:50 user nova-compute[72201]:       </nova:ports>
Aug 01 15:41:50 user nova-compute[72201]:     </nova:instance>
Aug 01 15:41:50 user nova-compute[72201]:   </metadata>
Aug 01 15:41:50 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:41:50 user nova-compute[72201]:     <system>
Aug 01 15:41:50 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:41:50 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:41:50 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:41:50 user nova-compute[72201]:       <entry name="serial">d2fda4cb-e06e-4aad-9c8d-454eb8ed578d</entry>
Aug 01 15:41:50 user nova-compute[72201]:       <entry name="uuid">d2fda4cb-e06e-4aad-9c8d-454eb8ed578d</entry>
Aug 01 15:41:50 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:41:50 user nova-compute[72201]:     </system>
Aug 01 15:41:50 user nova-compute[72201]:   </sysinfo>
Aug 01 15:41:50 user nova-compute[72201]:   <os>
Aug 01 15:41:50 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:41:50 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:41:50 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:41:50 user nova-compute[72201]:   </os>
Aug 01 15:41:50 user nova-compute[72201]:   <features>
Aug 01 15:41:50 user nova-compute[72201]:     <acpi/>
Aug 01 15:41:50 user nova-compute[72201]:     <apic/>
Aug 01 15:41:50 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:41:50 user nova-compute[72201]:   </features>
Aug 01 15:41:50 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:41:50 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:41:50 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:41:50 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:41:50 user nova-compute[72201]:   </clock>
Aug 01 15:41:50 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:41:50 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:41:50 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:41:50 user nova-compute[72201]:   </cpu>
Aug 01 15:41:50 user nova-compute[72201]:   <devices>
Aug 01 15:41:50 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:41:50 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:41:50 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk"/>
Aug 01 15:41:50 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:41:50 user nova-compute[72201]:     </disk>
Aug 01 15:41:50 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:41:50 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:41:50 user nova-compute[72201]:       <source dev="/dev/sdd"/>
Aug 01 15:41:50 user nova-compute[72201]:       <target dev="vdc" bus="virtio"/>
Aug 01 15:41:50 user nova-compute[72201]:       <serial>23d0b2b9-f9ab-4038-affe-b876256fc682</serial>
Aug 01 15:41:50 user nova-compute[72201]:     </disk>
Aug 01 15:41:50 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:41:50 user nova-compute[72201]:       <mac address="fa:16:3e:c6:69:03"/>
Aug 01 15:41:50 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:41:50 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:41:50 user nova-compute[72201]:       <target dev="tapa0dad7e0-1c"/>
Aug 01 15:41:50 user nova-compute[72201]:     </interface>
Aug 01 15:41:50 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:41:50 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/console.log" append="off"/>
Aug 01 15:41:50 user nova-compute[72201]:     </serial>
Aug 01 15:41:50 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:41:50 user nova-compute[72201]:     <video>
Aug 01 15:41:50 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:41:50 user nova-compute[72201]:     </video>
Aug 01 15:41:50 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:41:50 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:41:50 user nova-compute[72201]:     </rng>
Aug 01 15:41:50 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:41:50 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:41:50 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:41:50 user nova-compute[72201]:     </memballoon>
Aug 01 15:41:50 user nova-compute[72201]:   </devices>
Aug 01 15:41:50 user nova-compute[72201]: </domain>
Aug 01 15:41:50 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T15:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1409369655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1409369655',id=37,image_ref='8124a1cc-0015-4e27-83b6-0f4508a5e179',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-348355751',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:37:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fbe1b0601b564f789cbd45138114e95b',ramdisk_id='',reservation_id='r-fn43bruo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-858719582',owner_user_name='tempest-AttachVolumeShelveTestJSON-858719582-project-member',shelved_at='2023-08-01T15:39:47.051938',shelved_host='user',shelved_image_id='8124a1cc-0015-4e27-83b6-0f4508a5e179'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:41:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2caf51668cff454284097f6e91661c17',uuid=d2fda4cb-e06e-4aad-9c8d-454eb8ed578d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converting VIF {"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:69:03,bridge_name='br-int',has_traffic_filtering=True,id=a0dad7e0-1c01-4c8f-abc1-72650c5390d4,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0dad7e0-1c') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG os_vif [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:69:03,bridge_name='br-int',has_traffic_filtering=True,id=a0dad7e0-1c01-4c8f-abc1-72650c5390d4,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0dad7e0-1c') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0dad7e0-1c, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa0dad7e0-1c, col_values=(('external_ids', {'iface-id': 'a0dad7e0-1c01-4c8f-abc1-72650c5390d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:69:03', 'vm-uuid': 'd2fda4cb-e06e-4aad-9c8d-454eb8ed578d'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:50 user nova-compute[72201]: INFO os_vif [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:69:03,bridge_name='br-int',has_traffic_filtering=True,id=a0dad7e0-1c01-4c8f-abc1-72650c5390d4,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0dad7e0-1c')
Aug 01 15:41:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:41:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] No VIF found with MAC fa:16:3e:c6:69:03, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:41:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:52 user nova-compute[72201]: DEBUG nova.compute.manager [req-08c6cb46-d256-45d4-abf1-d7cc1b9ee9e8 req-1e79d958-240b-454b-95a5-0fc8acb626bc service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Received event network-vif-plugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:41:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-08c6cb46-d256-45d4-abf1-d7cc1b9ee9e8 req-1e79d958-240b-454b-95a5-0fc8acb626bc service nova] Acquiring lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:41:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-08c6cb46-d256-45d4-abf1-d7cc1b9ee9e8 req-1e79d958-240b-454b-95a5-0fc8acb626bc service nova] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:41:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-08c6cb46-d256-45d4-abf1-d7cc1b9ee9e8 req-1e79d958-240b-454b-95a5-0fc8acb626bc service nova] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:41:52 user nova-compute[72201]: DEBUG nova.compute.manager [req-08c6cb46-d256-45d4-abf1-d7cc1b9ee9e8 req-1e79d958-240b-454b-95a5-0fc8acb626bc service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] No waiting events found dispatching network-vif-plugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:41:52 user nova-compute[72201]: WARNING nova.compute.manager [req-08c6cb46-d256-45d4-abf1-d7cc1b9ee9e8 req-1e79d958-240b-454b-95a5-0fc8acb626bc service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Received unexpected event network-vif-plugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 15:41:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:41:54 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904514.3486292, d2fda4cb-e06e-4aad-9c8d-454eb8ed578d => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:41:54 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] VM Resumed (Lifecycle Event)
Aug 01 15:41:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:41:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:41:54 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Instance spawned successfully.
Aug 01 15:41:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:41:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:41:54 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:41:54 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904514.3528075, d2fda4cb-e06e-4aad-9c8d-454eb8ed578d => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:41:54 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] VM Started (Lifecycle Event)
Aug 01 15:41:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:41:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:41:54 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:41:54 user nova-compute[72201]: DEBUG nova.compute.manager [req-4028ee9f-67c1-48ed-86e2-c803bb089d6f req-915df522-da07-4531-910e-556d5059368a service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Received event network-vif-plugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:41:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4028ee9f-67c1-48ed-86e2-c803bb089d6f req-915df522-da07-4531-910e-556d5059368a service nova] Acquiring lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:41:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4028ee9f-67c1-48ed-86e2-c803bb089d6f req-915df522-da07-4531-910e-556d5059368a service nova] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:41:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4028ee9f-67c1-48ed-86e2-c803bb089d6f req-915df522-da07-4531-910e-556d5059368a service nova] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:41:54 user nova-compute[72201]: DEBUG nova.compute.manager [req-4028ee9f-67c1-48ed-86e2-c803bb089d6f req-915df522-da07-4531-910e-556d5059368a service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] No waiting events found dispatching network-vif-plugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:41:54 user nova-compute[72201]: WARNING nova.compute.manager [req-4028ee9f-67c1-48ed-86e2-c803bb089d6f req-915df522-da07-4531-910e-556d5059368a service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Received unexpected event network-vif-plugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 15:41:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:41:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-99b2865d-deb6-4a7b-8f30-eb50b7c532ab tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.617s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:41:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:10 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:42:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:16 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Acquiring lock "929ed2b3-a72e-424e-94c4-352c207442ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "929ed2b3-a72e-424e-94c4-352c207442ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Acquiring lock "929ed2b3-a72e-424e-94c4-352c207442ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "929ed2b3-a72e-424e-94c4-352c207442ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "929ed2b3-a72e-424e-94c4-352c207442ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:42:17 user nova-compute[72201]: INFO nova.compute.manager [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Terminating instance
Aug 01 15:42:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:17 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Instance destroyed successfully.
Aug 01 15:42:17 user nova-compute[72201]: DEBUG nova.objects.instance [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lazy-loading 'resources' on Instance uuid 929ed2b3-a72e-424e-94c4-352c207442ec {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:33:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1889734490',display_name='tempest-ServersNegativeTestJSON-server-1889734490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1889734490',id=31,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:33:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce0e2836d3794cd8b26b8f54a73af7e7',ramdisk_id='',reservation_id='r-0yu0memm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-592631034',owner_user_name='tempest-ServersNegativeTestJSON-592631034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:33:34Z,user_data=None,user_id='382a20da0cdd454181d19da58d22551a',uuid=929ed2b3-a72e-424e-94c4-352c207442ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "112cdddb-0763-476b-a269-aed7d05c7856", "address": "fa:16:3e:66:f3:81", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112cdddb-07", "ovs_interfaceid": "112cdddb-0763-476b-a269-aed7d05c7856", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Converting VIF {"id": "112cdddb-0763-476b-a269-aed7d05c7856", "address": "fa:16:3e:66:f3:81", "network": {"id": "76e721f1-1135-4932-9d27-41c013b3c149", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-701703514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce0e2836d3794cd8b26b8f54a73af7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112cdddb-07", "ovs_interfaceid": "112cdddb-0763-476b-a269-aed7d05c7856", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:f3:81,bridge_name='br-int',has_traffic_filtering=True,id=112cdddb-0763-476b-a269-aed7d05c7856,network=Network(76e721f1-1135-4932-9d27-41c013b3c149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112cdddb-07') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG os_vif [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:f3:81,bridge_name='br-int',has_traffic_filtering=True,id=112cdddb-0763-476b-a269-aed7d05c7856,network=Network(76e721f1-1135-4932-9d27-41c013b3c149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112cdddb-07') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap112cdddb-07, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:42:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:17 user nova-compute[72201]: INFO os_vif [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:f3:81,bridge_name='br-int',has_traffic_filtering=True,id=112cdddb-0763-476b-a269-aed7d05c7856,network=Network(76e721f1-1135-4932-9d27-41c013b3c149),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112cdddb-07')
Aug 01 15:42:17 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Deleting instance files /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec_del
Aug 01 15:42:17 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Deletion of /opt/stack/data/nova/instances/929ed2b3-a72e-424e-94c4-352c207442ec_del complete
Aug 01 15:42:18 user nova-compute[72201]: DEBUG nova.compute.manager [req-a00bfde8-3356-41e2-aa5e-d1c9561cbebd req-b87ac9be-472b-4830-b8ee-19bc7a4275f9 service nova] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Received event network-vif-unplugged-112cdddb-0763-476b-a269-aed7d05c7856 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:42:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a00bfde8-3356-41e2-aa5e-d1c9561cbebd req-b87ac9be-472b-4830-b8ee-19bc7a4275f9 service nova] Acquiring lock "929ed2b3-a72e-424e-94c4-352c207442ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:42:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a00bfde8-3356-41e2-aa5e-d1c9561cbebd req-b87ac9be-472b-4830-b8ee-19bc7a4275f9 service nova] Lock "929ed2b3-a72e-424e-94c4-352c207442ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:42:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a00bfde8-3356-41e2-aa5e-d1c9561cbebd req-b87ac9be-472b-4830-b8ee-19bc7a4275f9 service nova] Lock "929ed2b3-a72e-424e-94c4-352c207442ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:42:18 user nova-compute[72201]: DEBUG nova.compute.manager [req-a00bfde8-3356-41e2-aa5e-d1c9561cbebd req-b87ac9be-472b-4830-b8ee-19bc7a4275f9 service nova] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] No waiting events found dispatching network-vif-unplugged-112cdddb-0763-476b-a269-aed7d05c7856 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:42:18 user nova-compute[72201]: DEBUG nova.compute.manager [req-a00bfde8-3356-41e2-aa5e-d1c9561cbebd req-b87ac9be-472b-4830-b8ee-19bc7a4275f9 service nova] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Received event network-vif-unplugged-112cdddb-0763-476b-a269-aed7d05c7856 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:42:18 user nova-compute[72201]: INFO nova.compute.manager [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Took 0.78 seconds to destroy the instance on the hypervisor.
Aug 01 15:42:18 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:42:18 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:42:18 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:42:18 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Updating instance_info_cache with network_info: [{"id": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "address": "fa:16:3e:6a:5e:e0", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6062f511-71", "ovs_interfaceid": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:42:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:42:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:42:18 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:42:18 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:42:18 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Took 0.71 seconds to deallocate network for instance.
Aug 01 15:42:18 user nova-compute[72201]: DEBUG nova.compute.manager [req-dbe53d05-0359-42e2-b2c5-03d75c506335 req-4977e612-c3b1-41ca-8b10-ddcce4c74ce9 service nova] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Received event network-vif-deleted-112cdddb-0763-476b-a269-aed7d05c7856 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:42:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:42:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:42:18 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:42:18 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:42:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:42:19 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Deleted allocations for instance 929ed2b3-a72e-424e-94c4-352c207442ec
Aug 01 15:42:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:19 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:42:19 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:42:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:42:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:42:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:42:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:42:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-be79d793-023e-4963-b81a-1713f9887629 tempest-ServersNegativeTestJSON-592631034 tempest-ServersNegativeTestJSON-592631034-project-member] Lock "929ed2b3-a72e-424e-94c4-352c207442ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.888s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:42:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:42:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:42:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG nova.compute.manager [req-f2eeebea-74ab-449e-8335-06d858bc581b req-dbc853a1-c0bc-4774-8686-9cb3f6f24a04 service nova] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Received event network-vif-plugged-112cdddb-0763-476b-a269-aed7d05c7856 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f2eeebea-74ab-449e-8335-06d858bc581b req-dbc853a1-c0bc-4774-8686-9cb3f6f24a04 service nova] Acquiring lock "929ed2b3-a72e-424e-94c4-352c207442ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f2eeebea-74ab-449e-8335-06d858bc581b req-dbc853a1-c0bc-4774-8686-9cb3f6f24a04 service nova] Lock "929ed2b3-a72e-424e-94c4-352c207442ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f2eeebea-74ab-449e-8335-06d858bc581b req-dbc853a1-c0bc-4774-8686-9cb3f6f24a04 service nova] Lock "929ed2b3-a72e-424e-94c4-352c207442ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG nova.compute.manager [req-f2eeebea-74ab-449e-8335-06d858bc581b req-dbc853a1-c0bc-4774-8686-9cb3f6f24a04 service nova] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] No waiting events found dispatching network-vif-plugged-112cdddb-0763-476b-a269-aed7d05c7856 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:42:20 user nova-compute[72201]: WARNING nova.compute.manager [req-f2eeebea-74ab-449e-8335-06d858bc581b req-dbc853a1-c0bc-4774-8686-9cb3f6f24a04 service nova] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Received unexpected event network-vif-plugged-112cdddb-0763-476b-a269-aed7d05c7856 for instance with vm_state deleted and task_state None.
Aug 01 15:42:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG nova.objects.instance [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'flavor' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:42:20 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:42:20 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:42:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8484MB free_disk=25.330707550048828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "refresh_cache-801f5645-aff6-41ea-bb28-34e8dcacfe20" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquired lock "refresh_cache-801f5645-aff6-41ea-bb28-34e8dcacfe20" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG nova.network.neutron [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG nova.objects.instance [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'info_cache' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f0743332-223f-4507-b8b1-40d63b7b5e80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 801f5645-aff6-41ea-bb28-34e8dcacfe20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance d2fda4cb-e06e-4aad-9c8d-454eb8ed578d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:42:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.network.neutron [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Updating instance_info_cache with network_info: [{"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Releasing lock "refresh_cache-801f5645-aff6-41ea-bb28-34e8dcacfe20" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:42:21 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Instance destroyed successfully.
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.objects.instance [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'resources' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1438545025',display_name='tempest-AttachVolumeTestJSON-server-1438545025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1438545025',id=38,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5sTybeqRu+KrWZIs2Qy17OX/PCK/I5EFDxt6til1PIQ3CSrY0rgKAekgLbUup6BgzQOCUtfNIUY2C5P7VWdfbkUmmeezeVSiWHDBAhmzUEyBhfgdTIHXtComrkv3PWWQ==',key_name='tempest-keypair-634092699',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:38:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1b9978ab74a743b6870f1a86469debb4',ramdisk_id='',reservation_id='r-k1ayhqoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-570587534',owner_user_name='tempest-AttachVolumeTestJSON-570587534-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:40:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='243e1aae552d43b7b892618022460e1b',uuid=801f5645-aff6-41ea-bb28-34e8dcacfe20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converting VIF {"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:d3:89,bridge_name='br-int',has_traffic_filtering=True,id=1ad27823-4773-4b78-bbe0-1378855554c8,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad27823-47') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_vif [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:d3:89,bridge_name='br-int',has_traffic_filtering=True,id=1ad27823-4773-4b78-bbe0-1378855554c8,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad27823-47') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ad27823-47, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:42:21 user nova-compute[72201]: INFO os_vif [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:d3:89,bridge_name='br-int',has_traffic_filtering=True,id=1ad27823-4773-4b78-bbe0-1378855554c8,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad27823-47')
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkAfZxjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:42:21 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd1e138-67a2-492e-9313-ef803491891b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9be297-a168-41fa-9bae-ee63437a8d78]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)
Aug 01 15:42:21 user nova-compute[72201]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:42:21 user nova-compute[72201]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 (non-flash)
Aug 01 15:42:21 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)
Aug 01 15:42:21 user nova-compute[72201]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:42:21 user nova-compute[72201]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 (non-flash)
Aug 01 15:42:21 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc54755c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3'): ({'sdb'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Removing single pathed devices sdb {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ed31b3-1af3-4b63-b00d-8d53f526f397]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[029c1cb6-57e2-4c0f-80d1-3728938206dc]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Flushing IO for device /dev/sdb {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f12117a-1624-4acd-993b-291cdfe0dfa3]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a308c42f-c6d6-42f6-b462-3e043de4086b]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[26386f93-9650-445b-b422-32a003f0d8cb]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16ead68-ae55-48aa-b54c-9dda6233d2ba]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3, portal: 172.16.0.220,3260]
Aug 01 15:42:21 user nova-compute[72201]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3, portal: 172.16.0.220,3260] successful.
Aug 01 15:42:21 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a5dc6b-3985-478e-969f-9b986949f7a8]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] <== disconnect_volume: return (266ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Start _get_guest_xml network_info=[{"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkAfZxjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '801f5645-aff6-41ea-bb28-34e8dcacfe20', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4bd1d23-73c6-42e5-9999-feac531e50b3', 'serial': 'a4bd1d23-73c6-42e5-9999-feac531e50b3'}, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'ae7199a7-27ff-414f-afc1-136b790529af', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.objects.instance [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'numa_topology' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:42:21 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:42:21 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.objects.instance [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'vcpu_model' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkAfZxjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:42:21 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:42:21 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:42:21 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5cb7a0-5452-406b-baf4-5ea825203496]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:42:21 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43b85da-9a81-4914-b72c-4121c3216e99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3] added
Aug 01 15:42:21 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adc47d5-9cb7-4b30-931c-cfbb585bf20c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6330dd17-2175-48e1-9aff-9d8848c2bf0b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkAfZxjw {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkAfZxjw" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec40d11-b1a1-4c7c-b5ad-b110399e916e]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JkAfZxjw'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6ee31a-f171-46d2-a552-213b87c2d6c7]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1d4b3d-b3cd-43a7-8c74-3e6d6290c83f]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:42:21 user nova-compute[72201]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 (non-flash)
Aug 01 15:42:21 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:42:21 user nova-compute[72201]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 (non-flash)
Aug 01 15:42:21 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae557e6-12b1-458a-888e-8926d214b0aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3, portal: 172.16.0.220,3260]
Aug 01 15:42:21 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3, portal: 172.16.0.220,3260] successful.
Aug 01 15:42:21 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ff530a-2d13-49c6-bc26-67fddd32a87a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[529014fe-198c-4079-9da7-d4380b09bf04]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:42:21 user nova-compute[72201]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 (non-flash)
Aug 01 15:42:21 user nova-compute[72201]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)
Aug 01 15:42:21 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:42:21 user nova-compute[72201]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 (non-flash)
Aug 01 15:42:21 user nova-compute[72201]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)
Aug 01 15:42:21 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fe9492-1554-4cc2-b9a3-7def01fc8521]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:42:21 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:42:22 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:42:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkAfZxjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:42:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:42:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26564363431316462', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:42:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564363431316462', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:42:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1438545025',display_name='tempest-AttachVolumeTestJSON-server-1438545025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1438545025',id=38,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5sTybeqRu+KrWZIs2Qy17OX/PCK/I5EFDxt6til1PIQ3CSrY0rgKAekgLbUup6BgzQOCUtfNIUY2C5P7VWdfbkUmmeezeVSiWHDBAhmzUEyBhfgdTIHXtComrkv3PWWQ==',key_name='tempest-keypair-634092699',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:38:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1b9978ab74a743b6870f1a86469debb4',ramdisk_id='',reservation_id='r-k1ayhqoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-570587534',owner_user_name='tempest-AttachVolumeTestJSON-570587534-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:40:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='243e1aae552d43b7b892618022460e1b',uuid=801f5645-aff6-41ea-bb28-34e8dcacfe20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:42:22 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converting VIF {"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:42:22 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:d3:89,bridge_name='br-int',has_traffic_filtering=True,id=1ad27823-4773-4b78-bbe0-1378855554c8,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad27823-47') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:42:22 user nova-compute[72201]: DEBUG nova.objects.instance [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'pci_devices' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:42:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:42:22 user nova-compute[72201]:   <uuid>801f5645-aff6-41ea-bb28-34e8dcacfe20</uuid>
Aug 01 15:42:22 user nova-compute[72201]:   <name>instance-00000026</name>
Aug 01 15:42:22 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:42:22 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:42:22 user nova-compute[72201]:   <metadata>
Aug 01 15:42:22 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:42:22 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:42:22 user nova-compute[72201]:       <nova:name>tempest-AttachVolumeTestJSON-server-1438545025</nova:name>
Aug 01 15:42:22 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:42:21</nova:creationTime>
Aug 01 15:42:22 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:42:22 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:42:22 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:42:22 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:42:22 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:42:22 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:42:22 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:42:22 user nova-compute[72201]:       <nova:owner>
Aug 01 15:42:22 user nova-compute[72201]:         <nova:user uuid="243e1aae552d43b7b892618022460e1b">tempest-AttachVolumeTestJSON-570587534-project-member</nova:user>
Aug 01 15:42:22 user nova-compute[72201]:         <nova:project uuid="1b9978ab74a743b6870f1a86469debb4">tempest-AttachVolumeTestJSON-570587534</nova:project>
Aug 01 15:42:22 user nova-compute[72201]:       </nova:owner>
Aug 01 15:42:22 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:42:22 user nova-compute[72201]:       <nova:ports>
Aug 01 15:42:22 user nova-compute[72201]:         <nova:port uuid="1ad27823-4773-4b78-bbe0-1378855554c8">
Aug 01 15:42:22 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 15:42:22 user nova-compute[72201]:         </nova:port>
Aug 01 15:42:22 user nova-compute[72201]:       </nova:ports>
Aug 01 15:42:22 user nova-compute[72201]:     </nova:instance>
Aug 01 15:42:22 user nova-compute[72201]:   </metadata>
Aug 01 15:42:22 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:42:22 user nova-compute[72201]:     <system>
Aug 01 15:42:22 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:42:22 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:42:22 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:42:22 user nova-compute[72201]:       <entry name="serial">801f5645-aff6-41ea-bb28-34e8dcacfe20</entry>
Aug 01 15:42:22 user nova-compute[72201]:       <entry name="uuid">801f5645-aff6-41ea-bb28-34e8dcacfe20</entry>
Aug 01 15:42:22 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:42:22 user nova-compute[72201]:     </system>
Aug 01 15:42:22 user nova-compute[72201]:   </sysinfo>
Aug 01 15:42:22 user nova-compute[72201]:   <os>
Aug 01 15:42:22 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:42:22 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:42:22 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:42:22 user nova-compute[72201]:   </os>
Aug 01 15:42:22 user nova-compute[72201]:   <features>
Aug 01 15:42:22 user nova-compute[72201]:     <acpi/>
Aug 01 15:42:22 user nova-compute[72201]:     <apic/>
Aug 01 15:42:22 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:42:22 user nova-compute[72201]:   </features>
Aug 01 15:42:22 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:42:22 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:42:22 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:42:22 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:42:22 user nova-compute[72201]:   </clock>
Aug 01 15:42:22 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:42:22 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:42:22 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:42:22 user nova-compute[72201]:   </cpu>
Aug 01 15:42:22 user nova-compute[72201]:   <devices>
Aug 01 15:42:22 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:42:22 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:42:22 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk"/>
Aug 01 15:42:22 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:42:22 user nova-compute[72201]:     </disk>
Aug 01 15:42:22 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:42:22 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:42:22 user nova-compute[72201]:       <source dev="/dev/sdb"/>
Aug 01 15:42:22 user nova-compute[72201]:       <target dev="vdb" bus="virtio"/>
Aug 01 15:42:22 user nova-compute[72201]:       <serial>a4bd1d23-73c6-42e5-9999-feac531e50b3</serial>
Aug 01 15:42:22 user nova-compute[72201]:     </disk>
Aug 01 15:42:22 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:42:22 user nova-compute[72201]:       <mac address="fa:16:3e:f7:d3:89"/>
Aug 01 15:42:22 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:42:22 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:42:22 user nova-compute[72201]:       <target dev="tap1ad27823-47"/>
Aug 01 15:42:22 user nova-compute[72201]:     </interface>
Aug 01 15:42:22 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:42:22 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/console.log" append="off"/>
Aug 01 15:42:22 user nova-compute[72201]:     </serial>
Aug 01 15:42:22 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:42:22 user nova-compute[72201]:     <video>
Aug 01 15:42:22 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:42:22 user nova-compute[72201]:     </video>
Aug 01 15:42:22 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:42:22 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:42:22 user nova-compute[72201]:     </rng>
Aug 01 15:42:22 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:42:22 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:42:22 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:42:22 user nova-compute[72201]:     </memballoon>
Aug 01 15:42:22 user nova-compute[72201]:   </devices>
Aug 01 15:42:22 user nova-compute[72201]: </domain>
Aug 01 15:42:22 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:42:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:22 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:42:22 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:42:22 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:42:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:42:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG nova.objects.instance [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'trusted_certs' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Checking if we can resize image /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Cannot resize image /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG nova.objects.instance [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'migration_context' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1438545025',display_name='tempest-AttachVolumeTestJSON-server-1438545025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1438545025',id=38,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5sTybeqRu+KrWZIs2Qy17OX/PCK/I5EFDxt6til1PIQ3CSrY0rgKAekgLbUup6BgzQOCUtfNIUY2C5P7VWdfbkUmmeezeVSiWHDBAhmzUEyBhfgdTIHXtComrkv3PWWQ==',key_name='tempest-keypair-634092699',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:38:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='1b9978ab74a743b6870f1a86469debb4',ramdisk_id='',reservation_id='r-k1ayhqoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-570587534',owner_user_name='tempest-AttachVolumeTestJSON-570587534-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:40:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='243e1aae552d43b7b892618022460e1b',uuid=801f5645-aff6-41ea-bb28-34e8dcacfe20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converting VIF {"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:d3:89,bridge_name='br-int',has_traffic_filtering=True,id=1ad27823-4773-4b78-bbe0-1378855554c8,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad27823-47') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG os_vif [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:d3:89,bridge_name='br-int',has_traffic_filtering=True,id=1ad27823-4773-4b78-bbe0-1378855554c8,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad27823-47') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ad27823-47, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ad27823-47, col_values=(('external_ids', {'iface-id': '1ad27823-4773-4b78-bbe0-1378855554c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:d3:89', 'vm-uuid': '801f5645-aff6-41ea-bb28-34e8dcacfe20'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:42:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:23 user nova-compute[72201]: INFO os_vif [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:d3:89,bridge_name='br-int',has_traffic_filtering=True,id=1ad27823-4773-4b78-bbe0-1378855554c8,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad27823-47')
Aug 01 15:42:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-d614bd46-5726-49ce-afed-b5d2341e111c req-a7c7dcae-539f-43ad-8c2b-4fb81287cdd0 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received event network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:42:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d614bd46-5726-49ce-afed-b5d2341e111c req-a7c7dcae-539f-43ad-8c2b-4fb81287cdd0 service nova] Acquiring lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:42:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d614bd46-5726-49ce-afed-b5d2341e111c req-a7c7dcae-539f-43ad-8c2b-4fb81287cdd0 service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:42:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d614bd46-5726-49ce-afed-b5d2341e111c req-a7c7dcae-539f-43ad-8c2b-4fb81287cdd0 service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:42:25 user nova-compute[72201]: DEBUG nova.compute.manager [req-d614bd46-5726-49ce-afed-b5d2341e111c req-a7c7dcae-539f-43ad-8c2b-4fb81287cdd0 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] No waiting events found dispatching network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:42:25 user nova-compute[72201]: WARNING nova.compute.manager [req-d614bd46-5726-49ce-afed-b5d2341e111c req-a7c7dcae-539f-43ad-8c2b-4fb81287cdd0 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received unexpected event network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 for instance with vm_state stopped and task_state powering-on.
Aug 01 15:42:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:26 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904546.936007, 801f5645-aff6-41ea-bb28-34e8dcacfe20 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:42:26 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] VM Resumed (Lifecycle Event)
Aug 01 15:42:26 user nova-compute[72201]: DEBUG nova.compute.manager [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:42:26 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Instance rebooted successfully.
Aug 01 15:42:26 user nova-compute[72201]: DEBUG nova.compute.manager [None req-794ad6ad-a25f-4c2b-8f3e-b66324cc364e tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:42:26 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:42:26 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:42:26 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 01 15:42:26 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904546.94075, 801f5645-aff6-41ea-bb28-34e8dcacfe20 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:42:26 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] VM Started (Lifecycle Event)
Aug 01 15:42:27 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:42:27 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:42:27 user nova-compute[72201]: DEBUG nova.compute.manager [req-5b33c283-c8a5-4df7-b218-b111fff16e65 req-7d85f9d8-5132-4c63-b562-7b6e05d5a925 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received event network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:42:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5b33c283-c8a5-4df7-b218-b111fff16e65 req-7d85f9d8-5132-4c63-b562-7b6e05d5a925 service nova] Acquiring lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:42:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5b33c283-c8a5-4df7-b218-b111fff16e65 req-7d85f9d8-5132-4c63-b562-7b6e05d5a925 service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:42:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5b33c283-c8a5-4df7-b218-b111fff16e65 req-7d85f9d8-5132-4c63-b562-7b6e05d5a925 service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:42:27 user nova-compute[72201]: DEBUG nova.compute.manager [req-5b33c283-c8a5-4df7-b218-b111fff16e65 req-7d85f9d8-5132-4c63-b562-7b6e05d5a925 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] No waiting events found dispatching network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:42:27 user nova-compute[72201]: WARNING nova.compute.manager [req-5b33c283-c8a5-4df7-b218-b111fff16e65 req-7d85f9d8-5132-4c63-b562-7b6e05d5a925 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received unexpected event network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 for instance with vm_state active and task_state None.
Aug 01 15:42:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:32 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690904537.8200088, 929ed2b3-a72e-424e-94c4-352c207442ec => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:42:32 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] VM Stopped (Lifecycle Event)
Aug 01 15:42:32 user nova-compute[72201]: DEBUG nova.compute.manager [None req-af209469-38f7-49ed-b149-31217a0d51e2 None None] [instance: 929ed2b3-a72e-424e-94c4-352c207442ec] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:42:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:42:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:42:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:42:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:43:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:43:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:43:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:43:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:43:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:11 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:43:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:17 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:43:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:43:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-801f5645-aff6-41ea-bb28-34e8dcacfe20" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:43:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-801f5645-aff6-41ea-bb28-34e8dcacfe20" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:43:17 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:43:17 user nova-compute[72201]: INFO nova.compute.manager [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Rescuing
Aug 01 15:43:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:43:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquired lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:43:17 user nova-compute[72201]: DEBUG nova.network.neutron [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:43:18 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Updating instance_info_cache with network_info: [{"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:43:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-801f5645-aff6-41ea-bb28-34e8dcacfe20" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:43:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:43:18 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:43:18 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:43:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:18 user nova-compute[72201]: DEBUG nova.network.neutron [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Updating instance_info_cache with network_info: [{"id": "fa130bf4-53dc-43f7-8932-0aec318054d9", "address": "fa:16:3e:92:e7:b2", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa130bf4-53", "ovs_interfaceid": "fa130bf4-53dc-43f7-8932-0aec318054d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:43:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Releasing lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:43:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:19 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:43:19 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:43:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:43:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:43:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:43:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:43:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:19 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Instance destroyed successfully.
Aug 01 15:43:19 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Attempting a stable device rescue
Aug 01 15:43:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72201) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 15:43:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Instance directory exists: not creating {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 15:43:19 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Creating image(s)
Aug 01 15:43:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e0642bf-a60d-4882-b7fb-38bbcdf69ee5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:43:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "/opt/stack/data/nova/instances/7e0642bf-a60d-4882-b7fb-38bbcdf69ee5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:43:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "/opt/stack/data/nova/instances/7e0642bf-a60d-4882-b7fb-38bbcdf69ee5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:43:19 user nova-compute[72201]: DEBUG nova.objects.instance [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:43:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "aa6a60952c87d66d65c04d5719003b06ac2d2cf8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:43:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "aa6a60952c87d66d65c04d5719003b06ac2d2cf8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:43:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa6a60952c87d66d65c04d5719003b06ac2d2cf8.part --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG nova.compute.manager [req-96a4e7d1-052e-4b57-8d5d-94390f012cf1 req-b38d5a7d-cc7f-4b52-9c81-8defcc9854d8 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received event network-vif-unplugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-96a4e7d1-052e-4b57-8d5d-94390f012cf1 req-b38d5a7d-cc7f-4b52-9c81-8defcc9854d8 service nova] Acquiring lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-96a4e7d1-052e-4b57-8d5d-94390f012cf1 req-b38d5a7d-cc7f-4b52-9c81-8defcc9854d8 service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-96a4e7d1-052e-4b57-8d5d-94390f012cf1 req-b38d5a7d-cc7f-4b52-9c81-8defcc9854d8 service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG nova.compute.manager [req-96a4e7d1-052e-4b57-8d5d-94390f012cf1 req-b38d5a7d-cc7f-4b52-9c81-8defcc9854d8 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] No waiting events found dispatching network-vif-unplugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:43:20 user nova-compute[72201]: WARNING nova.compute.manager [req-96a4e7d1-052e-4b57-8d5d-94390f012cf1 req-b38d5a7d-cc7f-4b52-9c81-8defcc9854d8 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received unexpected event network-vif-unplugged-fa130bf4-53dc-43f7-8932-0aec318054d9 for instance with vm_state active and task_state rescuing.
Aug 01 15:43:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 1.003s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa6a60952c87d66d65c04d5719003b06ac2d2cf8.part --force-share --output=json" returned: 0 in 0.145s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG nova.virt.images [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] b7b69dfe-b381-464b-97bf-bd64a574fec8 was qcow2, converting to raw {{(pid=72201) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG nova.privsep.utils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72201) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aa6a60952c87d66d65c04d5719003b06ac2d2cf8.part /opt/stack/data/nova/instances/_base/aa6a60952c87d66d65c04d5719003b06ac2d2cf8.converted {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aa6a60952c87d66d65c04d5719003b06ac2d2cf8.part /opt/stack/data/nova/instances/_base/aa6a60952c87d66d65c04d5719003b06ac2d2cf8.converted" returned: 0 in 0.151s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa6a60952c87d66d65c04d5719003b06ac2d2cf8.converted --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa6a60952c87d66d65c04d5719003b06ac2d2cf8.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "aa6a60952c87d66d65c04d5719003b06ac2d2cf8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.486s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "aa6a60952c87d66d65c04d5719003b06ac2d2cf8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "aa6a60952c87d66d65c04d5719003b06ac2d2cf8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa6a60952c87d66d65c04d5719003b06ac2d2cf8 --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa6a60952c87d66d65c04d5719003b06ac2d2cf8 --force-share --output=json" returned: 0 in 0.154s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aa6a60952c87d66d65c04d5719003b06ac2d2cf8,backing_fmt=raw /opt/stack/data/nova/instances/7e0642bf-a60d-4882-b7fb-38bbcdf69ee5/disk.rescue {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aa6a60952c87d66d65c04d5719003b06ac2d2cf8,backing_fmt=raw /opt/stack/data/nova/instances/7e0642bf-a60d-4882-b7fb-38bbcdf69ee5/disk.rescue" returned: 0 in 0.074s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "aa6a60952c87d66d65c04d5719003b06ac2d2cf8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.objects.instance [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'migration_context' on Instance uuid 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Start _get_guest_xml network_info=[{"id": "fa130bf4-53dc-43f7-8932-0aec318054d9", "address": "fa:16:3e:92:e7:b2", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "vif_mac": "fa:16:3e:92:e7:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa130bf4-53", "ovs_interfaceid": "fa130bf4-53dc-43f7-8932-0aec318054d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b7b69dfe-b381-464b-97bf-bd64a574fec8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vqZNjAls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '7e0642bf-a60d-4882-b7fb-38bbcdf69ee5', 'attached_at': '', 'detached_at': '', 'volume_id': '73a13640-d808-40a7-8670-a2a67ea37f92', 'serial': '73a13640-d808-40a7-8670-a2a67ea37f92'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '8ecec86f-281e-4715-b991-72ad3c1a589e', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.objects.instance [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'resources' on Instance uuid 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.objects.instance [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'numa_topology' on Instance uuid 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:43:21 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:43:21 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.objects.instance [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vqZNjAls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:43:21 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:43:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:43:21 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:43:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:43:21 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[586ff847-536e-4e7a-9e11-5e0be5b0b975]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = vqZNjAls\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 15:43:21 user nova-compute[72201]: node.name = iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92
Aug 01 15:43:21 user nova-compute[72201]: node.tpgt = -1
Aug 01 15:43:21 user nova-compute[72201]: node.startup = automatic
Aug 01 15:43:21 user nova-compute[72201]: node.leading_login = No
Aug 01 15:43:21 user nova-compute[72201]: iface.iscsi_ifacename = default
Aug 01 15:43:21 user nova-compute[72201]: iface.net_ifacename = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.ipaddress = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.prefix_len = 0
Aug 01 15:43:21 user nova-compute[72201]: iface.hwaddress = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.transport_name = tcp
Aug 01 15:43:21 user nova-compute[72201]: iface.initiatorname = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.state = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.vlan_id = 0
Aug 01 15:43:21 user nova-compute[72201]: iface.vlan_priority = 0
Aug 01 15:43:21 user nova-compute[72201]: iface.vlan_state = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.iface_num = 0
Aug 01 15:43:21 user nova-compute[72201]: iface.mtu = 0
Aug 01 15:43:21 user nova-compute[72201]: iface.port = 0
Aug 01 15:43:21 user nova-compute[72201]: iface.bootproto = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.subnet_mask = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.gateway = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.dhcp_alt_client_id = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.dhcp_dns = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.dhcp_learn_iqn = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.dhcp_vendor_id_state = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.dhcp_vendor_id = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.dhcp_slp_da = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.fragmentation = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.gratuitous_arp = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.incoming_forwarding = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.tos_state = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.tos = 0
Aug 01 15:43:21 user nova-compute[72201]: iface.ttl = 0
Aug 01 15:43:21 user nova-compute[72201]: iface.delayed_ack = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.tcp_nagle = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.tcp_wsf_state = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.tcp_wsf = 0
Aug 01 15:43:21 user nova-compute[72201]: iface.tcp_timer_scale = 0
Aug 01 15:43:21 user nova-compute[72201]: iface.tcp_timestamp = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.redirect = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.def_task_mgmt_timeout = 0
Aug 01 15:43:21 user nova-compute[72201]: iface.header_digest = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.data_digest = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.immediate_data = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.initial_r2t = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.data_seq_inorder = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.data_pdu_inorder = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.erl = 0
Aug 01 15:43:21 user nova-compute[72201]: iface.max_receive_data_len = 0
Aug 01 15:43:21 user nova-compute[72201]: iface.first_burst_len = 0
Aug 01 15:43:21 user nova-compute[72201]: iface.max_outstanding_r2t = 0
Aug 01 15:43:21 user nova-compute[72201]: iface.max_burst_len = 0
Aug 01 15:43:21 user nova-compute[72201]: iface.chap_auth = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.bidi_chap = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.strict_login_compliance = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.discovery_auth = <empty>
Aug 01 15:43:21 user nova-compute[72201]: iface.discovery_logout = <empty>
Aug 01 15:43:21 user nova-compute[72201]: node.discovery_address = <empty>
Aug 01 15:43:21 user nova-compute[72201]: node.discovery_port = 0
Aug 01 15:43:21 user nova-compute[72201]: node.discovery_type = static
Aug 01 15:43:21 user nova-compute[72201]: node.session.initial_cmdsn = 0
Aug 01 15:43:21 user nova-compute[72201]: node.session.initial_login_retry_max = 8
Aug 01 15:43:21 user nova-compute[72201]: node.session.xmit_thread_priority = -20
Aug 01 15:43:21 user nova-compute[72201]: node.session.cmds_max = 128
Aug 01 15:43:21 user nova-compute[72201]: node.session.queue_depth = 32
Aug 01 15:43:21 user nova-compute[72201]: node.session.nr_sessions = 1
Aug 01 15:43:21 user nova-compute[72201]: node.session.auth.authmethod = CHAP
Aug 01 15:43:21 user nova-compute[72201]: node.session.auth.username = vqZNjAls
Aug 01 15:43:21 user nova-compute[72201]: node.session.auth.password = ***
Aug 01 15:43:21 user nova-compute[72201]: node.session.auth.username_in = <empty>
Aug 01 15:43:21 user nova-compute[72201]: node.session.auth.password_in = <empty>
Aug 01 15:43:21 user nova-compute[72201]: node.session.auth.chap_algs = MD5
Aug 01 15:43:21 user nova-compute[72201]: node.session.timeo.replacement_timeout = 120
Aug 01 15:43:21 user nova-compute[72201]: node.session.err_timeo.abort_timeout = 15
Aug 01 15:43:21 user nova-compute[72201]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 15:43:21 user nova-compute[72201]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 15:43:21 user nova-compute[72201]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 15:43:21 user nova-compute[72201]: node.session.iscsi.FastAbort = Yes
Aug 01 15:43:21 user nova-compute[72201]: node.session.iscsi.InitialR2T = No
Aug 01 15:43:21 user nova-compute[72201]: node.session.iscsi.ImmediateData = Yes
Aug 01 15:43:21 user nova-compute[72201]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 15:43:21 user nova-compute[72201]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 15:43:21 user nova-compute[72201]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 15:43:21 user nova-compute[72201]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 15:43:21 user nova-compute[72201]: node.session.iscsi.MaxConnections = 1
Aug 01 15:43:21 user nova-compute[72201]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 15:43:21 user nova-compute[72201]: node.session.iscsi.ERL = 0
Aug 01 15:43:21 user nova-compute[72201]: node.session.scan = manual
Aug 01 15:43:21 user nova-compute[72201]: node.session.reopen_max = 0
Aug 01 15:43:21 user nova-compute[72201]: node.conn[0].address = 172.16.0.220
Aug 01 15:43:21 user nova-compute[72201]: node.conn[0].port = 3260
Aug 01 15:43:21 user nova-compute[72201]: node.conn[0].startup = manual
Aug 01 15:43:21 user nova-compute[72201]: node.conn[0].tcp.window_size = 524288
Aug 01 15:43:21 user nova-compute[72201]: node.conn[0].tcp.type_of_service = 0
Aug 01 15:43:21 user nova-compute[72201]: node.conn[0].timeo.logout_timeout = 15
Aug 01 15:43:21 user nova-compute[72201]: node.conn[0].timeo.login_timeout = 15
Aug 01 15:43:21 user nova-compute[72201]: node.conn[0].timeo.auth_timeout = 45
Aug 01 15:43:21 user nova-compute[72201]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 15:43:21 user nova-compute[72201]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 15:43:21 user nova-compute[72201]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 15:43:21 user nova-compute[72201]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 15:43:21 user nova-compute[72201]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 15:43:21 user nova-compute[72201]: node.conn[0].iscsi.DataDigest = None
Aug 01 15:43:21 user nova-compute[72201]: node.conn[0].iscsi.IFMarker = No
Aug 01 15:43:21 user nova-compute[72201]: node.conn[0].iscsi.OFMarker = No
Aug 01 15:43:21 user nova-compute[72201]: # END RECORD
Aug 01 15:43:21 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b0f974-9d79-4251-93f3-889b508a830d]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:21 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:43:21 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:43:21 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8427MB free_disk=25.320598602294922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[008b53b8-8069-46d1-913d-289b87b5c24c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vqZNjAls {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vqZNjAls" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[666dd3c9-bbea-4b45-969c-ccb8dcdffdf4]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vqZNjAls'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabe0755-2248-4154-9df0-ab8353c4e2c0]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f0743332-223f-4507-b8b1-40d63b7b5e80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 801f5645-aff6-41ea-bb28-34e8dcacfe20 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance d2fda4cb-e06e-4aad-9c8d-454eb8ed578d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6101d83-9d92-4f50-b61c-1270d96d9d4a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:43:22 user nova-compute[72201]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 (non-flash)
Aug 01 15:43:22 user nova-compute[72201]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)
Aug 01 15:43:22 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:43:22 user nova-compute[72201]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 (non-flash)
Aug 01 15:43:22 user nova-compute[72201]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)
Aug 01 15:43:22 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.754s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] HCTL ('34', '0', '0', 0) found on session 46 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a59616-8463-47d3-8fc3-7511f17e3db7]: (4, ('0 0 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Searching for a device in session 46 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vqZNjAls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.778s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] <== connect_volume: return (779ms) {'type': 'block', 'scsi_wwn': '26162343637366338', 'path': '/dev/sdc'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162343637366338', 'path': '/dev/sdc'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1571805310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1571805310',id=39,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:41:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ed7463cb6f84c4a8cf1ef0437eca988',ramdisk_id='',reservation_id='r-pl830pzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:41:46Z,user_data=None,user_id='75b0cb34dac64c61a235470454e0c6bf',uuid=7e0642bf-a60d-4882-b7fb-38bbcdf69ee5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa130bf4-53dc-43f7-8932-0aec318054d9", "address": "fa:16:3e:92:e7:b2", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "vif_mac": "fa:16:3e:92:e7:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa130bf4-53", "ovs_interfaceid": "fa130bf4-53dc-43f7-8932-0aec318054d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converting VIF {"id": "fa130bf4-53dc-43f7-8932-0aec318054d9", "address": "fa:16:3e:92:e7:b2", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "vif_mac": "fa:16:3e:92:e7:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa130bf4-53", "ovs_interfaceid": "fa130bf4-53dc-43f7-8932-0aec318054d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:e7:b2,bridge_name='br-int',has_traffic_filtering=True,id=fa130bf4-53dc-43f7-8932-0aec318054d9,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa130bf4-53') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG nova.objects.instance [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:43:22 user nova-compute[72201]:   <uuid>7e0642bf-a60d-4882-b7fb-38bbcdf69ee5</uuid>
Aug 01 15:43:22 user nova-compute[72201]:   <name>instance-00000027</name>
Aug 01 15:43:22 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:43:22 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:43:22 user nova-compute[72201]:   <metadata>
Aug 01 15:43:22 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:43:22 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:43:22 user nova-compute[72201]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1571805310</nova:name>
Aug 01 15:43:22 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:43:21</nova:creationTime>
Aug 01 15:43:22 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:43:22 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:43:22 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:43:22 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:43:22 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:43:22 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:43:22 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:43:22 user nova-compute[72201]:       <nova:owner>
Aug 01 15:43:22 user nova-compute[72201]:         <nova:user uuid="75b0cb34dac64c61a235470454e0c6bf">tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member</nova:user>
Aug 01 15:43:22 user nova-compute[72201]:         <nova:project uuid="2ed7463cb6f84c4a8cf1ef0437eca988">tempest-ServerBootFromVolumeStableRescueTest-1836467291</nova:project>
Aug 01 15:43:22 user nova-compute[72201]:       </nova:owner>
Aug 01 15:43:22 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:43:22 user nova-compute[72201]:       <nova:ports>
Aug 01 15:43:22 user nova-compute[72201]:         <nova:port uuid="fa130bf4-53dc-43f7-8932-0aec318054d9">
Aug 01 15:43:22 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 15:43:22 user nova-compute[72201]:         </nova:port>
Aug 01 15:43:22 user nova-compute[72201]:       </nova:ports>
Aug 01 15:43:22 user nova-compute[72201]:     </nova:instance>
Aug 01 15:43:22 user nova-compute[72201]:   </metadata>
Aug 01 15:43:22 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:43:22 user nova-compute[72201]:     <system>
Aug 01 15:43:22 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:43:22 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:43:22 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:43:22 user nova-compute[72201]:       <entry name="serial">7e0642bf-a60d-4882-b7fb-38bbcdf69ee5</entry>
Aug 01 15:43:22 user nova-compute[72201]:       <entry name="uuid">7e0642bf-a60d-4882-b7fb-38bbcdf69ee5</entry>
Aug 01 15:43:22 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:43:22 user nova-compute[72201]:     </system>
Aug 01 15:43:22 user nova-compute[72201]:   </sysinfo>
Aug 01 15:43:22 user nova-compute[72201]:   <os>
Aug 01 15:43:22 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:43:22 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:43:22 user nova-compute[72201]:   </os>
Aug 01 15:43:22 user nova-compute[72201]:   <features>
Aug 01 15:43:22 user nova-compute[72201]:     <acpi/>
Aug 01 15:43:22 user nova-compute[72201]:     <apic/>
Aug 01 15:43:22 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:43:22 user nova-compute[72201]:   </features>
Aug 01 15:43:22 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:43:22 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:43:22 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:43:22 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:43:22 user nova-compute[72201]:   </clock>
Aug 01 15:43:22 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:43:22 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:43:22 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:43:22 user nova-compute[72201]:   </cpu>
Aug 01 15:43:22 user nova-compute[72201]:   <devices>
Aug 01 15:43:22 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:43:22 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:43:22 user nova-compute[72201]:       <source dev="/dev/sdc"/>
Aug 01 15:43:22 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:43:22 user nova-compute[72201]:       <serial>73a13640-d808-40a7-8670-a2a67ea37f92</serial>
Aug 01 15:43:22 user nova-compute[72201]:     </disk>
Aug 01 15:43:22 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:43:22 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:43:22 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/7e0642bf-a60d-4882-b7fb-38bbcdf69ee5/disk.rescue"/>
Aug 01 15:43:22 user nova-compute[72201]:       <target dev="vdb" bus="virtio"/>
Aug 01 15:43:22 user nova-compute[72201]:       <boot order="1"/>
Aug 01 15:43:22 user nova-compute[72201]:     </disk>
Aug 01 15:43:22 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:43:22 user nova-compute[72201]:       <mac address="fa:16:3e:92:e7:b2"/>
Aug 01 15:43:22 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:43:22 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:43:22 user nova-compute[72201]:       <target dev="tapfa130bf4-53"/>
Aug 01 15:43:22 user nova-compute[72201]:     </interface>
Aug 01 15:43:22 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:43:22 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/7e0642bf-a60d-4882-b7fb-38bbcdf69ee5/console.log" append="off"/>
Aug 01 15:43:22 user nova-compute[72201]:     </serial>
Aug 01 15:43:22 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:43:22 user nova-compute[72201]:     <video>
Aug 01 15:43:22 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:43:22 user nova-compute[72201]:     </video>
Aug 01 15:43:22 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:43:22 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:43:22 user nova-compute[72201]:     </rng>
Aug 01 15:43:22 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:43:22 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:43:22 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:43:22 user nova-compute[72201]:     </memballoon>
Aug 01 15:43:22 user nova-compute[72201]:   </devices>
Aug 01 15:43:22 user nova-compute[72201]: </domain>
Aug 01 15:43:22 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:43:22 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Instance destroyed successfully.
Aug 01 15:43:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] No VIF found with MAC fa:16:3e:92:e7:b2, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG nova.compute.manager [req-c4b4f696-64fb-4c2d-8f09-3ca944122a72 req-68f5cbf4-3014-4984-836f-1772b773cc0a service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received event network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c4b4f696-64fb-4c2d-8f09-3ca944122a72 req-68f5cbf4-3014-4984-836f-1772b773cc0a service nova] Acquiring lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c4b4f696-64fb-4c2d-8f09-3ca944122a72 req-68f5cbf4-3014-4984-836f-1772b773cc0a service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c4b4f696-64fb-4c2d-8f09-3ca944122a72 req-68f5cbf4-3014-4984-836f-1772b773cc0a service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:43:22 user nova-compute[72201]: DEBUG nova.compute.manager [req-c4b4f696-64fb-4c2d-8f09-3ca944122a72 req-68f5cbf4-3014-4984-836f-1772b773cc0a service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] No waiting events found dispatching network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:43:22 user nova-compute[72201]: WARNING nova.compute.manager [req-c4b4f696-64fb-4c2d-8f09-3ca944122a72 req-68f5cbf4-3014-4984-836f-1772b773cc0a service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received unexpected event network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 for instance with vm_state active and task_state rescuing.
Aug 01 15:43:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:24 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:43:24 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:43:24 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:43:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:43:24 user nova-compute[72201]: DEBUG nova.compute.manager [req-525873cb-76a4-45b4-aa20-037a8e09ec22 req-ee09d685-d5c1-4b07-a48a-b791504e5b3b service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received event network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:43:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-525873cb-76a4-45b4-aa20-037a8e09ec22 req-ee09d685-d5c1-4b07-a48a-b791504e5b3b service nova] Acquiring lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:43:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-525873cb-76a4-45b4-aa20-037a8e09ec22 req-ee09d685-d5c1-4b07-a48a-b791504e5b3b service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:43:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-525873cb-76a4-45b4-aa20-037a8e09ec22 req-ee09d685-d5c1-4b07-a48a-b791504e5b3b service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:43:24 user nova-compute[72201]: DEBUG nova.compute.manager [req-525873cb-76a4-45b4-aa20-037a8e09ec22 req-ee09d685-d5c1-4b07-a48a-b791504e5b3b service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] No waiting events found dispatching network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:43:24 user nova-compute[72201]: WARNING nova.compute.manager [req-525873cb-76a4-45b4-aa20-037a8e09ec22 req-ee09d685-d5c1-4b07-a48a-b791504e5b3b service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received unexpected event network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 for instance with vm_state active and task_state rescuing.
Aug 01 15:43:24 user nova-compute[72201]: DEBUG nova.compute.manager [req-525873cb-76a4-45b4-aa20-037a8e09ec22 req-ee09d685-d5c1-4b07-a48a-b791504e5b3b service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received event network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:43:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-525873cb-76a4-45b4-aa20-037a8e09ec22 req-ee09d685-d5c1-4b07-a48a-b791504e5b3b service nova] Acquiring lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:43:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-525873cb-76a4-45b4-aa20-037a8e09ec22 req-ee09d685-d5c1-4b07-a48a-b791504e5b3b service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:43:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-525873cb-76a4-45b4-aa20-037a8e09ec22 req-ee09d685-d5c1-4b07-a48a-b791504e5b3b service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:43:24 user nova-compute[72201]: DEBUG nova.compute.manager [req-525873cb-76a4-45b4-aa20-037a8e09ec22 req-ee09d685-d5c1-4b07-a48a-b791504e5b3b service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] No waiting events found dispatching network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:43:24 user nova-compute[72201]: WARNING nova.compute.manager [req-525873cb-76a4-45b4-aa20-037a8e09ec22 req-ee09d685-d5c1-4b07-a48a-b791504e5b3b service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received unexpected event network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 for instance with vm_state active and task_state rescuing.
Aug 01 15:43:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Removed pending event for 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 due to event {{(pid=72201) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 15:43:25 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904605.7695532, 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:43:25 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] VM Resumed (Lifecycle Event)
Aug 01 15:43:25 user nova-compute[72201]: DEBUG nova.compute.manager [None req-8c183f7c-f9ab-44e8-90ac-7b174711711a tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:43:25 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:43:25 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:43:25 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 15:43:25 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904605.775385, 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:43:25 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] VM Started (Lifecycle Event)
Aug 01 15:43:25 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:43:25 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:43:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:43:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:43:25 user nova-compute[72201]: INFO nova.compute.manager [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Detaching volume 23d0b2b9-f9ab-4038-affe-b876256fc682
Aug 01 15:43:26 user nova-compute[72201]: INFO nova.virt.block_device [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Attempting to driver detach volume 23d0b2b9-f9ab-4038-affe-b876256fc682 from mountpoint /dev/vdc
Aug 01 15:43:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Attempting to detach device vdc from instance d2fda4cb-e06e-4aad-9c8d-454eb8ed578d from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:43:26 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:43:26 user nova-compute[72201]:   <source dev="/dev/sdd"/>
Aug 01 15:43:26 user nova-compute[72201]:   <target dev="vdc" bus="virtio"/>
Aug 01 15:43:26 user nova-compute[72201]:   <serial>23d0b2b9-f9ab-4038-affe-b876256fc682</serial>
Aug 01 15:43:26 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 15:43:26 user nova-compute[72201]: </disk>
Aug 01 15:43:26 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:43:26 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Successfully detached device vdc from instance d2fda4cb-e06e-4aad-9c8d-454eb8ed578d from the persistent domain config.
Aug 01 15:43:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d2fda4cb-e06e-4aad-9c8d-454eb8ed578d from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:43:26 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:43:26 user nova-compute[72201]:   <source dev="/dev/sdd"/>
Aug 01 15:43:26 user nova-compute[72201]:   <target dev="vdc" bus="virtio"/>
Aug 01 15:43:26 user nova-compute[72201]:   <serial>23d0b2b9-f9ab-4038-affe-b876256fc682</serial>
Aug 01 15:43:26 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 15:43:26 user nova-compute[72201]: </disk>
Aug 01 15:43:26 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690904606.5124843, d2fda4cb-e06e-4aad-9c8d-454eb8ed578d => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d2fda4cb-e06e-4aad-9c8d-454eb8ed578d {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:43:26 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Successfully detached device vdc from instance d2fda4cb-e06e-4aad-9c8d-454eb8ed578d from the live domain config.
Aug 01 15:43:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ArsNcDfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:43:26 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:43:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecc3727-725c-4552-a74f-f02bf8a6b0d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed287d5f-8b73-401b-92f0-971c7ed0571d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:43:26 user nova-compute[72201]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 (non-flash)
Aug 01 15:43:26 user nova-compute[72201]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)
Aug 01 15:43:26 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:43:26 user nova-compute[72201]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 (non-flash)
Aug 01 15:43:26 user nova-compute[72201]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)
Aug 01 15:43:26 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c5164d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682'): ({'sdd'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Removing single pathed devices sdd {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff44b3d-1dcf-4d19-8dd9-33102144e769]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1752fe8d-8d19-4534-a5af-ddef660bdf3b]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Flushing IO for device /dev/sdd {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8da9b62-99a3-46fc-b2fd-fd9e4541e012]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b438dd0-402a-45ee-b3de-2de0f0e9a53e]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] SCSI volumes sdd have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.049s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3e7fb4-4f2a-4a2c-957e-c0020af5c81c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac5925b-a674-4296-996f-934b0477a4ab]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682, portal: 172.16.0.220,3260]
Aug 01 15:43:26 user nova-compute[72201]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682, portal: 172.16.0.220,3260] successful.
Aug 01 15:43:26 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d0b2b9-f9ab-4038-affe-b876256fc682 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[61770a51-89f8-446a-80b2-740d11d34cbc]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] <== disconnect_volume: return (327ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:43:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:43:27 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'flavor' on Instance uuid d2fda4cb-e06e-4aad-9c8d-454eb8ed578d {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:43:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ca38af20-9101-417a-81a1-7c4ec3416b36 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.830s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:43:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:43:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:44:11 user nova-compute[72201]: INFO nova.compute.manager [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Detaching volume a4bd1d23-73c6-42e5-9999-feac531e50b3
Aug 01 15:44:11 user nova-compute[72201]: INFO nova.virt.block_device [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Attempting to driver detach volume a4bd1d23-73c6-42e5-9999-feac531e50b3 from mountpoint /dev/vdb
Aug 01 15:44:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Attempting to detach device vdb from instance 801f5645-aff6-41ea-bb28-34e8dcacfe20 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:44:11 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:44:11 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 15:44:11 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:44:11 user nova-compute[72201]:   <serial>a4bd1d23-73c6-42e5-9999-feac531e50b3</serial>
Aug 01 15:44:11 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 15:44:11 user nova-compute[72201]: </disk>
Aug 01 15:44:11 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:44:11 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Successfully detached device vdb from instance 801f5645-aff6-41ea-bb28-34e8dcacfe20 from the persistent domain config.
Aug 01 15:44:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 801f5645-aff6-41ea-bb28-34e8dcacfe20 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:44:11 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:44:11 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 15:44:11 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:44:11 user nova-compute[72201]:   <serial>a4bd1d23-73c6-42e5-9999-feac531e50b3</serial>
Aug 01 15:44:11 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 15:44:11 user nova-compute[72201]: </disk>
Aug 01 15:44:11 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690904651.8798075, 801f5645-aff6-41ea-bb28-34e8dcacfe20 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:44:11 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Successfully detached device vdb from instance 801f5645-aff6-41ea-bb28-34e8dcacfe20 from the live domain config.
Aug 01 15:44:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkAfZxjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:44:11 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:44:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[161ba271-19e3-46e2-ac89-14db57adb2ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[427f4462-619a-4ef1-8cdc-3a60c6f1de25]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:44:11 user nova-compute[72201]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)
Aug 01 15:44:11 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:44:11 user nova-compute[72201]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 (non-flash)
Aug 01 15:44:11 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c13b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3'): ({'sdb'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Removing single pathed devices sdb {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0585f3a8-7966-451b-b8ba-bc337a0c9f5b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4207dc44-1126-43a9-ba9c-2c695bb097d0]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Flushing IO for device /dev/sdb {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c809f6-967b-4031-b1f7-d56646b206a2]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:44:11 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c6280f-408d-436e-bd26-3a242a1d09fd]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6118ae-3c5c-4c89-89cf-3868bbf1ca2d]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[649b1f0b-743a-42d5-8783-bebd7e43a815]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3, portal: 172.16.0.220,3260]
Aug 01 15:44:12 user nova-compute[72201]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3, portal: 172.16.0.220,3260] successful.
Aug 01 15:44:12 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4bd1d23-73c6-42e5-9999-feac531e50b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[52513525-7619-4ddd-8412-93683433d7dc]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] <== disconnect_volume: return (266ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'flavor' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:44:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a291a3bc-b68d-4a06-af6d-12aec363c69f tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.621s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:44:13 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:44:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:44:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:44:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:44:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:44:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eb5ddbe4-f32e-4a88-bed0-d56133f08af7 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:44:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eb5ddbe4-f32e-4a88-bed0-d56133f08af7 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:44:13 user nova-compute[72201]: DEBUG nova.compute.manager [None req-eb5ddbe4-f32e-4a88-bed0-d56133f08af7 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:44:13 user nova-compute[72201]: DEBUG nova.compute.manager [None req-eb5ddbe4-f32e-4a88-bed0-d56133f08af7 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72201) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 01 15:44:13 user nova-compute[72201]: DEBUG nova.objects.instance [None req-eb5ddbe4-f32e-4a88-bed0-d56133f08af7 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'flavor' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:44:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:14 user nova-compute[72201]: DEBUG nova.compute.manager [req-881ffc6f-7522-47b3-876e-b777663c7041 req-e861dabc-9d20-4086-9433-83273834dd89 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received event network-vif-unplugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:44:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-881ffc6f-7522-47b3-876e-b777663c7041 req-e861dabc-9d20-4086-9433-83273834dd89 service nova] Acquiring lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:44:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-881ffc6f-7522-47b3-876e-b777663c7041 req-e861dabc-9d20-4086-9433-83273834dd89 service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:44:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-881ffc6f-7522-47b3-876e-b777663c7041 req-e861dabc-9d20-4086-9433-83273834dd89 service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:44:14 user nova-compute[72201]: DEBUG nova.compute.manager [req-881ffc6f-7522-47b3-876e-b777663c7041 req-e861dabc-9d20-4086-9433-83273834dd89 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] No waiting events found dispatching network-vif-unplugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:44:14 user nova-compute[72201]: WARNING nova.compute.manager [req-881ffc6f-7522-47b3-876e-b777663c7041 req-e861dabc-9d20-4086-9433-83273834dd89 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received unexpected event network-vif-unplugged-1ad27823-4773-4b78-bbe0-1378855554c8 for instance with vm_state active and task_state powering-off.
Aug 01 15:44:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:14 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Instance destroyed successfully.
Aug 01 15:44:14 user nova-compute[72201]: DEBUG nova.compute.manager [None req-eb5ddbe4-f32e-4a88-bed0-d56133f08af7 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:44:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-eb5ddbe4-f32e-4a88-bed0-d56133f08af7 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.839s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:44:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-cedf29b2-e791-4eb4-9fe0-b740b1f8325e req-397f6dc4-d370-4600-a83c-dc2b0f046b73 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received event network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:44:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cedf29b2-e791-4eb4-9fe0-b740b1f8325e req-397f6dc4-d370-4600-a83c-dc2b0f046b73 service nova] Acquiring lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:44:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cedf29b2-e791-4eb4-9fe0-b740b1f8325e req-397f6dc4-d370-4600-a83c-dc2b0f046b73 service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:44:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cedf29b2-e791-4eb4-9fe0-b740b1f8325e req-397f6dc4-d370-4600-a83c-dc2b0f046b73 service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:44:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-cedf29b2-e791-4eb4-9fe0-b740b1f8325e req-397f6dc4-d370-4600-a83c-dc2b0f046b73 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] No waiting events found dispatching network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:44:16 user nova-compute[72201]: WARNING nova.compute.manager [req-cedf29b2-e791-4eb4-9fe0-b740b1f8325e req-397f6dc4-d370-4600-a83c-dc2b0f046b73 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received unexpected event network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 for instance with vm_state stopped and task_state None.
Aug 01 15:44:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:44:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:44:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:44:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:44:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:44:16 user nova-compute[72201]: INFO nova.compute.manager [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Terminating instance
Aug 01 15:44:16 user nova-compute[72201]: DEBUG nova.compute.manager [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:44:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-82d7e993-3f3d-401e-b3c8-6f1c6f51f75c req-c14eb595-1c73-4566-b29d-d8bd01e2a675 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Received event network-vif-unplugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:44:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-82d7e993-3f3d-401e-b3c8-6f1c6f51f75c req-c14eb595-1c73-4566-b29d-d8bd01e2a675 service nova] Acquiring lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:44:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-82d7e993-3f3d-401e-b3c8-6f1c6f51f75c req-c14eb595-1c73-4566-b29d-d8bd01e2a675 service nova] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:44:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-82d7e993-3f3d-401e-b3c8-6f1c6f51f75c req-c14eb595-1c73-4566-b29d-d8bd01e2a675 service nova] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:44:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-82d7e993-3f3d-401e-b3c8-6f1c6f51f75c req-c14eb595-1c73-4566-b29d-d8bd01e2a675 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] No waiting events found dispatching network-vif-unplugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:44:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-82d7e993-3f3d-401e-b3c8-6f1c6f51f75c req-c14eb595-1c73-4566-b29d-d8bd01e2a675 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Received event network-vif-unplugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:44:16 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Instance destroyed successfully.
Aug 01 15:44:16 user nova-compute[72201]: DEBUG nova.objects.instance [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'resources' on Instance uuid d2fda4cb-e06e-4aad-9c8d-454eb8ed578d {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:44:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T15:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1409369655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1409369655',id=37,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1UwRi2DLxVkCy7f6TeJOq3Esxx8EN67AgUIDTYqNjKiFyedgrt4A4GVJf/i9wFUBHnDxvju/m05DMK0cWUmOSdPmtX6heks7S/3CnY/EItVPiAFtvpneGJhC02WW+9gA==',key_name='tempest-keypair-348355751',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:41:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbe1b0601b564f789cbd45138114e95b',ramdisk_id='',reservation_id='r-fn43bruo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-858719582',owner_user_name='tempest-AttachVolumeShelveTestJSON-858719582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:41:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2caf51668cff454284097f6e91661c17',uuid=d2fda4cb-e06e-4aad-9c8d-454eb8ed578d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:44:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converting VIF {"id": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "address": "fa:16:3e:c6:69:03", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0dad7e0-1c", "ovs_interfaceid": "a0dad7e0-1c01-4c8f-abc1-72650c5390d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:44:17 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:69:03,bridge_name='br-int',has_traffic_filtering=True,id=a0dad7e0-1c01-4c8f-abc1-72650c5390d4,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0dad7e0-1c') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:44:17 user nova-compute[72201]: DEBUG os_vif [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:69:03,bridge_name='br-int',has_traffic_filtering=True,id=a0dad7e0-1c01-4c8f-abc1-72650c5390d4,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0dad7e0-1c') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:44:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0dad7e0-1c, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:44:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:44:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:17 user nova-compute[72201]: INFO os_vif [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:69:03,bridge_name='br-int',has_traffic_filtering=True,id=a0dad7e0-1c01-4c8f-abc1-72650c5390d4,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0dad7e0-1c')
Aug 01 15:44:17 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Deleting instance files /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d_del
Aug 01 15:44:17 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Deletion of /opt/stack/data/nova/instances/d2fda4cb-e06e-4aad-9c8d-454eb8ed578d_del complete
Aug 01 15:44:17 user nova-compute[72201]: INFO nova.compute.manager [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 01 15:44:17 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:44:17 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:44:17 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:44:17 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:44:17 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Took 0.87 seconds to deallocate network for instance.
Aug 01 15:44:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:44:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:44:18 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:44:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:44:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 15:44:18 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:44:18 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:44:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:44:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:44:18 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:44:18 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid f0743332-223f-4507-b8b1-40d63b7b5e80 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:44:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:44:18 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Deleted allocations for instance d2fda4cb-e06e-4aad-9c8d-454eb8ed578d
Aug 01 15:44:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7781fcf2-4895-4adf-9e68-fcb56914c28a tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.072s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:44:18 user nova-compute[72201]: DEBUG nova.compute.manager [req-a33e2ef3-0060-4e9f-acf4-860c6540a683 req-0e4abe4a-f759-44ff-b693-56087a8ef944 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Received event network-vif-plugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:44:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a33e2ef3-0060-4e9f-acf4-860c6540a683 req-0e4abe4a-f759-44ff-b693-56087a8ef944 service nova] Acquiring lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:44:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a33e2ef3-0060-4e9f-acf4-860c6540a683 req-0e4abe4a-f759-44ff-b693-56087a8ef944 service nova] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:44:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a33e2ef3-0060-4e9f-acf4-860c6540a683 req-0e4abe4a-f759-44ff-b693-56087a8ef944 service nova] Lock "d2fda4cb-e06e-4aad-9c8d-454eb8ed578d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:44:18 user nova-compute[72201]: DEBUG nova.compute.manager [req-a33e2ef3-0060-4e9f-acf4-860c6540a683 req-0e4abe4a-f759-44ff-b693-56087a8ef944 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] No waiting events found dispatching network-vif-plugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:44:18 user nova-compute[72201]: WARNING nova.compute.manager [req-a33e2ef3-0060-4e9f-acf4-860c6540a683 req-0e4abe4a-f759-44ff-b693-56087a8ef944 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Received unexpected event network-vif-plugged-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 for instance with vm_state deleted and task_state None.
Aug 01 15:44:18 user nova-compute[72201]: DEBUG nova.compute.manager [req-a33e2ef3-0060-4e9f-acf4-860c6540a683 req-0e4abe4a-f759-44ff-b693-56087a8ef944 service nova] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Received event network-vif-deleted-a0dad7e0-1c01-4c8f-abc1-72650c5390d4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:44:18 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Updating instance_info_cache with network_info: [{"id": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "address": "fa:16:3e:6a:5e:e0", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6062f511-71", "ovs_interfaceid": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:44:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:44:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:44:19 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:44:19 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:44:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:44:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:44:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:44:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:44:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:44:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:44:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:44:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:44:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:44:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:44:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:44:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:44:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:44:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0642bf-a60d-4882-b7fb-38bbcdf69ee5/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:44:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0642bf-a60d-4882-b7fb-38bbcdf69ee5/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:44:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0642bf-a60d-4882-b7fb-38bbcdf69ee5/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:44:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0642bf-a60d-4882-b7fb-38bbcdf69ee5/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:44:20 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:44:20 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:44:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8461MB free_disk=25.24917984008789GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:44:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:44:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:44:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f0743332-223f-4507-b8b1-40d63b7b5e80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:44:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 801f5645-aff6-41ea-bb28-34e8dcacfe20 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:44:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:44:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:44:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:44:20 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:44:20 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:44:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:44:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:44:21 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:44:21 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:44:21 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:44:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:22 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:44:24 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:44:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:44:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:44:27 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:44:29 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690904654.50966, 801f5645-aff6-41ea-bb28-34e8dcacfe20 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:44:29 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] VM Stopped (Lifecycle Event)
Aug 01 15:44:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-8c4adb6f-e6a5-40d3-a4b9-2dff3adcb953 None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:44:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-8c4adb6f-e6a5-40d3-a4b9-2dff3adcb953 None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:44:31 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690904656.9860427, d2fda4cb-e06e-4aad-9c8d-454eb8ed578d => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:44:31 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] VM Stopped (Lifecycle Event)
Aug 01 15:44:32 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4092f966-c130-4efd-aadc-fd0c6792a69b None None] [instance: d2fda4cb-e06e-4aad-9c8d-454eb8ed578d] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:44:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:44:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:44:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:44:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:44:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:44:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:44:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:44:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:44:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:44:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:44:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:44:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:45:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:45:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:45:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:45:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:45:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:09 user nova-compute[72201]: INFO nova.compute.manager [None req-9bd89dd9-a460-4f95-b39f-5382f06485ae tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Unrescuing
Aug 01 15:45:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9bd89dd9-a460-4f95-b39f-5382f06485ae tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:45:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9bd89dd9-a460-4f95-b39f-5382f06485ae tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquired lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:45:09 user nova-compute[72201]: DEBUG nova.network.neutron [None req-9bd89dd9-a460-4f95-b39f-5382f06485ae tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:45:09 user nova-compute[72201]: DEBUG nova.network.neutron [None req-9bd89dd9-a460-4f95-b39f-5382f06485ae tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Updating instance_info_cache with network_info: [{"id": "fa130bf4-53dc-43f7-8932-0aec318054d9", "address": "fa:16:3e:92:e7:b2", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa130bf4-53", "ovs_interfaceid": "fa130bf4-53dc-43f7-8932-0aec318054d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:45:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9bd89dd9-a460-4f95-b39f-5382f06485ae tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Releasing lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:45:09 user nova-compute[72201]: DEBUG nova.objects.instance [None req-9bd89dd9-a460-4f95-b39f-5382f06485ae tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'flavor' on Instance uuid 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:45:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:10 user nova-compute[72201]: DEBUG nova.compute.manager [req-d271039f-86f7-494e-a5ce-b3f1fc84001a req-a86bec94-13ac-465c-9762-a09a719608eb service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received event network-vif-unplugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:45:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d271039f-86f7-494e-a5ce-b3f1fc84001a req-a86bec94-13ac-465c-9762-a09a719608eb service nova] Acquiring lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:45:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d271039f-86f7-494e-a5ce-b3f1fc84001a req-a86bec94-13ac-465c-9762-a09a719608eb service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:45:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d271039f-86f7-494e-a5ce-b3f1fc84001a req-a86bec94-13ac-465c-9762-a09a719608eb service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:45:10 user nova-compute[72201]: DEBUG nova.compute.manager [req-d271039f-86f7-494e-a5ce-b3f1fc84001a req-a86bec94-13ac-465c-9762-a09a719608eb service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] No waiting events found dispatching network-vif-unplugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:45:10 user nova-compute[72201]: WARNING nova.compute.manager [req-d271039f-86f7-494e-a5ce-b3f1fc84001a req-a86bec94-13ac-465c-9762-a09a719608eb service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received unexpected event network-vif-unplugged-fa130bf4-53dc-43f7-8932-0aec318054d9 for instance with vm_state rescued and task_state unrescuing.
Aug 01 15:45:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:45:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:45:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:45:10 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Instance destroyed successfully.
Aug 01 15:45:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:45:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:45:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:45:10 user nova-compute[72201]: INFO nova.compute.claims [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Claim successful on node user
Aug 01 15:45:10 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:45:10 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:45:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.272s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:45:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:45:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:45:10 user nova-compute[72201]: DEBUG nova.network.neutron [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:45:10 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:45:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG nova.policy [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2caf51668cff454284097f6e91661c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe1b0601b564f789cbd45138114e95b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:45:11 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Creating image(s)
Aug 01 15:45:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "/opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "/opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.137s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk 1073741824" returned: 0 in 0.126s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG nova.network.neutron [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Successfully created port: 5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.178s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Cannot resize image /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG nova.objects.instance [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'migration_context' on Instance uuid c1120ed7-15d6-4c45-9949-4bf59be4c2c0 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Ensure instance console log exists: /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-2b9eb6cd-68f9-4f59-a328-0ceb646165eb req-0819685d-ab05-4b49-85d5-2004a99e5cb2 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received event network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2b9eb6cd-68f9-4f59-a328-0ceb646165eb req-0819685d-ab05-4b49-85d5-2004a99e5cb2 service nova] Acquiring lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2b9eb6cd-68f9-4f59-a328-0ceb646165eb req-0819685d-ab05-4b49-85d5-2004a99e5cb2 service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2b9eb6cd-68f9-4f59-a328-0ceb646165eb req-0819685d-ab05-4b49-85d5-2004a99e5cb2 service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-2b9eb6cd-68f9-4f59-a328-0ceb646165eb req-0819685d-ab05-4b49-85d5-2004a99e5cb2 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] No waiting events found dispatching network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:45:12 user nova-compute[72201]: WARNING nova.compute.manager [req-2b9eb6cd-68f9-4f59-a328-0ceb646165eb req-0819685d-ab05-4b49-85d5-2004a99e5cb2 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received unexpected event network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 for instance with vm_state rescued and task_state unrescuing.
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-2b9eb6cd-68f9-4f59-a328-0ceb646165eb req-0819685d-ab05-4b49-85d5-2004a99e5cb2 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received event network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2b9eb6cd-68f9-4f59-a328-0ceb646165eb req-0819685d-ab05-4b49-85d5-2004a99e5cb2 service nova] Acquiring lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2b9eb6cd-68f9-4f59-a328-0ceb646165eb req-0819685d-ab05-4b49-85d5-2004a99e5cb2 service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2b9eb6cd-68f9-4f59-a328-0ceb646165eb req-0819685d-ab05-4b49-85d5-2004a99e5cb2 service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-2b9eb6cd-68f9-4f59-a328-0ceb646165eb req-0819685d-ab05-4b49-85d5-2004a99e5cb2 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] No waiting events found dispatching network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:45:12 user nova-compute[72201]: WARNING nova.compute.manager [req-2b9eb6cd-68f9-4f59-a328-0ceb646165eb req-0819685d-ab05-4b49-85d5-2004a99e5cb2 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received unexpected event network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 for instance with vm_state rescued and task_state unrescuing.
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.network.neutron [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Successfully updated port: 5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "refresh_cache-c1120ed7-15d6-4c45-9949-4bf59be4c2c0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquired lock "refresh_cache-c1120ed7-15d6-4c45-9949-4bf59be4c2c0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.network.neutron [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-e024602b-af95-4eb5-8fe1-0ddd25f11dd5 req-82b1a04a-fbb0-4b70-b44f-b814bd9173e9 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Received event network-changed-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-e024602b-af95-4eb5-8fe1-0ddd25f11dd5 req-82b1a04a-fbb0-4b70-b44f-b814bd9173e9 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Refreshing instance network info cache due to event network-changed-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e024602b-af95-4eb5-8fe1-0ddd25f11dd5 req-82b1a04a-fbb0-4b70-b44f-b814bd9173e9 service nova] Acquiring lock "refresh_cache-c1120ed7-15d6-4c45-9949-4bf59be4c2c0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.network.neutron [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.network.neutron [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Updating instance_info_cache with network_info: [{"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Releasing lock "refresh_cache-c1120ed7-15d6-4c45-9949-4bf59be4c2c0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Instance network_info: |[{"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e024602b-af95-4eb5-8fe1-0ddd25f11dd5 req-82b1a04a-fbb0-4b70-b44f-b814bd9173e9 service nova] Acquired lock "refresh_cache-c1120ed7-15d6-4c45-9949-4bf59be4c2c0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.network.neutron [req-e024602b-af95-4eb5-8fe1-0ddd25f11dd5 req-82b1a04a-fbb0-4b70-b44f-b814bd9173e9 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Refreshing network info cache for port 5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Start _get_guest_xml network_info=[{"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:45:12 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:45:12 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-21922150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-21922150',id=40,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQ7fCan9R/LO3/o5uRQNerNLwjF3c0FjKZQZ6wJkoAlnRCkjfKf7HrcJXA0edFSt/4HZ6yiyiLzvckXXuRRY9eKAx2iUqC+q3sOcLS8IYNO4r3rCdUoFv23o2p1n0gcFQ==',key_name='tempest-keypair-2143760373',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbe1b0601b564f789cbd45138114e95b',ramdisk_id='',reservation_id='r-48jtcvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-858719582',owner_user_name='tempest-AttachVolumeShelveTestJSON-858719582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2caf51668cff454284097f6e91661c17',uuid=c1120ed7-15d6-4c45-9949-4bf59be4c2c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converting VIF {"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:8b:2d,bridge_name='br-int',has_traffic_filtering=True,id=5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4c3a15-35') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.objects.instance [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'pci_devices' on Instance uuid c1120ed7-15d6-4c45-9949-4bf59be4c2c0 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:45:12 user nova-compute[72201]:   <uuid>c1120ed7-15d6-4c45-9949-4bf59be4c2c0</uuid>
Aug 01 15:45:12 user nova-compute[72201]:   <name>instance-00000028</name>
Aug 01 15:45:12 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:45:12 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:45:12 user nova-compute[72201]:   <metadata>
Aug 01 15:45:12 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:45:12 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:45:12 user nova-compute[72201]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-21922150</nova:name>
Aug 01 15:45:12 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:45:12</nova:creationTime>
Aug 01 15:45:12 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:45:12 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:45:12 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:45:12 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:45:12 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:45:12 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:45:12 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:45:12 user nova-compute[72201]:       <nova:owner>
Aug 01 15:45:12 user nova-compute[72201]:         <nova:user uuid="2caf51668cff454284097f6e91661c17">tempest-AttachVolumeShelveTestJSON-858719582-project-member</nova:user>
Aug 01 15:45:12 user nova-compute[72201]:         <nova:project uuid="fbe1b0601b564f789cbd45138114e95b">tempest-AttachVolumeShelveTestJSON-858719582</nova:project>
Aug 01 15:45:12 user nova-compute[72201]:       </nova:owner>
Aug 01 15:45:12 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:45:12 user nova-compute[72201]:       <nova:ports>
Aug 01 15:45:12 user nova-compute[72201]:         <nova:port uuid="5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a">
Aug 01 15:45:12 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 15:45:12 user nova-compute[72201]:         </nova:port>
Aug 01 15:45:12 user nova-compute[72201]:       </nova:ports>
Aug 01 15:45:12 user nova-compute[72201]:     </nova:instance>
Aug 01 15:45:12 user nova-compute[72201]:   </metadata>
Aug 01 15:45:12 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:45:12 user nova-compute[72201]:     <system>
Aug 01 15:45:12 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:45:12 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:45:12 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:45:12 user nova-compute[72201]:       <entry name="serial">c1120ed7-15d6-4c45-9949-4bf59be4c2c0</entry>
Aug 01 15:45:12 user nova-compute[72201]:       <entry name="uuid">c1120ed7-15d6-4c45-9949-4bf59be4c2c0</entry>
Aug 01 15:45:12 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:45:12 user nova-compute[72201]:     </system>
Aug 01 15:45:12 user nova-compute[72201]:   </sysinfo>
Aug 01 15:45:12 user nova-compute[72201]:   <os>
Aug 01 15:45:12 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:45:12 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:45:12 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:45:12 user nova-compute[72201]:   </os>
Aug 01 15:45:12 user nova-compute[72201]:   <features>
Aug 01 15:45:12 user nova-compute[72201]:     <acpi/>
Aug 01 15:45:12 user nova-compute[72201]:     <apic/>
Aug 01 15:45:12 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:45:12 user nova-compute[72201]:   </features>
Aug 01 15:45:12 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:45:12 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:45:12 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:45:12 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:45:12 user nova-compute[72201]:   </clock>
Aug 01 15:45:12 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:45:12 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:45:12 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:45:12 user nova-compute[72201]:   </cpu>
Aug 01 15:45:12 user nova-compute[72201]:   <devices>
Aug 01 15:45:12 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:45:12 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:45:12 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk"/>
Aug 01 15:45:12 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:45:12 user nova-compute[72201]:     </disk>
Aug 01 15:45:12 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:45:12 user nova-compute[72201]:       <mac address="fa:16:3e:57:8b:2d"/>
Aug 01 15:45:12 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:45:12 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:45:12 user nova-compute[72201]:       <target dev="tap5e4c3a15-35"/>
Aug 01 15:45:12 user nova-compute[72201]:     </interface>
Aug 01 15:45:12 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:45:12 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/console.log" append="off"/>
Aug 01 15:45:12 user nova-compute[72201]:     </serial>
Aug 01 15:45:12 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:45:12 user nova-compute[72201]:     <video>
Aug 01 15:45:12 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:45:12 user nova-compute[72201]:     </video>
Aug 01 15:45:12 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:45:12 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:45:12 user nova-compute[72201]:     </rng>
Aug 01 15:45:12 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:45:12 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:45:12 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:45:12 user nova-compute[72201]:     </memballoon>
Aug 01 15:45:12 user nova-compute[72201]:   </devices>
Aug 01 15:45:12 user nova-compute[72201]: </domain>
Aug 01 15:45:12 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-21922150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-21922150',id=40,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQ7fCan9R/LO3/o5uRQNerNLwjF3c0FjKZQZ6wJkoAlnRCkjfKf7HrcJXA0edFSt/4HZ6yiyiLzvckXXuRRY9eKAx2iUqC+q3sOcLS8IYNO4r3rCdUoFv23o2p1n0gcFQ==',key_name='tempest-keypair-2143760373',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbe1b0601b564f789cbd45138114e95b',ramdisk_id='',reservation_id='r-48jtcvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-858719582',owner_user_name='tempest-AttachVolumeShelveTestJSON-858719582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2caf51668cff454284097f6e91661c17',uuid=c1120ed7-15d6-4c45-9949-4bf59be4c2c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converting VIF {"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:8b:2d,bridge_name='br-int',has_traffic_filtering=True,id=5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4c3a15-35') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG os_vif [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:8b:2d,bridge_name='br-int',has_traffic_filtering=True,id=5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4c3a15-35') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e4c3a15-35, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e4c3a15-35, col_values=(('external_ids', {'iface-id': '5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:8b:2d', 'vm-uuid': 'c1120ed7-15d6-4c45-9949-4bf59be4c2c0'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:45:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:12 user nova-compute[72201]: INFO os_vif [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:8b:2d,bridge_name='br-int',has_traffic_filtering=True,id=5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4c3a15-35')
Aug 01 15:45:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:45:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] No VIF found with MAC fa:16:3e:57:8b:2d, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:45:13 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:45:13 user nova-compute[72201]: DEBUG nova.network.neutron [req-e024602b-af95-4eb5-8fe1-0ddd25f11dd5 req-82b1a04a-fbb0-4b70-b44f-b814bd9173e9 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Updated VIF entry in instance network info cache for port 5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:45:13 user nova-compute[72201]: DEBUG nova.network.neutron [req-e024602b-af95-4eb5-8fe1-0ddd25f11dd5 req-82b1a04a-fbb0-4b70-b44f-b814bd9173e9 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Updating instance_info_cache with network_info: [{"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:45:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e024602b-af95-4eb5-8fe1-0ddd25f11dd5 req-82b1a04a-fbb0-4b70-b44f-b814bd9173e9 service nova] Releasing lock "refresh_cache-c1120ed7-15d6-4c45-9949-4bf59be4c2c0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:45:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Removed pending event for 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 due to event {{(pid=72201) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 15:45:14 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904714.0282774, 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:45:14 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] VM Resumed (Lifecycle Event)
Aug 01 15:45:14 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9bd89dd9-a460-4f95-b39f-5382f06485ae tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:45:14 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:45:14 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:45:14 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 15:45:14 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904714.0295386, 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:45:14 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] VM Started (Lifecycle Event)
Aug 01 15:45:14 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:45:14 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:45:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:14 user nova-compute[72201]: DEBUG nova.compute.manager [req-e40664f6-1e72-4748-861e-32886c7a9aa5 req-ee4f91a2-4d1f-404b-8c2b-7c3032ebc1fe service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received event network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:45:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e40664f6-1e72-4748-861e-32886c7a9aa5 req-ee4f91a2-4d1f-404b-8c2b-7c3032ebc1fe service nova] Acquiring lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:45:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e40664f6-1e72-4748-861e-32886c7a9aa5 req-ee4f91a2-4d1f-404b-8c2b-7c3032ebc1fe service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:45:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e40664f6-1e72-4748-861e-32886c7a9aa5 req-ee4f91a2-4d1f-404b-8c2b-7c3032ebc1fe service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:45:14 user nova-compute[72201]: DEBUG nova.compute.manager [req-e40664f6-1e72-4748-861e-32886c7a9aa5 req-ee4f91a2-4d1f-404b-8c2b-7c3032ebc1fe service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] No waiting events found dispatching network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:45:14 user nova-compute[72201]: WARNING nova.compute.manager [req-e40664f6-1e72-4748-861e-32886c7a9aa5 req-ee4f91a2-4d1f-404b-8c2b-7c3032ebc1fe service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received unexpected event network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 for instance with vm_state active and task_state None.
Aug 01 15:45:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-6dee521a-9485-468f-b107-199cb4d1f456 req-7fdf481c-0c04-4d37-b64a-de9cb8bb72db service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Received event network-vif-plugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:45:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6dee521a-9485-468f-b107-199cb4d1f456 req-7fdf481c-0c04-4d37-b64a-de9cb8bb72db service nova] Acquiring lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:45:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6dee521a-9485-468f-b107-199cb4d1f456 req-7fdf481c-0c04-4d37-b64a-de9cb8bb72db service nova] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:45:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6dee521a-9485-468f-b107-199cb4d1f456 req-7fdf481c-0c04-4d37-b64a-de9cb8bb72db service nova] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:45:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-6dee521a-9485-468f-b107-199cb4d1f456 req-7fdf481c-0c04-4d37-b64a-de9cb8bb72db service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] No waiting events found dispatching network-vif-plugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:45:16 user nova-compute[72201]: WARNING nova.compute.manager [req-6dee521a-9485-468f-b107-199cb4d1f456 req-7fdf481c-0c04-4d37-b64a-de9cb8bb72db service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Received unexpected event network-vif-plugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a for instance with vm_state building and task_state spawning.
Aug 01 15:45:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-6dee521a-9485-468f-b107-199cb4d1f456 req-7fdf481c-0c04-4d37-b64a-de9cb8bb72db service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Received event network-vif-plugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:45:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6dee521a-9485-468f-b107-199cb4d1f456 req-7fdf481c-0c04-4d37-b64a-de9cb8bb72db service nova] Acquiring lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:45:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6dee521a-9485-468f-b107-199cb4d1f456 req-7fdf481c-0c04-4d37-b64a-de9cb8bb72db service nova] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:45:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6dee521a-9485-468f-b107-199cb4d1f456 req-7fdf481c-0c04-4d37-b64a-de9cb8bb72db service nova] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:45:16 user nova-compute[72201]: DEBUG nova.compute.manager [req-6dee521a-9485-468f-b107-199cb4d1f456 req-7fdf481c-0c04-4d37-b64a-de9cb8bb72db service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] No waiting events found dispatching network-vif-plugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:45:16 user nova-compute[72201]: WARNING nova.compute.manager [req-6dee521a-9485-468f-b107-199cb4d1f456 req-7fdf481c-0c04-4d37-b64a-de9cb8bb72db service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Received unexpected event network-vif-plugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a for instance with vm_state building and task_state spawning.
Aug 01 15:45:16 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904716.4809017, c1120ed7-15d6-4c45-9949-4bf59be4c2c0 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:45:16 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] VM Resumed (Lifecycle Event)
Aug 01 15:45:16 user nova-compute[72201]: DEBUG nova.compute.manager [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:45:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:45:16 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Instance spawned successfully.
Aug 01 15:45:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:45:16 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:45:16 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:45:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:45:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:45:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:45:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:45:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:45:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:45:16 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:45:16 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904716.4837286, c1120ed7-15d6-4c45-9949-4bf59be4c2c0 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:45:16 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] VM Started (Lifecycle Event)
Aug 01 15:45:16 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:45:16 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:45:16 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:45:16 user nova-compute[72201]: INFO nova.compute.manager [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Took 5.49 seconds to spawn the instance on the hypervisor.
Aug 01 15:45:16 user nova-compute[72201]: DEBUG nova.compute.manager [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:45:16 user nova-compute[72201]: INFO nova.compute.manager [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Took 6.09 seconds to build instance.
Aug 01 15:45:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2fc954b8-a6fb-4116-904c-5b6c81138546 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.355s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:45:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:19 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:45:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:45:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:45:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:45:19 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:45:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:45:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:45:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:45:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:45:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:45:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:45:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:45:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:45:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:45:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:45:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:45:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:45:20 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:45:20 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:45:20 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:45:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8579MB free_disk=25.246692657470703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:45:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:45:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:45:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f0743332-223f-4507-b8b1-40d63b7b5e80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:45:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 801f5645-aff6-41ea-bb28-34e8dcacfe20 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:45:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:45:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance c1120ed7-15d6-4c45-9949-4bf59be4c2c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:45:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:45:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:45:20 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:45:20 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:45:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:45:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:45:21 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:45:21 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:45:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:45:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-801f5645-aff6-41ea-bb28-34e8dcacfe20" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:45:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-801f5645-aff6-41ea-bb28-34e8dcacfe20" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:45:21 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:45:22 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Updating instance_info_cache with network_info: [{"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:45:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-801f5645-aff6-41ea-bb28-34e8dcacfe20" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:45:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:45:22 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:45:22 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:45:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:23 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:45:24 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:45:26 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:45:26 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:45:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:45:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:45:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:45:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:45:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:45:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:45:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:45:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:46:04 user nova-compute[72201]: DEBUG nova.objects.instance [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'flavor' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:46:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "refresh_cache-801f5645-aff6-41ea-bb28-34e8dcacfe20" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:46:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquired lock "refresh_cache-801f5645-aff6-41ea-bb28-34e8dcacfe20" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:46:04 user nova-compute[72201]: DEBUG nova.network.neutron [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:46:04 user nova-compute[72201]: DEBUG nova.objects.instance [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'info_cache' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:46:04 user nova-compute[72201]: DEBUG nova.network.neutron [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Updating instance_info_cache with network_info: [{"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:46:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Releasing lock "refresh_cache-801f5645-aff6-41ea-bb28-34e8dcacfe20" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:46:04 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Instance destroyed successfully.
Aug 01 15:46:04 user nova-compute[72201]: DEBUG nova.objects.instance [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'resources' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:46:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1438545025',display_name='tempest-AttachVolumeTestJSON-server-1438545025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1438545025',id=38,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5sTybeqRu+KrWZIs2Qy17OX/PCK/I5EFDxt6til1PIQ3CSrY0rgKAekgLbUup6BgzQOCUtfNIUY2C5P7VWdfbkUmmeezeVSiWHDBAhmzUEyBhfgdTIHXtComrkv3PWWQ==',key_name='tempest-keypair-634092699',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:38:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1b9978ab74a743b6870f1a86469debb4',ramdisk_id='',reservation_id='r-k1ayhqoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-570587534',owner_user_name='tempest-AttachVolumeTestJSON-570587534-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:44:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='243e1aae552d43b7b892618022460e1b',uuid=801f5645-aff6-41ea-bb28-34e8dcacfe20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:46:04 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converting VIF {"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:46:04 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:d3:89,bridge_name='br-int',has_traffic_filtering=True,id=1ad27823-4773-4b78-bbe0-1378855554c8,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad27823-47') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:46:04 user nova-compute[72201]: DEBUG os_vif [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:d3:89,bridge_name='br-int',has_traffic_filtering=True,id=1ad27823-4773-4b78-bbe0-1378855554c8,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad27823-47') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ad27823-47, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:46:05 user nova-compute[72201]: INFO os_vif [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:d3:89,bridge_name='br-int',has_traffic_filtering=True,id=1ad27823-4773-4b78-bbe0-1378855554c8,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad27823-47')
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Start _get_guest_xml network_info=[{"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.objects.instance [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'numa_topology' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:46:05 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:46:05 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.objects.instance [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'vcpu_model' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1438545025',display_name='tempest-AttachVolumeTestJSON-server-1438545025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1438545025',id=38,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5sTybeqRu+KrWZIs2Qy17OX/PCK/I5EFDxt6til1PIQ3CSrY0rgKAekgLbUup6BgzQOCUtfNIUY2C5P7VWdfbkUmmeezeVSiWHDBAhmzUEyBhfgdTIHXtComrkv3PWWQ==',key_name='tempest-keypair-634092699',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:38:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1b9978ab74a743b6870f1a86469debb4',ramdisk_id='',reservation_id='r-k1ayhqoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-570587534',owner_user_name='tempest-AttachVolumeTestJSON-570587534-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:44:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='243e1aae552d43b7b892618022460e1b',uuid=801f5645-aff6-41ea-bb28-34e8dcacfe20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converting VIF {"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:d3:89,bridge_name='br-int',has_traffic_filtering=True,id=1ad27823-4773-4b78-bbe0-1378855554c8,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad27823-47') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.objects.instance [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'pci_devices' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:46:05 user nova-compute[72201]:   <uuid>801f5645-aff6-41ea-bb28-34e8dcacfe20</uuid>
Aug 01 15:46:05 user nova-compute[72201]:   <name>instance-00000026</name>
Aug 01 15:46:05 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:46:05 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:46:05 user nova-compute[72201]:   <metadata>
Aug 01 15:46:05 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:46:05 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:46:05 user nova-compute[72201]:       <nova:name>tempest-AttachVolumeTestJSON-server-1438545025</nova:name>
Aug 01 15:46:05 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:46:05</nova:creationTime>
Aug 01 15:46:05 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:46:05 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:46:05 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:46:05 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:46:05 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:46:05 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:46:05 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:46:05 user nova-compute[72201]:       <nova:owner>
Aug 01 15:46:05 user nova-compute[72201]:         <nova:user uuid="243e1aae552d43b7b892618022460e1b">tempest-AttachVolumeTestJSON-570587534-project-member</nova:user>
Aug 01 15:46:05 user nova-compute[72201]:         <nova:project uuid="1b9978ab74a743b6870f1a86469debb4">tempest-AttachVolumeTestJSON-570587534</nova:project>
Aug 01 15:46:05 user nova-compute[72201]:       </nova:owner>
Aug 01 15:46:05 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:46:05 user nova-compute[72201]:       <nova:ports>
Aug 01 15:46:05 user nova-compute[72201]:         <nova:port uuid="1ad27823-4773-4b78-bbe0-1378855554c8">
Aug 01 15:46:05 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 15:46:05 user nova-compute[72201]:         </nova:port>
Aug 01 15:46:05 user nova-compute[72201]:       </nova:ports>
Aug 01 15:46:05 user nova-compute[72201]:     </nova:instance>
Aug 01 15:46:05 user nova-compute[72201]:   </metadata>
Aug 01 15:46:05 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:46:05 user nova-compute[72201]:     <system>
Aug 01 15:46:05 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:46:05 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:46:05 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:46:05 user nova-compute[72201]:       <entry name="serial">801f5645-aff6-41ea-bb28-34e8dcacfe20</entry>
Aug 01 15:46:05 user nova-compute[72201]:       <entry name="uuid">801f5645-aff6-41ea-bb28-34e8dcacfe20</entry>
Aug 01 15:46:05 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:46:05 user nova-compute[72201]:     </system>
Aug 01 15:46:05 user nova-compute[72201]:   </sysinfo>
Aug 01 15:46:05 user nova-compute[72201]:   <os>
Aug 01 15:46:05 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:46:05 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:46:05 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:46:05 user nova-compute[72201]:   </os>
Aug 01 15:46:05 user nova-compute[72201]:   <features>
Aug 01 15:46:05 user nova-compute[72201]:     <acpi/>
Aug 01 15:46:05 user nova-compute[72201]:     <apic/>
Aug 01 15:46:05 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:46:05 user nova-compute[72201]:   </features>
Aug 01 15:46:05 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:46:05 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:46:05 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:46:05 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:46:05 user nova-compute[72201]:   </clock>
Aug 01 15:46:05 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:46:05 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:46:05 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:46:05 user nova-compute[72201]:   </cpu>
Aug 01 15:46:05 user nova-compute[72201]:   <devices>
Aug 01 15:46:05 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:46:05 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:46:05 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk"/>
Aug 01 15:46:05 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:46:05 user nova-compute[72201]:     </disk>
Aug 01 15:46:05 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:46:05 user nova-compute[72201]:       <mac address="fa:16:3e:f7:d3:89"/>
Aug 01 15:46:05 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:46:05 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:46:05 user nova-compute[72201]:       <target dev="tap1ad27823-47"/>
Aug 01 15:46:05 user nova-compute[72201]:     </interface>
Aug 01 15:46:05 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:46:05 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/console.log" append="off"/>
Aug 01 15:46:05 user nova-compute[72201]:     </serial>
Aug 01 15:46:05 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:46:05 user nova-compute[72201]:     <video>
Aug 01 15:46:05 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:46:05 user nova-compute[72201]:     </video>
Aug 01 15:46:05 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:46:05 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:46:05 user nova-compute[72201]:     </rng>
Aug 01 15:46:05 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:46:05 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:46:05 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:46:05 user nova-compute[72201]:     </memballoon>
Aug 01 15:46:05 user nova-compute[72201]:   </devices>
Aug 01 15:46:05 user nova-compute[72201]: </domain>
Aug 01 15:46:05 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.objects.instance [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'trusted_certs' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Checking if we can resize image /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Cannot resize image /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.objects.instance [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'migration_context' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1438545025',display_name='tempest-AttachVolumeTestJSON-server-1438545025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1438545025',id=38,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5sTybeqRu+KrWZIs2Qy17OX/PCK/I5EFDxt6til1PIQ3CSrY0rgKAekgLbUup6BgzQOCUtfNIUY2C5P7VWdfbkUmmeezeVSiWHDBAhmzUEyBhfgdTIHXtComrkv3PWWQ==',key_name='tempest-keypair-634092699',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:38:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='1b9978ab74a743b6870f1a86469debb4',ramdisk_id='',reservation_id='r-k1ayhqoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-570587534',owner_user_name='tempest-AttachVolumeTestJSON-570587534-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:44:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='243e1aae552d43b7b892618022460e1b',uuid=801f5645-aff6-41ea-bb28-34e8dcacfe20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converting VIF {"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:d3:89,bridge_name='br-int',has_traffic_filtering=True,id=1ad27823-4773-4b78-bbe0-1378855554c8,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad27823-47') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG os_vif [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:d3:89,bridge_name='br-int',has_traffic_filtering=True,id=1ad27823-4773-4b78-bbe0-1378855554c8,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad27823-47') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ad27823-47, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ad27823-47, col_values=(('external_ids', {'iface-id': '1ad27823-4773-4b78-bbe0-1378855554c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:d3:89', 'vm-uuid': '801f5645-aff6-41ea-bb28-34e8dcacfe20'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:46:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:05 user nova-compute[72201]: INFO os_vif [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:d3:89,bridge_name='br-int',has_traffic_filtering=True,id=1ad27823-4773-4b78-bbe0-1378855554c8,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad27823-47')
Aug 01 15:46:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-de68fc97-b612-4606-bd0b-18208947ec5d req-addf3417-e1b8-4ef6-908d-37f276d58380 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received event network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:46:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-de68fc97-b612-4606-bd0b-18208947ec5d req-addf3417-e1b8-4ef6-908d-37f276d58380 service nova] Acquiring lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:46:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-de68fc97-b612-4606-bd0b-18208947ec5d req-addf3417-e1b8-4ef6-908d-37f276d58380 service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:46:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-de68fc97-b612-4606-bd0b-18208947ec5d req-addf3417-e1b8-4ef6-908d-37f276d58380 service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:46:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-de68fc97-b612-4606-bd0b-18208947ec5d req-addf3417-e1b8-4ef6-908d-37f276d58380 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] No waiting events found dispatching network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:46:07 user nova-compute[72201]: WARNING nova.compute.manager [req-de68fc97-b612-4606-bd0b-18208947ec5d req-addf3417-e1b8-4ef6-908d-37f276d58380 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received unexpected event network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 for instance with vm_state stopped and task_state powering-on.
Aug 01 15:46:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:46:09 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904769.1121652, 801f5645-aff6-41ea-bb28-34e8dcacfe20 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:46:09 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] VM Resumed (Lifecycle Event)
Aug 01 15:46:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:46:09 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Instance rebooted successfully.
Aug 01 15:46:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-26ee9705-484c-4456-96d0-8294100b23b8 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:46:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:46:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:46:09 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 01 15:46:09 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904769.1135428, 801f5645-aff6-41ea-bb28-34e8dcacfe20 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:46:09 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] VM Started (Lifecycle Event)
Aug 01 15:46:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:46:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:46:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-57f0db73-e354-4eec-96c0-baf991cca863 req-0cceab60-9381-44d0-ad06-979498c71110 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received event network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:46:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-57f0db73-e354-4eec-96c0-baf991cca863 req-0cceab60-9381-44d0-ad06-979498c71110 service nova] Acquiring lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:46:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-57f0db73-e354-4eec-96c0-baf991cca863 req-0cceab60-9381-44d0-ad06-979498c71110 service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:46:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-57f0db73-e354-4eec-96c0-baf991cca863 req-0cceab60-9381-44d0-ad06-979498c71110 service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:46:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-57f0db73-e354-4eec-96c0-baf991cca863 req-0cceab60-9381-44d0-ad06-979498c71110 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] No waiting events found dispatching network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:46:09 user nova-compute[72201]: WARNING nova.compute.manager [req-57f0db73-e354-4eec-96c0-baf991cca863 req-0cceab60-9381-44d0-ad06-979498c71110 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received unexpected event network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 for instance with vm_state active and task_state None.
Aug 01 15:46:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:13 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:46:13 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:46:13 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72201) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 15:46:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:20 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:46:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:46:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:46:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:46:20 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:46:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:46:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:46:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:46:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:46:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:46:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:46:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:46:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:46:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:46:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:46:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:46:20 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:46:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:46:21 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:46:21 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:46:21 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:46:21 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8477MB free_disk=25.217529296875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:46:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:46:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:46:21 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f0743332-223f-4507-b8b1-40d63b7b5e80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:46:21 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 801f5645-aff6-41ea-bb28-34e8dcacfe20 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:46:21 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:46:21 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance c1120ed7-15d6-4c45-9949-4bf59be4c2c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:46:21 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:46:21 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:46:21 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing inventories for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 15:46:21 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating ProviderTree inventory for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 15:46:21 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating inventory in ProviderTree for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 15:46:21 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing aggregate associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, aggregates: None {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 15:46:21 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing trait associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 15:46:21 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:46:21 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:46:21 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:46:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:46:22 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:46:22 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:46:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:46:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:46:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:46:23 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:46:23 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Updating instance_info_cache with network_info: [{"id": "fa130bf4-53dc-43f7-8932-0aec318054d9", "address": "fa:16:3e:92:e7:b2", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa130bf4-53", "ovs_interfaceid": "fa130bf4-53dc-43f7-8932-0aec318054d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:46:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:46:23 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:46:23 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:46:23 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:46:23 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:46:23 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:46:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:26 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:46:26 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:46:26 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:46:29 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:46:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:39 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:46:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 15:46:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] There are 0 instances to clean {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 15:46:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:43 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:46:43 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid f0743332-223f-4507-b8b1-40d63b7b5e80 {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:46:43 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:46:43 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:46:43 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid c1120ed7-15d6-4c45-9949-4bf59be4c2c0 {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:46:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "f0743332-223f-4507-b8b1-40d63b7b5e80" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:46:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:46:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:46:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:46:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:46:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:46:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:46:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:46:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:46:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:46:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:46:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:46:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:46:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:47:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "e4f06d05-b05a-459c-9a44-0af858b2570d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:47:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "e4f06d05-b05a-459c-9a44-0af858b2570d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:47:01 user nova-compute[72201]: DEBUG nova.compute.manager [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:47:02 user nova-compute[72201]: INFO nova.compute.claims [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Claim successful on node user
Aug 01 15:47:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-d35faa1e-9d09-42d9-b5e8-cf0446d60756 req-66f254ae-e28e-4868-9b49-0545663cce55 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Received event network-changed-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-d35faa1e-9d09-42d9-b5e8-cf0446d60756 req-66f254ae-e28e-4868-9b49-0545663cce55 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Refreshing instance network info cache due to event network-changed-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d35faa1e-9d09-42d9-b5e8-cf0446d60756 req-66f254ae-e28e-4868-9b49-0545663cce55 service nova] Acquiring lock "refresh_cache-c1120ed7-15d6-4c45-9949-4bf59be4c2c0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d35faa1e-9d09-42d9-b5e8-cf0446d60756 req-66f254ae-e28e-4868-9b49-0545663cce55 service nova] Acquired lock "refresh_cache-c1120ed7-15d6-4c45-9949-4bf59be4c2c0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG nova.network.neutron [req-d35faa1e-9d09-42d9-b5e8-cf0446d60756 req-66f254ae-e28e-4868-9b49-0545663cce55 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Refreshing network info cache for port 5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG nova.compute.manager [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG nova.compute.manager [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG nova.network.neutron [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:47:02 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:47:02 user nova-compute[72201]: DEBUG nova.compute.manager [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG nova.compute.manager [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:47:02 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Creating image(s)
Aug 01 15:47:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "/opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "/opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG nova.policy [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75b0cb34dac64c61a235470454e0c6bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed7463cb6f84c4a8cf1ef0437eca988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG nova.network.neutron [req-d35faa1e-9d09-42d9-b5e8-cf0446d60756 req-66f254ae-e28e-4868-9b49-0545663cce55 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Updated VIF entry in instance network info cache for port 5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG nova.network.neutron [req-d35faa1e-9d09-42d9-b5e8-cf0446d60756 req-66f254ae-e28e-4868-9b49-0545663cce55 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Updating instance_info_cache with network_info: [{"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.154s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d35faa1e-9d09-42d9-b5e8-cf0446d60756 req-66f254ae-e28e-4868-9b49-0545663cce55 service nova] Releasing lock "refresh_cache-c1120ed7-15d6-4c45-9949-4bf59be4c2c0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.145s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk 1073741824" returned: 0 in 0.052s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:47:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:47:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:47:03 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:47:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:47:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:47:03 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Cannot resize image /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:47:03 user nova-compute[72201]: DEBUG nova.objects.instance [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'migration_context' on Instance uuid e4f06d05-b05a-459c-9a44-0af858b2570d {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:47:03 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:47:03 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Ensure instance console log exists: /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:47:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:47:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:47:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:47:03 user nova-compute[72201]: DEBUG nova.network.neutron [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Successfully created port: cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.network.neutron [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Successfully updated port: cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "refresh_cache-e4f06d05-b05a-459c-9a44-0af858b2570d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquired lock "refresh_cache-e4f06d05-b05a-459c-9a44-0af858b2570d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.network.neutron [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.network.neutron [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-d41e9542-9533-43b4-ad7f-325f15b44ed9 req-f837f03a-9a80-4b31-9a53-edb806419d41 service nova] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Received event network-changed-cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-d41e9542-9533-43b4-ad7f-325f15b44ed9 req-f837f03a-9a80-4b31-9a53-edb806419d41 service nova] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Refreshing instance network info cache due to event network-changed-cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d41e9542-9533-43b4-ad7f-325f15b44ed9 req-f837f03a-9a80-4b31-9a53-edb806419d41 service nova] Acquiring lock "refresh_cache-e4f06d05-b05a-459c-9a44-0af858b2570d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.network.neutron [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Updating instance_info_cache with network_info: [{"id": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "address": "fa:16:3e:77:73:42", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd914fa0-b0", "ovs_interfaceid": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Releasing lock "refresh_cache-e4f06d05-b05a-459c-9a44-0af858b2570d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.compute.manager [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Instance network_info: |[{"id": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "address": "fa:16:3e:77:73:42", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd914fa0-b0", "ovs_interfaceid": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d41e9542-9533-43b4-ad7f-325f15b44ed9 req-f837f03a-9a80-4b31-9a53-edb806419d41 service nova] Acquired lock "refresh_cache-e4f06d05-b05a-459c-9a44-0af858b2570d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.network.neutron [req-d41e9542-9533-43b4-ad7f-325f15b44ed9 req-f837f03a-9a80-4b31-9a53-edb806419d41 service nova] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Refreshing network info cache for port cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Start _get_guest_xml network_info=[{"id": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "address": "fa:16:3e:77:73:42", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd914fa0-b0", "ovs_interfaceid": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:47:04 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:47:04 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1191757417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1191757417',id=41,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ed7463cb6f84c4a8cf1ef0437eca988',ramdisk_id='',reservation_id='r-v478oqcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:47:03Z,user_data=None,user_id='75b0cb34dac64c61a235470454e0c6bf',uuid=e4f06d05-b05a-459c-9a44-0af858b2570d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "address": "fa:16:3e:77:73:42", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd914fa0-b0", "ovs_interfaceid": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converting VIF {"id": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "address": "fa:16:3e:77:73:42", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd914fa0-b0", "ovs_interfaceid": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:73:42,bridge_name='br-int',has_traffic_filtering=True,id=cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd914fa0-b0') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.objects.instance [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'pci_devices' on Instance uuid e4f06d05-b05a-459c-9a44-0af858b2570d {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:47:04 user nova-compute[72201]:   <uuid>e4f06d05-b05a-459c-9a44-0af858b2570d</uuid>
Aug 01 15:47:04 user nova-compute[72201]:   <name>instance-00000029</name>
Aug 01 15:47:04 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:47:04 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:47:04 user nova-compute[72201]:   <metadata>
Aug 01 15:47:04 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:47:04 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:47:04 user nova-compute[72201]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1191757417</nova:name>
Aug 01 15:47:04 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:47:04</nova:creationTime>
Aug 01 15:47:04 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:47:04 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:47:04 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:47:04 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:47:04 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:47:04 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:47:04 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:47:04 user nova-compute[72201]:       <nova:owner>
Aug 01 15:47:04 user nova-compute[72201]:         <nova:user uuid="75b0cb34dac64c61a235470454e0c6bf">tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member</nova:user>
Aug 01 15:47:04 user nova-compute[72201]:         <nova:project uuid="2ed7463cb6f84c4a8cf1ef0437eca988">tempest-ServerBootFromVolumeStableRescueTest-1836467291</nova:project>
Aug 01 15:47:04 user nova-compute[72201]:       </nova:owner>
Aug 01 15:47:04 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:47:04 user nova-compute[72201]:       <nova:ports>
Aug 01 15:47:04 user nova-compute[72201]:         <nova:port uuid="cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae">
Aug 01 15:47:04 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 15:47:04 user nova-compute[72201]:         </nova:port>
Aug 01 15:47:04 user nova-compute[72201]:       </nova:ports>
Aug 01 15:47:04 user nova-compute[72201]:     </nova:instance>
Aug 01 15:47:04 user nova-compute[72201]:   </metadata>
Aug 01 15:47:04 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:47:04 user nova-compute[72201]:     <system>
Aug 01 15:47:04 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:47:04 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:47:04 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:47:04 user nova-compute[72201]:       <entry name="serial">e4f06d05-b05a-459c-9a44-0af858b2570d</entry>
Aug 01 15:47:04 user nova-compute[72201]:       <entry name="uuid">e4f06d05-b05a-459c-9a44-0af858b2570d</entry>
Aug 01 15:47:04 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:47:04 user nova-compute[72201]:     </system>
Aug 01 15:47:04 user nova-compute[72201]:   </sysinfo>
Aug 01 15:47:04 user nova-compute[72201]:   <os>
Aug 01 15:47:04 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:47:04 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:47:04 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:47:04 user nova-compute[72201]:   </os>
Aug 01 15:47:04 user nova-compute[72201]:   <features>
Aug 01 15:47:04 user nova-compute[72201]:     <acpi/>
Aug 01 15:47:04 user nova-compute[72201]:     <apic/>
Aug 01 15:47:04 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:47:04 user nova-compute[72201]:   </features>
Aug 01 15:47:04 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:47:04 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:47:04 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:47:04 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:47:04 user nova-compute[72201]:   </clock>
Aug 01 15:47:04 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:47:04 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:47:04 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:47:04 user nova-compute[72201]:   </cpu>
Aug 01 15:47:04 user nova-compute[72201]:   <devices>
Aug 01 15:47:04 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:47:04 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:47:04 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk"/>
Aug 01 15:47:04 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:47:04 user nova-compute[72201]:     </disk>
Aug 01 15:47:04 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:47:04 user nova-compute[72201]:       <mac address="fa:16:3e:77:73:42"/>
Aug 01 15:47:04 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:47:04 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:47:04 user nova-compute[72201]:       <target dev="tapcd914fa0-b0"/>
Aug 01 15:47:04 user nova-compute[72201]:     </interface>
Aug 01 15:47:04 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:47:04 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/console.log" append="off"/>
Aug 01 15:47:04 user nova-compute[72201]:     </serial>
Aug 01 15:47:04 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:47:04 user nova-compute[72201]:     <video>
Aug 01 15:47:04 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:47:04 user nova-compute[72201]:     </video>
Aug 01 15:47:04 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:47:04 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:47:04 user nova-compute[72201]:     </rng>
Aug 01 15:47:04 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:47:04 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:47:04 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:47:04 user nova-compute[72201]:     </memballoon>
Aug 01 15:47:04 user nova-compute[72201]:   </devices>
Aug 01 15:47:04 user nova-compute[72201]: </domain>
Aug 01 15:47:04 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1191757417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1191757417',id=41,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ed7463cb6f84c4a8cf1ef0437eca988',ramdisk_id='',reservation_id='r-v478oqcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:47:03Z,user_data=None,user_id='75b0cb34dac64c61a235470454e0c6bf',uuid=e4f06d05-b05a-459c-9a44-0af858b2570d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "address": "fa:16:3e:77:73:42", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd914fa0-b0", "ovs_interfaceid": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converting VIF {"id": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "address": "fa:16:3e:77:73:42", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd914fa0-b0", "ovs_interfaceid": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:73:42,bridge_name='br-int',has_traffic_filtering=True,id=cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd914fa0-b0') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG os_vif [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:73:42,bridge_name='br-int',has_traffic_filtering=True,id=cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd914fa0-b0') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd914fa0-b0, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcd914fa0-b0, col_values=(('external_ids', {'iface-id': 'cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:73:42', 'vm-uuid': 'e4f06d05-b05a-459c-9a44-0af858b2570d'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:04 user nova-compute[72201]: INFO os_vif [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:73:42,bridge_name='br-int',has_traffic_filtering=True,id=cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd914fa0-b0')
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:47:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] No VIF found with MAC fa:16:3e:77:73:42, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:47:05 user nova-compute[72201]: DEBUG nova.network.neutron [req-d41e9542-9533-43b4-ad7f-325f15b44ed9 req-f837f03a-9a80-4b31-9a53-edb806419d41 service nova] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Updated VIF entry in instance network info cache for port cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:47:05 user nova-compute[72201]: DEBUG nova.network.neutron [req-d41e9542-9533-43b4-ad7f-325f15b44ed9 req-f837f03a-9a80-4b31-9a53-edb806419d41 service nova] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Updating instance_info_cache with network_info: [{"id": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "address": "fa:16:3e:77:73:42", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd914fa0-b0", "ovs_interfaceid": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:47:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d41e9542-9533-43b4-ad7f-325f15b44ed9 req-f837f03a-9a80-4b31-9a53-edb806419d41 service nova] Releasing lock "refresh_cache-e4f06d05-b05a-459c-9a44-0af858b2570d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:47:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-d21451f4-c041-4a9e-a902-9f3f7e39066e req-48db6da3-6c7d-414e-93a1-0b862252113e service nova] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Received event network-vif-plugged-cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:47:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d21451f4-c041-4a9e-a902-9f3f7e39066e req-48db6da3-6c7d-414e-93a1-0b862252113e service nova] Acquiring lock "e4f06d05-b05a-459c-9a44-0af858b2570d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:47:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d21451f4-c041-4a9e-a902-9f3f7e39066e req-48db6da3-6c7d-414e-93a1-0b862252113e service nova] Lock "e4f06d05-b05a-459c-9a44-0af858b2570d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:47:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d21451f4-c041-4a9e-a902-9f3f7e39066e req-48db6da3-6c7d-414e-93a1-0b862252113e service nova] Lock "e4f06d05-b05a-459c-9a44-0af858b2570d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:47:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-d21451f4-c041-4a9e-a902-9f3f7e39066e req-48db6da3-6c7d-414e-93a1-0b862252113e service nova] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] No waiting events found dispatching network-vif-plugged-cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:47:06 user nova-compute[72201]: WARNING nova.compute.manager [req-d21451f4-c041-4a9e-a902-9f3f7e39066e req-48db6da3-6c7d-414e-93a1-0b862252113e service nova] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Received unexpected event network-vif-plugged-cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae for instance with vm_state building and task_state spawning.
Aug 01 15:47:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:47:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:47:07 user nova-compute[72201]: INFO nova.compute.manager [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Shelving
Aug 01 15:47:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-0b762fc8-0ce2-440c-8fb6-681a9f1991f4 req-241e9093-a7c2-4258-8273-5f942d27324a service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Received event network-vif-unplugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:47:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0b762fc8-0ce2-440c-8fb6-681a9f1991f4 req-241e9093-a7c2-4258-8273-5f942d27324a service nova] Acquiring lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:47:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0b762fc8-0ce2-440c-8fb6-681a9f1991f4 req-241e9093-a7c2-4258-8273-5f942d27324a service nova] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:47:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0b762fc8-0ce2-440c-8fb6-681a9f1991f4 req-241e9093-a7c2-4258-8273-5f942d27324a service nova] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:47:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-0b762fc8-0ce2-440c-8fb6-681a9f1991f4 req-241e9093-a7c2-4258-8273-5f942d27324a service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] No waiting events found dispatching network-vif-unplugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:47:07 user nova-compute[72201]: WARNING nova.compute.manager [req-0b762fc8-0ce2-440c-8fb6-681a9f1991f4 req-241e9093-a7c2-4258-8273-5f942d27324a service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Received unexpected event network-vif-unplugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a for instance with vm_state active and task_state shelving.
Aug 01 15:47:07 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Instance destroyed successfully.
Aug 01 15:47:07 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Beginning cold snapshot process
Aug 01 15:47:08 user nova-compute[72201]: DEBUG nova.privsep.utils [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72201) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 15:47:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk /opt/stack/data/nova/instances/snapshots/tmp86dn2hhz/e7e39d0da8d247fc94f07dd132ba2ebb {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:47:08 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904828.3499687, e4f06d05-b05a-459c-9a44-0af858b2570d => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:47:08 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] VM Resumed (Lifecycle Event)
Aug 01 15:47:08 user nova-compute[72201]: DEBUG nova.compute.manager [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:47:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:47:08 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Instance spawned successfully.
Aug 01 15:47:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:47:08 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:47:08 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:47:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:47:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:47:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:47:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:47:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:47:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:47:08 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:47:08 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904828.353041, e4f06d05-b05a-459c-9a44-0af858b2570d => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:47:08 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] VM Started (Lifecycle Event)
Aug 01 15:47:08 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:47:08 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:47:08 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:47:08 user nova-compute[72201]: INFO nova.compute.manager [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Took 5.92 seconds to spawn the instance on the hypervisor.
Aug 01 15:47:08 user nova-compute[72201]: DEBUG nova.compute.manager [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:47:08 user nova-compute[72201]: INFO nova.compute.manager [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Took 6.63 seconds to build instance.
Aug 01 15:47:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-111695ff-9a49-44bc-b7e2-cb7040de1e45 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "e4f06d05-b05a-459c-9a44-0af858b2570d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.812s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:47:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk /opt/stack/data/nova/instances/snapshots/tmp86dn2hhz/e7e39d0da8d247fc94f07dd132ba2ebb" returned: 0 in 0.707s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:47:08 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Snapshot extracted, beginning image upload
Aug 01 15:47:08 user nova-compute[72201]: DEBUG nova.compute.manager [req-5320e272-30b7-45b9-9990-1bbde2376834 req-07592065-f8af-446d-b984-7d6c5bb5f48d service nova] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Received event network-vif-plugged-cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:47:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5320e272-30b7-45b9-9990-1bbde2376834 req-07592065-f8af-446d-b984-7d6c5bb5f48d service nova] Acquiring lock "e4f06d05-b05a-459c-9a44-0af858b2570d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:47:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5320e272-30b7-45b9-9990-1bbde2376834 req-07592065-f8af-446d-b984-7d6c5bb5f48d service nova] Lock "e4f06d05-b05a-459c-9a44-0af858b2570d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:47:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5320e272-30b7-45b9-9990-1bbde2376834 req-07592065-f8af-446d-b984-7d6c5bb5f48d service nova] Lock "e4f06d05-b05a-459c-9a44-0af858b2570d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:47:08 user nova-compute[72201]: DEBUG nova.compute.manager [req-5320e272-30b7-45b9-9990-1bbde2376834 req-07592065-f8af-446d-b984-7d6c5bb5f48d service nova] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] No waiting events found dispatching network-vif-plugged-cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:47:08 user nova-compute[72201]: WARNING nova.compute.manager [req-5320e272-30b7-45b9-9990-1bbde2376834 req-07592065-f8af-446d-b984-7d6c5bb5f48d service nova] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Received unexpected event network-vif-plugged-cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae for instance with vm_state active and task_state None.
Aug 01 15:47:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-7de89a04-7b29-460b-9ffa-a5baf1a072a1 req-65b13c14-aff2-4c36-92f8-1c95223a1629 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Received event network-vif-plugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:47:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7de89a04-7b29-460b-9ffa-a5baf1a072a1 req-65b13c14-aff2-4c36-92f8-1c95223a1629 service nova] Acquiring lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:47:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7de89a04-7b29-460b-9ffa-a5baf1a072a1 req-65b13c14-aff2-4c36-92f8-1c95223a1629 service nova] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:47:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-7de89a04-7b29-460b-9ffa-a5baf1a072a1 req-65b13c14-aff2-4c36-92f8-1c95223a1629 service nova] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:47:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-7de89a04-7b29-460b-9ffa-a5baf1a072a1 req-65b13c14-aff2-4c36-92f8-1c95223a1629 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] No waiting events found dispatching network-vif-plugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:47:09 user nova-compute[72201]: WARNING nova.compute.manager [req-7de89a04-7b29-460b-9ffa-a5baf1a072a1 req-65b13c14-aff2-4c36-92f8-1c95223a1629 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Received unexpected event network-vif-plugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a for instance with vm_state active and task_state shelving_image_uploading.
Aug 01 15:47:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:11 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Snapshot image upload complete
Aug 01 15:47:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:47:11 user nova-compute[72201]: INFO nova.compute.manager [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Shelve offloading
Aug 01 15:47:11 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Instance destroyed successfully.
Aug 01 15:47:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:47:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "refresh_cache-c1120ed7-15d6-4c45-9949-4bf59be4c2c0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:47:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquired lock "refresh_cache-c1120ed7-15d6-4c45-9949-4bf59be4c2c0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:47:11 user nova-compute[72201]: DEBUG nova.network.neutron [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:47:11 user nova-compute[72201]: DEBUG nova.network.neutron [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Updating instance_info_cache with network_info: [{"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:47:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Releasing lock "refresh_cache-c1120ed7-15d6-4c45-9949-4bf59be4c2c0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:47:12 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Instance destroyed successfully.
Aug 01 15:47:12 user nova-compute[72201]: DEBUG nova.objects.instance [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'resources' on Instance uuid c1120ed7-15d6-4c45-9949-4bf59be4c2c0 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:47:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-21922150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-21922150',id=40,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQ7fCan9R/LO3/o5uRQNerNLwjF3c0FjKZQZ6wJkoAlnRCkjfKf7HrcJXA0edFSt/4HZ6yiyiLzvckXXuRRY9eKAx2iUqC+q3sOcLS8IYNO4r3rCdUoFv23o2p1n0gcFQ==',key_name='tempest-keypair-2143760373',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fbe1b0601b564f789cbd45138114e95b',ramdisk_id='',reservation_id='r-48jtcvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-858719582',owner_user_name='tempest-AttachVolumeShelveTestJSON-858719582-project-member',shelved_at='2023-08-01T15:47:11.227319',shelved_host='user',shelved_image_id='c0220614-5065-428f-9c1d-2dbb4841e514'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:47:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2caf51668cff454284097f6e91661c17',uuid=c1120ed7-15d6-4c45-9949-4bf59be4c2c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:47:12 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converting VIF {"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:47:12 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:8b:2d,bridge_name='br-int',has_traffic_filtering=True,id=5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4c3a15-35') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:47:12 user nova-compute[72201]: DEBUG os_vif [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:8b:2d,bridge_name='br-int',has_traffic_filtering=True,id=5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4c3a15-35') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:47:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e4c3a15-35, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:47:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:47:12 user nova-compute[72201]: INFO os_vif [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:8b:2d,bridge_name='br-int',has_traffic_filtering=True,id=5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4c3a15-35')
Aug 01 15:47:12 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Deleting instance files /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0_del
Aug 01 15:47:12 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Deletion of /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0_del complete
Aug 01 15:47:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-92f6b28e-9600-41e9-bbf6-5c6ae9c3c488 req-a0aa10ec-e0f6-4ba9-b2ad-595644c3decf service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Received event network-changed-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:47:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-92f6b28e-9600-41e9-bbf6-5c6ae9c3c488 req-a0aa10ec-e0f6-4ba9-b2ad-595644c3decf service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Refreshing instance network info cache due to event network-changed-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:47:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-92f6b28e-9600-41e9-bbf6-5c6ae9c3c488 req-a0aa10ec-e0f6-4ba9-b2ad-595644c3decf service nova] Acquiring lock "refresh_cache-c1120ed7-15d6-4c45-9949-4bf59be4c2c0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:47:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-92f6b28e-9600-41e9-bbf6-5c6ae9c3c488 req-a0aa10ec-e0f6-4ba9-b2ad-595644c3decf service nova] Acquired lock "refresh_cache-c1120ed7-15d6-4c45-9949-4bf59be4c2c0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:47:12 user nova-compute[72201]: DEBUG nova.network.neutron [req-92f6b28e-9600-41e9-bbf6-5c6ae9c3c488 req-a0aa10ec-e0f6-4ba9-b2ad-595644c3decf service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Refreshing network info cache for port 5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:47:12 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Deleted allocations for instance c1120ed7-15d6-4c45-9949-4bf59be4c2c0
Aug 01 15:47:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:47:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:47:12 user nova-compute[72201]: DEBUG nova.objects.instance [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'numa_topology' on Instance uuid c1120ed7-15d6-4c45-9949-4bf59be4c2c0 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:47:12 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:47:12 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:47:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:47:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-76518025-016d-48ff-9629-60d556242736 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.773s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:47:13 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:47:13 user nova-compute[72201]: DEBUG nova.network.neutron [req-92f6b28e-9600-41e9-bbf6-5c6ae9c3c488 req-a0aa10ec-e0f6-4ba9-b2ad-595644c3decf service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Updated VIF entry in instance network info cache for port 5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:47:13 user nova-compute[72201]: DEBUG nova.network.neutron [req-92f6b28e-9600-41e9-bbf6-5c6ae9c3c488 req-a0aa10ec-e0f6-4ba9-b2ad-595644c3decf service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Updating instance_info_cache with network_info: [{"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:47:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-92f6b28e-9600-41e9-bbf6-5c6ae9c3c488 req-a0aa10ec-e0f6-4ba9-b2ad-595644c3decf service nova] Releasing lock "refresh_cache-c1120ed7-15d6-4c45-9949-4bf59be4c2c0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:47:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:21 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:47:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:47:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 15:47:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:47:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:47:21 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:47:21 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid f0743332-223f-4507-b8b1-40d63b7b5e80 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:47:21 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Updating instance_info_cache with network_info: [{"id": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "address": "fa:16:3e:6a:5e:e0", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6062f511-71", "ovs_interfaceid": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:47:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:47:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:47:21 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:47:22 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:47:22 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:47:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:47:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:47:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:47:22 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:47:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:47:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:47:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:47:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:47:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:47:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:47:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:47:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:47:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:47:22 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690904827.8577785, c1120ed7-15d6-4c45-9949-4bf59be4c2c0 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:47:22 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] VM Stopped (Lifecycle Event)
Aug 01 15:47:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d5b52725-1cf5-4be9-8aa1-a5b98b3e5480 None None] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:47:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:47:22 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:47:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:47:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:47:23 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:47:23 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:47:23 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8391MB free_disk=25.152568817138672GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:47:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:47:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:47:23 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f0743332-223f-4507-b8b1-40d63b7b5e80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:47:23 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 801f5645-aff6-41ea-bb28-34e8dcacfe20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:47:23 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:47:23 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e4f06d05-b05a-459c-9a44-0af858b2570d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:47:23 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:47:23 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:47:23 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:47:23 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:47:23 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:47:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:47:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:24 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:47:24 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:47:27 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:47:27 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:47:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:28 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:47:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:47:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:47:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:47:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:47:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:47:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:47:55 user nova-compute[72201]: INFO nova.compute.manager [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Terminating instance
Aug 01 15:47:55 user nova-compute[72201]: DEBUG nova.compute.manager [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:47:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:55 user nova-compute[72201]: DEBUG nova.compute.manager [req-868e30c0-2cfd-4aeb-857a-0b85e4fbb5f8 req-0f42b09b-0992-46a9-8bc3-416837d3dceb service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received event network-vif-unplugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:47:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-868e30c0-2cfd-4aeb-857a-0b85e4fbb5f8 req-0f42b09b-0992-46a9-8bc3-416837d3dceb service nova] Acquiring lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:47:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-868e30c0-2cfd-4aeb-857a-0b85e4fbb5f8 req-0f42b09b-0992-46a9-8bc3-416837d3dceb service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:47:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-868e30c0-2cfd-4aeb-857a-0b85e4fbb5f8 req-0f42b09b-0992-46a9-8bc3-416837d3dceb service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:47:55 user nova-compute[72201]: DEBUG nova.compute.manager [req-868e30c0-2cfd-4aeb-857a-0b85e4fbb5f8 req-0f42b09b-0992-46a9-8bc3-416837d3dceb service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] No waiting events found dispatching network-vif-unplugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:47:55 user nova-compute[72201]: DEBUG nova.compute.manager [req-868e30c0-2cfd-4aeb-857a-0b85e4fbb5f8 req-0f42b09b-0992-46a9-8bc3-416837d3dceb service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received event network-vif-unplugged-1ad27823-4773-4b78-bbe0-1378855554c8 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:47:56 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Instance destroyed successfully.
Aug 01 15:47:56 user nova-compute[72201]: DEBUG nova.objects.instance [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'resources' on Instance uuid 801f5645-aff6-41ea-bb28-34e8dcacfe20 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:47:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1438545025',display_name='tempest-AttachVolumeTestJSON-server-1438545025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1438545025',id=38,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5sTybeqRu+KrWZIs2Qy17OX/PCK/I5EFDxt6til1PIQ3CSrY0rgKAekgLbUup6BgzQOCUtfNIUY2C5P7VWdfbkUmmeezeVSiWHDBAhmzUEyBhfgdTIHXtComrkv3PWWQ==',key_name='tempest-keypair-634092699',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:38:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b9978ab74a743b6870f1a86469debb4',ramdisk_id='',reservation_id='r-k1ayhqoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-570587534',owner_user_name='tempest-AttachVolumeTestJSON-570587534-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:46:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='243e1aae552d43b7b892618022460e1b',uuid=801f5645-aff6-41ea-bb28-34e8dcacfe20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:47:56 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converting VIF {"id": "1ad27823-4773-4b78-bbe0-1378855554c8", "address": "fa:16:3e:f7:d3:89", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad27823-47", "ovs_interfaceid": "1ad27823-4773-4b78-bbe0-1378855554c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:47:56 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:d3:89,bridge_name='br-int',has_traffic_filtering=True,id=1ad27823-4773-4b78-bbe0-1378855554c8,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad27823-47') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:47:56 user nova-compute[72201]: DEBUG os_vif [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:d3:89,bridge_name='br-int',has_traffic_filtering=True,id=1ad27823-4773-4b78-bbe0-1378855554c8,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad27823-47') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:47:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ad27823-47, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:47:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:47:56 user nova-compute[72201]: INFO os_vif [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:d3:89,bridge_name='br-int',has_traffic_filtering=True,id=1ad27823-4773-4b78-bbe0-1378855554c8,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad27823-47')
Aug 01 15:47:56 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Deleting instance files /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20_del
Aug 01 15:47:56 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Deletion of /opt/stack/data/nova/instances/801f5645-aff6-41ea-bb28-34e8dcacfe20_del complete
Aug 01 15:47:56 user nova-compute[72201]: INFO nova.compute.manager [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 15:47:56 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:47:56 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:47:56 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:47:57 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:47:57 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Took 0.97 seconds to deallocate network for instance.
Aug 01 15:47:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:47:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:47:57 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:47:57 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:47:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:47:57 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Deleted allocations for instance 801f5645-aff6-41ea-bb28-34e8dcacfe20
Aug 01 15:47:57 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bf7dab63-963b-42fa-940b-a6a18b3c6042 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.237s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:47:58 user nova-compute[72201]: DEBUG nova.compute.manager [req-57b1be76-7861-431e-916b-2fda9a7a71fc req-5ed45cbe-f705-462f-b365-7cccd38cdf32 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received event network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:47:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-57b1be76-7861-431e-916b-2fda9a7a71fc req-5ed45cbe-f705-462f-b365-7cccd38cdf32 service nova] Acquiring lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:47:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-57b1be76-7861-431e-916b-2fda9a7a71fc req-5ed45cbe-f705-462f-b365-7cccd38cdf32 service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:47:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-57b1be76-7861-431e-916b-2fda9a7a71fc req-5ed45cbe-f705-462f-b365-7cccd38cdf32 service nova] Lock "801f5645-aff6-41ea-bb28-34e8dcacfe20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:47:58 user nova-compute[72201]: DEBUG nova.compute.manager [req-57b1be76-7861-431e-916b-2fda9a7a71fc req-5ed45cbe-f705-462f-b365-7cccd38cdf32 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] No waiting events found dispatching network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:47:58 user nova-compute[72201]: WARNING nova.compute.manager [req-57b1be76-7861-431e-916b-2fda9a7a71fc req-5ed45cbe-f705-462f-b365-7cccd38cdf32 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received unexpected event network-vif-plugged-1ad27823-4773-4b78-bbe0-1378855554c8 for instance with vm_state deleted and task_state None.
Aug 01 15:47:58 user nova-compute[72201]: DEBUG nova.compute.manager [req-57b1be76-7861-431e-916b-2fda9a7a71fc req-5ed45cbe-f705-462f-b365-7cccd38cdf32 service nova] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Received event network-vif-deleted-1ad27823-4773-4b78-bbe0-1378855554c8 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:47:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:48:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:48:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:48:11 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690904876.3142436, 801f5645-aff6-41ea-bb28-34e8dcacfe20 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:48:11 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] VM Stopped (Lifecycle Event)
Aug 01 15:48:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-fd8ed0cf-1b06-4b6e-95ae-a66393b3df95 None None] [instance: 801f5645-aff6-41ea-bb28-34e8dcacfe20] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:48:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:48:15 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:48:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:48:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:48:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:48:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:48:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:48:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:48:21 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:48:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:48:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:48:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:48:21 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:48:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:48:21 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Updating instance_info_cache with network_info: [{"id": "fa130bf4-53dc-43f7-8932-0aec318054d9", "address": "fa:16:3e:92:e7:b2", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa130bf4-53", "ovs_interfaceid": "fa130bf4-53dc-43f7-8932-0aec318054d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:48:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:48:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:48:21 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:48:23 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:48:23 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:48:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:48:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:48:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:48:23 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:48:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:48:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:48:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:48:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:48:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:48:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:48:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:48:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:48:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:48:24 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:48:24 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:48:24 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8562MB free_disk=25.178264617919922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:48:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:48:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:48:24 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f0743332-223f-4507-b8b1-40d63b7b5e80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:48:24 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:48:24 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e4f06d05-b05a-459c-9a44-0af858b2570d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:48:24 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:48:24 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:48:24 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:48:24 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:48:24 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:48:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:48:25 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:48:25 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:48:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:48:28 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:48:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:48:29 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:48:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:48:34 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:48:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:48:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:48:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:48:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:48:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:48:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:48:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:48:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:48:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:48:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:48:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:48:49 user nova-compute[72201]: DEBUG nova.compute.manager [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:48:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:48:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:48:49 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:48:49 user nova-compute[72201]: INFO nova.compute.claims [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Claim successful on node user
Aug 01 15:48:49 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:48:49 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG nova.network.neutron [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:48:50 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:48:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG nova.policy [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '243e1aae552d43b7b892618022460e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9978ab74a743b6870f1a86469debb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:48:50 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Creating image(s)
Aug 01 15:48:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "/opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "/opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "/opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.132s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1/disk 1073741824" returned: 0 in 0.053s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.137s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Checking if we can resize image /opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG nova.network.neutron [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Successfully created port: 7478a101-d462-4cc1-908b-9a5c0ce2b1b5 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Cannot resize image /opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG nova.objects.instance [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'migration_context' on Instance uuid 27dfe137-c422-4c0b-b7c0-8cb2935806b1 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Ensure instance console log exists: /opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:48:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:48:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:48:51 user nova-compute[72201]: DEBUG nova.network.neutron [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Successfully updated port: 7478a101-d462-4cc1-908b-9a5c0ce2b1b5 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:48:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "refresh_cache-27dfe137-c422-4c0b-b7c0-8cb2935806b1" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:48:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquired lock "refresh_cache-27dfe137-c422-4c0b-b7c0-8cb2935806b1" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:48:51 user nova-compute[72201]: DEBUG nova.network.neutron [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:48:51 user nova-compute[72201]: DEBUG nova.compute.manager [req-a5555939-ae5f-466b-9c15-ed258b8b00fe req-e57fdac4-f29f-4138-904f-eea3f5be6929 service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Received event network-changed-7478a101-d462-4cc1-908b-9a5c0ce2b1b5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:48:51 user nova-compute[72201]: DEBUG nova.compute.manager [req-a5555939-ae5f-466b-9c15-ed258b8b00fe req-e57fdac4-f29f-4138-904f-eea3f5be6929 service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Refreshing instance network info cache due to event network-changed-7478a101-d462-4cc1-908b-9a5c0ce2b1b5. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:48:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a5555939-ae5f-466b-9c15-ed258b8b00fe req-e57fdac4-f29f-4138-904f-eea3f5be6929 service nova] Acquiring lock "refresh_cache-27dfe137-c422-4c0b-b7c0-8cb2935806b1" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:48:51 user nova-compute[72201]: DEBUG nova.network.neutron [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:48:51 user nova-compute[72201]: DEBUG nova.network.neutron [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Updating instance_info_cache with network_info: [{"id": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "address": "fa:16:3e:0c:e1:85", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7478a101-d4", "ovs_interfaceid": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:48:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Releasing lock "refresh_cache-27dfe137-c422-4c0b-b7c0-8cb2935806b1" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:48:51 user nova-compute[72201]: DEBUG nova.compute.manager [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Instance network_info: |[{"id": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "address": "fa:16:3e:0c:e1:85", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7478a101-d4", "ovs_interfaceid": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:48:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a5555939-ae5f-466b-9c15-ed258b8b00fe req-e57fdac4-f29f-4138-904f-eea3f5be6929 service nova] Acquired lock "refresh_cache-27dfe137-c422-4c0b-b7c0-8cb2935806b1" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:48:51 user nova-compute[72201]: DEBUG nova.network.neutron [req-a5555939-ae5f-466b-9c15-ed258b8b00fe req-e57fdac4-f29f-4138-904f-eea3f5be6929 service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Refreshing network info cache for port 7478a101-d462-4cc1-908b-9a5c0ce2b1b5 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:48:51 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Start _get_guest_xml network_info=[{"id": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "address": "fa:16:3e:0c:e1:85", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7478a101-d4", "ovs_interfaceid": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:48:52 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:48:52 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:48:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-610200022',display_name='tempest-AttachVolumeTestJSON-server-610200022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-610200022',id=42,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApN0k1TNcZzPS0ncHOwIRF0A0QKEjXgNRD3d/wUNZS/8nnR+oRuxEt3tZbiduGf0PLJgqXvrzVvWz0mEH6JWvLrfufXB1Uc2vCeFB4Xg3kCrMzrZ1FsSR26C2pC59Joqg==',key_name='tempest-keypair-85936855',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b9978ab74a743b6870f1a86469debb4',ramdisk_id='',reservation_id='r-48a5sxt8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-570587534',owner_user_name='tempest-AttachVolumeTestJSON-570587534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='243e1aae552d43b7b892618022460e1b',uuid=27dfe137-c422-4c0b-b7c0-8cb2935806b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "address": "fa:16:3e:0c:e1:85", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7478a101-d4", "ovs_interfaceid": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converting VIF {"id": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "address": "fa:16:3e:0c:e1:85", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7478a101-d4", "ovs_interfaceid": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:e1:85,bridge_name='br-int',has_traffic_filtering=True,id=7478a101-d462-4cc1-908b-9a5c0ce2b1b5,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7478a101-d4') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.objects.instance [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'pci_devices' on Instance uuid 27dfe137-c422-4c0b-b7c0-8cb2935806b1 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:48:52 user nova-compute[72201]:   <uuid>27dfe137-c422-4c0b-b7c0-8cb2935806b1</uuid>
Aug 01 15:48:52 user nova-compute[72201]:   <name>instance-0000002a</name>
Aug 01 15:48:52 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:48:52 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:48:52 user nova-compute[72201]:   <metadata>
Aug 01 15:48:52 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:48:52 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:48:52 user nova-compute[72201]:       <nova:name>tempest-AttachVolumeTestJSON-server-610200022</nova:name>
Aug 01 15:48:52 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:48:52</nova:creationTime>
Aug 01 15:48:52 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:48:52 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:48:52 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:48:52 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:48:52 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:48:52 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:48:52 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:48:52 user nova-compute[72201]:       <nova:owner>
Aug 01 15:48:52 user nova-compute[72201]:         <nova:user uuid="243e1aae552d43b7b892618022460e1b">tempest-AttachVolumeTestJSON-570587534-project-member</nova:user>
Aug 01 15:48:52 user nova-compute[72201]:         <nova:project uuid="1b9978ab74a743b6870f1a86469debb4">tempest-AttachVolumeTestJSON-570587534</nova:project>
Aug 01 15:48:52 user nova-compute[72201]:       </nova:owner>
Aug 01 15:48:52 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:48:52 user nova-compute[72201]:       <nova:ports>
Aug 01 15:48:52 user nova-compute[72201]:         <nova:port uuid="7478a101-d462-4cc1-908b-9a5c0ce2b1b5">
Aug 01 15:48:52 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 15:48:52 user nova-compute[72201]:         </nova:port>
Aug 01 15:48:52 user nova-compute[72201]:       </nova:ports>
Aug 01 15:48:52 user nova-compute[72201]:     </nova:instance>
Aug 01 15:48:52 user nova-compute[72201]:   </metadata>
Aug 01 15:48:52 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:48:52 user nova-compute[72201]:     <system>
Aug 01 15:48:52 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:48:52 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:48:52 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:48:52 user nova-compute[72201]:       <entry name="serial">27dfe137-c422-4c0b-b7c0-8cb2935806b1</entry>
Aug 01 15:48:52 user nova-compute[72201]:       <entry name="uuid">27dfe137-c422-4c0b-b7c0-8cb2935806b1</entry>
Aug 01 15:48:52 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:48:52 user nova-compute[72201]:     </system>
Aug 01 15:48:52 user nova-compute[72201]:   </sysinfo>
Aug 01 15:48:52 user nova-compute[72201]:   <os>
Aug 01 15:48:52 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:48:52 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:48:52 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:48:52 user nova-compute[72201]:   </os>
Aug 01 15:48:52 user nova-compute[72201]:   <features>
Aug 01 15:48:52 user nova-compute[72201]:     <acpi/>
Aug 01 15:48:52 user nova-compute[72201]:     <apic/>
Aug 01 15:48:52 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:48:52 user nova-compute[72201]:   </features>
Aug 01 15:48:52 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:48:52 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:48:52 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:48:52 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:48:52 user nova-compute[72201]:   </clock>
Aug 01 15:48:52 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:48:52 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:48:52 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:48:52 user nova-compute[72201]:   </cpu>
Aug 01 15:48:52 user nova-compute[72201]:   <devices>
Aug 01 15:48:52 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:48:52 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:48:52 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1/disk"/>
Aug 01 15:48:52 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:48:52 user nova-compute[72201]:     </disk>
Aug 01 15:48:52 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:48:52 user nova-compute[72201]:       <mac address="fa:16:3e:0c:e1:85"/>
Aug 01 15:48:52 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:48:52 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:48:52 user nova-compute[72201]:       <target dev="tap7478a101-d4"/>
Aug 01 15:48:52 user nova-compute[72201]:     </interface>
Aug 01 15:48:52 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:48:52 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1/console.log" append="off"/>
Aug 01 15:48:52 user nova-compute[72201]:     </serial>
Aug 01 15:48:52 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:48:52 user nova-compute[72201]:     <video>
Aug 01 15:48:52 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:48:52 user nova-compute[72201]:     </video>
Aug 01 15:48:52 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:48:52 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:48:52 user nova-compute[72201]:     </rng>
Aug 01 15:48:52 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:48:52 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:48:52 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:48:52 user nova-compute[72201]:     </memballoon>
Aug 01 15:48:52 user nova-compute[72201]:   </devices>
Aug 01 15:48:52 user nova-compute[72201]: </domain>
Aug 01 15:48:52 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:48:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-610200022',display_name='tempest-AttachVolumeTestJSON-server-610200022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-610200022',id=42,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApN0k1TNcZzPS0ncHOwIRF0A0QKEjXgNRD3d/wUNZS/8nnR+oRuxEt3tZbiduGf0PLJgqXvrzVvWz0mEH6JWvLrfufXB1Uc2vCeFB4Xg3kCrMzrZ1FsSR26C2pC59Joqg==',key_name='tempest-keypair-85936855',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b9978ab74a743b6870f1a86469debb4',ramdisk_id='',reservation_id='r-48a5sxt8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-570587534',owner_user_name='tempest-AttachVolumeTestJSON-570587534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='243e1aae552d43b7b892618022460e1b',uuid=27dfe137-c422-4c0b-b7c0-8cb2935806b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "address": "fa:16:3e:0c:e1:85", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7478a101-d4", "ovs_interfaceid": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converting VIF {"id": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "address": "fa:16:3e:0c:e1:85", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7478a101-d4", "ovs_interfaceid": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:e1:85,bridge_name='br-int',has_traffic_filtering=True,id=7478a101-d462-4cc1-908b-9a5c0ce2b1b5,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7478a101-d4') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG os_vif [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:e1:85,bridge_name='br-int',has_traffic_filtering=True,id=7478a101-d462-4cc1-908b-9a5c0ce2b1b5,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7478a101-d4') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7478a101-d4, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7478a101-d4, col_values=(('external_ids', {'iface-id': '7478a101-d462-4cc1-908b-9a5c0ce2b1b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:e1:85', 'vm-uuid': '27dfe137-c422-4c0b-b7c0-8cb2935806b1'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:48:52 user nova-compute[72201]: INFO os_vif [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:e1:85,bridge_name='br-int',has_traffic_filtering=True,id=7478a101-d462-4cc1-908b-9a5c0ce2b1b5,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7478a101-d4')
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] No VIF found with MAC fa:16:3e:0c:e1:85, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0db8b603-0e02-4943-a8c2-6233ac3beb4e tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:48:52 user nova-compute[72201]: INFO nova.compute.manager [None req-0db8b603-0e02-4943-a8c2-6233ac3beb4e tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] instance snapshotting
Aug 01 15:48:52 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-0db8b603-0e02-4943-a8c2-6233ac3beb4e tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Beginning live snapshot process
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.network.neutron [req-a5555939-ae5f-466b-9c15-ed258b8b00fe req-e57fdac4-f29f-4138-904f-eea3f5be6929 service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Updated VIF entry in instance network info cache for port 7478a101-d462-4cc1-908b-9a5c0ce2b1b5. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG nova.network.neutron [req-a5555939-ae5f-466b-9c15-ed258b8b00fe req-e57fdac4-f29f-4138-904f-eea3f5be6929 service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Updating instance_info_cache with network_info: [{"id": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "address": "fa:16:3e:0c:e1:85", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7478a101-d4", "ovs_interfaceid": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a5555939-ae5f-466b-9c15-ed258b8b00fe req-e57fdac4-f29f-4138-904f-eea3f5be6929 service nova] Releasing lock "refresh_cache-27dfe137-c422-4c0b-b7c0-8cb2935806b1" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0db8b603-0e02-4943-a8c2-6233ac3beb4e tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json -f qcow2 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0db8b603-0e02-4943-a8c2-6233ac3beb4e tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json -f qcow2" returned: 0 in 0.131s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0db8b603-0e02-4943-a8c2-6233ac3beb4e tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json -f qcow2 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0db8b603-0e02-4943-a8c2-6233ac3beb4e tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0db8b603-0e02-4943-a8c2-6233ac3beb4e tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0db8b603-0e02-4943-a8c2-6233ac3beb4e tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.129s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0db8b603-0e02-4943-a8c2-6233ac3beb4e tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk0qe8luj/7df999fd004048e3a49281defaafa7ee.delta 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:48:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0db8b603-0e02-4943-a8c2-6233ac3beb4e tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk0qe8luj/7df999fd004048e3a49281defaafa7ee.delta 1073741824" returned: 0 in 0.055s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:48:52 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-0db8b603-0e02-4943-a8c2-6233ac3beb4e tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 15:48:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-0db8b603-0e02-4943-a8c2-6233ac3beb4e tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:48:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:48:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:48:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:48:54 user nova-compute[72201]: DEBUG nova.compute.manager [req-e80ee6a4-de7c-4df6-a959-e139cfece2e0 req-9e822dc7-08ed-4ce0-9df9-ba15769376fa service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Received event network-vif-plugged-7478a101-d462-4cc1-908b-9a5c0ce2b1b5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:48:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e80ee6a4-de7c-4df6-a959-e139cfece2e0 req-9e822dc7-08ed-4ce0-9df9-ba15769376fa service nova] Acquiring lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:48:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e80ee6a4-de7c-4df6-a959-e139cfece2e0 req-9e822dc7-08ed-4ce0-9df9-ba15769376fa service nova] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:48:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e80ee6a4-de7c-4df6-a959-e139cfece2e0 req-9e822dc7-08ed-4ce0-9df9-ba15769376fa service nova] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:48:54 user nova-compute[72201]: DEBUG nova.compute.manager [req-e80ee6a4-de7c-4df6-a959-e139cfece2e0 req-9e822dc7-08ed-4ce0-9df9-ba15769376fa service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] No waiting events found dispatching network-vif-plugged-7478a101-d462-4cc1-908b-9a5c0ce2b1b5 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:48:54 user nova-compute[72201]: WARNING nova.compute.manager [req-e80ee6a4-de7c-4df6-a959-e139cfece2e0 req-9e822dc7-08ed-4ce0-9df9-ba15769376fa service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Received unexpected event network-vif-plugged-7478a101-d462-4cc1-908b-9a5c0ce2b1b5 for instance with vm_state building and task_state spawning.
Aug 01 15:48:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-0db8b603-0e02-4943-a8c2-6233ac3beb4e tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72201) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 15:48:54 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-0db8b603-0e02-4943-a8c2-6233ac3beb4e tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 15:48:54 user nova-compute[72201]: DEBUG nova.privsep.utils [None req-0db8b603-0e02-4943-a8c2-6233ac3beb4e tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72201) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 15:48:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0db8b603-0e02-4943-a8c2-6233ac3beb4e tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk0qe8luj/7df999fd004048e3a49281defaafa7ee.delta /opt/stack/data/nova/instances/snapshots/tmpk0qe8luj/7df999fd004048e3a49281defaafa7ee {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:48:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:48:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:48:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0db8b603-0e02-4943-a8c2-6233ac3beb4e tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk0qe8luj/7df999fd004048e3a49281defaafa7ee.delta /opt/stack/data/nova/instances/snapshots/tmpk0qe8luj/7df999fd004048e3a49281defaafa7ee" returned: 0 in 0.378s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:48:54 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-0db8b603-0e02-4943-a8c2-6233ac3beb4e tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Snapshot extracted, beginning image upload
Aug 01 15:48:56 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904936.1680062, 27dfe137-c422-4c0b-b7c0-8cb2935806b1 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:48:56 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] VM Resumed (Lifecycle Event)
Aug 01 15:48:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:48:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:48:56 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Instance spawned successfully.
Aug 01 15:48:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:48:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:48:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:48:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:48:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:48:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:48:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:48:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:48:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:48:56 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:48:56 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904936.1737337, 27dfe137-c422-4c0b-b7c0-8cb2935806b1 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:48:56 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] VM Started (Lifecycle Event)
Aug 01 15:48:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-a74cad2d-9fa0-4dd3-a9e5-e0483c62bf07 req-6322b876-c338-446b-bbf2-468cdb9b8d4f service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Received event network-vif-plugged-7478a101-d462-4cc1-908b-9a5c0ce2b1b5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:48:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a74cad2d-9fa0-4dd3-a9e5-e0483c62bf07 req-6322b876-c338-446b-bbf2-468cdb9b8d4f service nova] Acquiring lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:48:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a74cad2d-9fa0-4dd3-a9e5-e0483c62bf07 req-6322b876-c338-446b-bbf2-468cdb9b8d4f service nova] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:48:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a74cad2d-9fa0-4dd3-a9e5-e0483c62bf07 req-6322b876-c338-446b-bbf2-468cdb9b8d4f service nova] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:48:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-a74cad2d-9fa0-4dd3-a9e5-e0483c62bf07 req-6322b876-c338-446b-bbf2-468cdb9b8d4f service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] No waiting events found dispatching network-vif-plugged-7478a101-d462-4cc1-908b-9a5c0ce2b1b5 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:48:56 user nova-compute[72201]: WARNING nova.compute.manager [req-a74cad2d-9fa0-4dd3-a9e5-e0483c62bf07 req-6322b876-c338-446b-bbf2-468cdb9b8d4f service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Received unexpected event network-vif-plugged-7478a101-d462-4cc1-908b-9a5c0ce2b1b5 for instance with vm_state building and task_state spawning.
Aug 01 15:48:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:48:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:48:56 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:48:56 user nova-compute[72201]: INFO nova.compute.manager [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Took 5.96 seconds to spawn the instance on the hypervisor.
Aug 01 15:48:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:48:56 user nova-compute[72201]: INFO nova.compute.manager [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Took 6.73 seconds to build instance.
Aug 01 15:48:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b756147d-cc37-4079-ace9-dcb160b39389 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.827s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:48:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:48:57 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-0db8b603-0e02-4943-a8c2-6233ac3beb4e tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Snapshot image upload complete
Aug 01 15:48:57 user nova-compute[72201]: INFO nova.compute.manager [None req-0db8b603-0e02-4943-a8c2-6233ac3beb4e tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Took 4.83 seconds to snapshot the instance on the hypervisor.
Aug 01 15:48:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:48:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:48:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:48:59 user nova-compute[72201]: INFO nova.compute.manager [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Unshelving
Aug 01 15:48:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:48:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:48:59 user nova-compute[72201]: DEBUG nova.objects.instance [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'pci_requests' on Instance uuid c1120ed7-15d6-4c45-9949-4bf59be4c2c0 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:48:59 user nova-compute[72201]: DEBUG nova.objects.instance [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'numa_topology' on Instance uuid c1120ed7-15d6-4c45-9949-4bf59be4c2c0 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:48:59 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:48:59 user nova-compute[72201]: INFO nova.compute.claims [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Claim successful on node user
Aug 01 15:48:59 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:48:59 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:48:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:48:59 user nova-compute[72201]: INFO nova.network.neutron [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Updating port 5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 15:49:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "refresh_cache-c1120ed7-15d6-4c45-9949-4bf59be4c2c0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:49:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquired lock "refresh_cache-c1120ed7-15d6-4c45-9949-4bf59be4c2c0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:49:00 user nova-compute[72201]: DEBUG nova.network.neutron [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:49:00 user nova-compute[72201]: DEBUG nova.compute.manager [req-c18a5c7a-3946-403a-b355-e86a9959101d req-004555de-4f81-4281-b21b-b3768d95c3e7 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Received event network-changed-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:49:00 user nova-compute[72201]: DEBUG nova.compute.manager [req-c18a5c7a-3946-403a-b355-e86a9959101d req-004555de-4f81-4281-b21b-b3768d95c3e7 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Refreshing instance network info cache due to event network-changed-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:49:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c18a5c7a-3946-403a-b355-e86a9959101d req-004555de-4f81-4281-b21b-b3768d95c3e7 service nova] Acquiring lock "refresh_cache-c1120ed7-15d6-4c45-9949-4bf59be4c2c0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:49:01 user nova-compute[72201]: DEBUG nova.network.neutron [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Updating instance_info_cache with network_info: [{"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:49:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Releasing lock "refresh_cache-c1120ed7-15d6-4c45-9949-4bf59be4c2c0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:49:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:49:01 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Creating image(s)
Aug 01 15:49:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:49:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "/opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:49:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "/opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:49:01 user nova-compute[72201]: DEBUG nova.objects.instance [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'trusted_certs' on Instance uuid c1120ed7-15d6-4c45-9949-4bf59be4c2c0 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:49:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c18a5c7a-3946-403a-b355-e86a9959101d req-004555de-4f81-4281-b21b-b3768d95c3e7 service nova] Acquired lock "refresh_cache-c1120ed7-15d6-4c45-9949-4bf59be4c2c0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:49:01 user nova-compute[72201]: DEBUG nova.network.neutron [req-c18a5c7a-3946-403a-b355-e86a9959101d req-004555de-4f81-4281-b21b-b3768d95c3e7 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Refreshing network info cache for port 5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:49:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "d06d5a0f7806ee60e9cc869b5b8df6ebb242164f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:49:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "d06d5a0f7806ee60e9cc869b5b8df6ebb242164f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:49:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d06d5a0f7806ee60e9cc869b5b8df6ebb242164f.part --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:49:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d06d5a0f7806ee60e9cc869b5b8df6ebb242164f.part --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:49:02 user nova-compute[72201]: DEBUG nova.virt.images [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] c0220614-5065-428f-9c1d-2dbb4841e514 was qcow2, converting to raw {{(pid=72201) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 15:49:02 user nova-compute[72201]: DEBUG nova.privsep.utils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72201) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 15:49:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d06d5a0f7806ee60e9cc869b5b8df6ebb242164f.part /opt/stack/data/nova/instances/_base/d06d5a0f7806ee60e9cc869b5b8df6ebb242164f.converted {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:49:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d06d5a0f7806ee60e9cc869b5b8df6ebb242164f.part /opt/stack/data/nova/instances/_base/d06d5a0f7806ee60e9cc869b5b8df6ebb242164f.converted" returned: 0 in 0.312s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:49:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d06d5a0f7806ee60e9cc869b5b8df6ebb242164f.converted --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:49:03 user nova-compute[72201]: DEBUG nova.network.neutron [req-c18a5c7a-3946-403a-b355-e86a9959101d req-004555de-4f81-4281-b21b-b3768d95c3e7 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Updated VIF entry in instance network info cache for port 5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:49:03 user nova-compute[72201]: DEBUG nova.network.neutron [req-c18a5c7a-3946-403a-b355-e86a9959101d req-004555de-4f81-4281-b21b-b3768d95c3e7 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Updating instance_info_cache with network_info: [{"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:49:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c18a5c7a-3946-403a-b355-e86a9959101d req-004555de-4f81-4281-b21b-b3768d95c3e7 service nova] Releasing lock "refresh_cache-c1120ed7-15d6-4c45-9949-4bf59be4c2c0" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:49:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d06d5a0f7806ee60e9cc869b5b8df6ebb242164f.converted --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:49:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "d06d5a0f7806ee60e9cc869b5b8df6ebb242164f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.428s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:49:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d06d5a0f7806ee60e9cc869b5b8df6ebb242164f --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:49:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d06d5a0f7806ee60e9cc869b5b8df6ebb242164f --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:49:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "d06d5a0f7806ee60e9cc869b5b8df6ebb242164f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:49:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "d06d5a0f7806ee60e9cc869b5b8df6ebb242164f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:49:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d06d5a0f7806ee60e9cc869b5b8df6ebb242164f --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:49:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d06d5a0f7806ee60e9cc869b5b8df6ebb242164f --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:49:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d06d5a0f7806ee60e9cc869b5b8df6ebb242164f,backing_fmt=raw /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:49:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d06d5a0f7806ee60e9cc869b5b8df6ebb242164f,backing_fmt=raw /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk 1073741824" returned: 0 in 0.052s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:49:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "d06d5a0f7806ee60e9cc869b5b8df6ebb242164f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:49:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d06d5a0f7806ee60e9cc869b5b8df6ebb242164f --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:49:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d06d5a0f7806ee60e9cc869b5b8df6ebb242164f --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:49:03 user nova-compute[72201]: DEBUG nova.objects.instance [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'migration_context' on Instance uuid c1120ed7-15d6-4c45-9949-4bf59be4c2c0 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:49:03 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Rebasing disk image.
Aug 01 15:49:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:49:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:49:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba -F raw /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba -F raw /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk" returned: 0 in 1.851s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Ensure instance console log exists: /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Start _get_guest_xml network_info=[{"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='6c3a9c8c77f5a9f7675bd6469f364eb4',container_format='bare',created_at=2023-08-01T15:47:07Z,direct_url=<?>,disk_format='qcow2',id=c0220614-5065-428f-9c1d-2dbb4841e514,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-21922150-shelved',owner='fbe1b0601b564f789cbd45138114e95b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T15:47:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:49:05 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:49:05 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6c3a9c8c77f5a9f7675bd6469f364eb4',container_format='bare',created_at=2023-08-01T15:47:07Z,direct_url=<?>,disk_format='qcow2',id=c0220614-5065-428f-9c1d-2dbb4841e514,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-21922150-shelved',owner='fbe1b0601b564f789cbd45138114e95b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T15:47:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.objects.instance [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'vcpu_model' on Instance uuid c1120ed7-15d6-4c45-9949-4bf59be4c2c0 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T15:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-21922150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-21922150',id=40,image_ref='c0220614-5065-428f-9c1d-2dbb4841e514',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2143760373',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fbe1b0601b564f789cbd45138114e95b',ramdisk_id='',reservation_id='r-48jtcvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-858719582',owner_user_name='tempest-AttachVolumeShelveTestJSON-858719582-project-member',shelved_at='2023-08-01T15:47:11.227319',shelved_host='user',shelved_image_id='c0220614-5065-428f-9c1d-2dbb4841e514'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2caf51668cff454284097f6e91661c17',uuid=c1120ed7-15d6-4c45-9949-4bf59be4c2c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converting VIF {"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:8b:2d,bridge_name='br-int',has_traffic_filtering=True,id=5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4c3a15-35') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.objects.instance [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'pci_devices' on Instance uuid c1120ed7-15d6-4c45-9949-4bf59be4c2c0 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:49:05 user nova-compute[72201]:   <uuid>c1120ed7-15d6-4c45-9949-4bf59be4c2c0</uuid>
Aug 01 15:49:05 user nova-compute[72201]:   <name>instance-00000028</name>
Aug 01 15:49:05 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:49:05 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:49:05 user nova-compute[72201]:   <metadata>
Aug 01 15:49:05 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:49:05 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:49:05 user nova-compute[72201]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-21922150</nova:name>
Aug 01 15:49:05 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:49:05</nova:creationTime>
Aug 01 15:49:05 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:49:05 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:49:05 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:49:05 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:49:05 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:49:05 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:49:05 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:49:05 user nova-compute[72201]:       <nova:owner>
Aug 01 15:49:05 user nova-compute[72201]:         <nova:user uuid="2caf51668cff454284097f6e91661c17">tempest-AttachVolumeShelveTestJSON-858719582-project-member</nova:user>
Aug 01 15:49:05 user nova-compute[72201]:         <nova:project uuid="fbe1b0601b564f789cbd45138114e95b">tempest-AttachVolumeShelveTestJSON-858719582</nova:project>
Aug 01 15:49:05 user nova-compute[72201]:       </nova:owner>
Aug 01 15:49:05 user nova-compute[72201]:       <nova:root type="image" uuid="c0220614-5065-428f-9c1d-2dbb4841e514"/>
Aug 01 15:49:05 user nova-compute[72201]:       <nova:ports>
Aug 01 15:49:05 user nova-compute[72201]:         <nova:port uuid="5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a">
Aug 01 15:49:05 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 15:49:05 user nova-compute[72201]:         </nova:port>
Aug 01 15:49:05 user nova-compute[72201]:       </nova:ports>
Aug 01 15:49:05 user nova-compute[72201]:     </nova:instance>
Aug 01 15:49:05 user nova-compute[72201]:   </metadata>
Aug 01 15:49:05 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:49:05 user nova-compute[72201]:     <system>
Aug 01 15:49:05 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:49:05 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:49:05 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:49:05 user nova-compute[72201]:       <entry name="serial">c1120ed7-15d6-4c45-9949-4bf59be4c2c0</entry>
Aug 01 15:49:05 user nova-compute[72201]:       <entry name="uuid">c1120ed7-15d6-4c45-9949-4bf59be4c2c0</entry>
Aug 01 15:49:05 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:49:05 user nova-compute[72201]:     </system>
Aug 01 15:49:05 user nova-compute[72201]:   </sysinfo>
Aug 01 15:49:05 user nova-compute[72201]:   <os>
Aug 01 15:49:05 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:49:05 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:49:05 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:49:05 user nova-compute[72201]:   </os>
Aug 01 15:49:05 user nova-compute[72201]:   <features>
Aug 01 15:49:05 user nova-compute[72201]:     <acpi/>
Aug 01 15:49:05 user nova-compute[72201]:     <apic/>
Aug 01 15:49:05 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:49:05 user nova-compute[72201]:   </features>
Aug 01 15:49:05 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:49:05 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:49:05 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:49:05 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:49:05 user nova-compute[72201]:   </clock>
Aug 01 15:49:05 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:49:05 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:49:05 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:49:05 user nova-compute[72201]:   </cpu>
Aug 01 15:49:05 user nova-compute[72201]:   <devices>
Aug 01 15:49:05 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:49:05 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:49:05 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk"/>
Aug 01 15:49:05 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:49:05 user nova-compute[72201]:     </disk>
Aug 01 15:49:05 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:49:05 user nova-compute[72201]:       <mac address="fa:16:3e:57:8b:2d"/>
Aug 01 15:49:05 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:49:05 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:49:05 user nova-compute[72201]:       <target dev="tap5e4c3a15-35"/>
Aug 01 15:49:05 user nova-compute[72201]:     </interface>
Aug 01 15:49:05 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:49:05 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/console.log" append="off"/>
Aug 01 15:49:05 user nova-compute[72201]:     </serial>
Aug 01 15:49:05 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:49:05 user nova-compute[72201]:     <video>
Aug 01 15:49:05 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:49:05 user nova-compute[72201]:     </video>
Aug 01 15:49:05 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:49:05 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:49:05 user nova-compute[72201]:     </rng>
Aug 01 15:49:05 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:49:05 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:49:05 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:49:05 user nova-compute[72201]:     </memballoon>
Aug 01 15:49:05 user nova-compute[72201]:   </devices>
Aug 01 15:49:05 user nova-compute[72201]: </domain>
Aug 01 15:49:05 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T15:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-21922150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-21922150',id=40,image_ref='c0220614-5065-428f-9c1d-2dbb4841e514',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2143760373',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fbe1b0601b564f789cbd45138114e95b',ramdisk_id='',reservation_id='r-48jtcvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-858719582',owner_user_name='tempest-AttachVolumeShelveTestJSON-858719582-project-member',shelved_at='2023-08-01T15:47:11.227319',shelved_host='user',shelved_image_id='c0220614-5065-428f-9c1d-2dbb4841e514'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2caf51668cff454284097f6e91661c17',uuid=c1120ed7-15d6-4c45-9949-4bf59be4c2c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converting VIF {"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:8b:2d,bridge_name='br-int',has_traffic_filtering=True,id=5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4c3a15-35') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG os_vif [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:8b:2d,bridge_name='br-int',has_traffic_filtering=True,id=5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4c3a15-35') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e4c3a15-35, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e4c3a15-35, col_values=(('external_ids', {'iface-id': '5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:8b:2d', 'vm-uuid': 'c1120ed7-15d6-4c45-9949-4bf59be4c2c0'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:05 user nova-compute[72201]: INFO os_vif [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:8b:2d,bridge_name='br-int',has_traffic_filtering=True,id=5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4c3a15-35')
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:49:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] No VIF found with MAC fa:16:3e:57:8b:2d, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:49:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-1d60f7c3-c20c-4831-b53e-6744339877dc req-7e6b279e-c9ee-42e8-b611-61272bec9d50 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Received event network-vif-plugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:49:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1d60f7c3-c20c-4831-b53e-6744339877dc req-7e6b279e-c9ee-42e8-b611-61272bec9d50 service nova] Acquiring lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:49:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1d60f7c3-c20c-4831-b53e-6744339877dc req-7e6b279e-c9ee-42e8-b611-61272bec9d50 service nova] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:49:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1d60f7c3-c20c-4831-b53e-6744339877dc req-7e6b279e-c9ee-42e8-b611-61272bec9d50 service nova] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:49:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-1d60f7c3-c20c-4831-b53e-6744339877dc req-7e6b279e-c9ee-42e8-b611-61272bec9d50 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] No waiting events found dispatching network-vif-plugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:49:07 user nova-compute[72201]: WARNING nova.compute.manager [req-1d60f7c3-c20c-4831-b53e-6744339877dc req-7e6b279e-c9ee-42e8-b611-61272bec9d50 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Received unexpected event network-vif-plugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 15:49:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-71a9d1e6-9437-45e1-9974-89d9cd661af7 req-1982257e-c195-4ada-8409-c7141d99e8c5 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Received event network-vif-plugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:49:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-71a9d1e6-9437-45e1-9974-89d9cd661af7 req-1982257e-c195-4ada-8409-c7141d99e8c5 service nova] Acquiring lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:49:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-71a9d1e6-9437-45e1-9974-89d9cd661af7 req-1982257e-c195-4ada-8409-c7141d99e8c5 service nova] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:49:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-71a9d1e6-9437-45e1-9974-89d9cd661af7 req-1982257e-c195-4ada-8409-c7141d99e8c5 service nova] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:49:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-71a9d1e6-9437-45e1-9974-89d9cd661af7 req-1982257e-c195-4ada-8409-c7141d99e8c5 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] No waiting events found dispatching network-vif-plugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:49:09 user nova-compute[72201]: WARNING nova.compute.manager [req-71a9d1e6-9437-45e1-9974-89d9cd661af7 req-1982257e-c195-4ada-8409-c7141d99e8c5 service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Received unexpected event network-vif-plugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 15:49:09 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904949.6366088, c1120ed7-15d6-4c45-9949-4bf59be4c2c0 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:49:09 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] VM Resumed (Lifecycle Event)
Aug 01 15:49:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:49:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:49:09 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Instance spawned successfully.
Aug 01 15:49:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:49:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:49:09 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:49:09 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690904949.6402495, c1120ed7-15d6-4c45-9949-4bf59be4c2c0 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:49:09 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] VM Started (Lifecycle Event)
Aug 01 15:49:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:49:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:49:09 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:49:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:49:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cd718019-f661-458e-84a8-45a1ac481191 tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.545s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:49:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:17 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:49:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:21 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:49:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:49:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-e4f06d05-b05a-459c-9a44-0af858b2570d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:49:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-e4f06d05-b05a-459c-9a44-0af858b2570d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:49:21 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:49:21 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Updating instance_info_cache with network_info: [{"id": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "address": "fa:16:3e:77:73:42", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd914fa0-b0", "ovs_interfaceid": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:49:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-e4f06d05-b05a-459c-9a44-0af858b2570d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:49:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:49:21 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:49:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:25 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:49:25 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:49:25 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:49:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:49:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:49:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:49:25 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:49:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:49:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:49:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:49:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:49:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:49:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:49:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:49:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:49:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:49:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:49:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:49:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:49:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:49:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:49:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:49:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:49:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:49:26 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:49:26 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:49:26 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8329MB free_disk=25.066402435302734GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:49:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:49:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:49:27 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f0743332-223f-4507-b8b1-40d63b7b5e80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:49:27 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:49:27 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e4f06d05-b05a-459c-9a44-0af858b2570d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:49:27 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 27dfe137-c422-4c0b-b7c0-8cb2935806b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:49:27 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance c1120ed7-15d6-4c45-9949-4bf59be4c2c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:49:27 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:49:27 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:49:27 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:49:27 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:49:27 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:49:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:49:28 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:49:29 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:49:29 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:49:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:49:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:49:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:49:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:49:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:49:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:49:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:49:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:49:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:49:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:49:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "53b64583-bd6a-4829-9ecb-379c28c96246" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:49:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "53b64583-bd6a-4829-9ecb-379c28c96246" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:49:58 user nova-compute[72201]: DEBUG nova.compute.manager [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:49:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:49:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:49:58 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:49:58 user nova-compute[72201]: INFO nova.compute.claims [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Claim successful on node user
Aug 01 15:49:59 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:49:59 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:49:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:49:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:49:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:49:59 user nova-compute[72201]: DEBUG nova.network.neutron [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:49:59 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:49:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:49:59 user nova-compute[72201]: INFO nova.virt.block_device [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Booting with volume-backed-image 73af296a-4f5f-49df-a90d-46b9fdcd9a3f at /dev/vda
Aug 01 15:49:59 user nova-compute[72201]: DEBUG nova.policy [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75b0cb34dac64c61a235470454e0c6bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed7463cb6f84c4a8cf1ef0437eca988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:49:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:00 user nova-compute[72201]: DEBUG nova.network.neutron [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Successfully created port: 499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:50:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:00 user nova-compute[72201]: DEBUG nova.network.neutron [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Successfully updated port: 499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:50:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "refresh_cache-53b64583-bd6a-4829-9ecb-379c28c96246" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:50:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquired lock "refresh_cache-53b64583-bd6a-4829-9ecb-379c28c96246" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:50:00 user nova-compute[72201]: DEBUG nova.network.neutron [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:50:00 user nova-compute[72201]: DEBUG nova.compute.manager [req-262d9f87-01e8-48d5-9f36-db4b2449f543 req-c3374ea7-3419-4a03-af7b-16377ff2a779 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received event network-changed-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:50:00 user nova-compute[72201]: DEBUG nova.compute.manager [req-262d9f87-01e8-48d5-9f36-db4b2449f543 req-c3374ea7-3419-4a03-af7b-16377ff2a779 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Refreshing instance network info cache due to event network-changed-499a4d61-525d-46d6-9232-4a1b945cd6b2. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:50:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-262d9f87-01e8-48d5-9f36-db4b2449f543 req-c3374ea7-3419-4a03-af7b-16377ff2a779 service nova] Acquiring lock "refresh_cache-53b64583-bd6a-4829-9ecb-379c28c96246" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:50:00 user nova-compute[72201]: DEBUG nova.network.neutron [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:50:01 user nova-compute[72201]: DEBUG nova.network.neutron [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Updating instance_info_cache with network_info: [{"id": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "address": "fa:16:3e:0f:a9:68", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a4d61-52", "ovs_interfaceid": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:50:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Releasing lock "refresh_cache-53b64583-bd6a-4829-9ecb-379c28c96246" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:50:01 user nova-compute[72201]: DEBUG nova.compute.manager [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Instance network_info: |[{"id": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "address": "fa:16:3e:0f:a9:68", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a4d61-52", "ovs_interfaceid": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:50:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-262d9f87-01e8-48d5-9f36-db4b2449f543 req-c3374ea7-3419-4a03-af7b-16377ff2a779 service nova] Acquired lock "refresh_cache-53b64583-bd6a-4829-9ecb-379c28c96246" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:50:01 user nova-compute[72201]: DEBUG nova.network.neutron [req-262d9f87-01e8-48d5-9f36-db4b2449f543 req-c3374ea7-3419-4a03-af7b-16377ff2a779 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Refreshing network info cache for port 499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:50:01 user nova-compute[72201]: DEBUG nova.network.neutron [req-262d9f87-01e8-48d5-9f36-db4b2449f543 req-c3374ea7-3419-4a03-af7b-16377ff2a779 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Updated VIF entry in instance network info cache for port 499a4d61-525d-46d6-9232-4a1b945cd6b2. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:50:01 user nova-compute[72201]: DEBUG nova.network.neutron [req-262d9f87-01e8-48d5-9f36-db4b2449f543 req-c3374ea7-3419-4a03-af7b-16377ff2a779 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Updating instance_info_cache with network_info: [{"id": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "address": "fa:16:3e:0f:a9:68", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a4d61-52", "ovs_interfaceid": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:50:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-262d9f87-01e8-48d5-9f36-db4b2449f543 req-c3374ea7-3419-4a03-af7b-16377ff2a779 service nova] Releasing lock "refresh_cache-53b64583-bd6a-4829-9ecb-379c28c96246" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:50:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG os_brick.utils [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b3d009-aeab-4c70-8383-45eec51c445d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[25dff8bb-8532-4747-8c82-a17cd3c41d7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a52a67-debc-4dad-a12c-29398b34f67c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a8ae5f-17fb-4b35-85e3-32bcb0a223ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:50:10 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:50:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c31354c-a575-4343-8356-deed602e19ba]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG os_brick.utils [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Updating existing volume attachment record: 59ded670-9805-4142-b222-71e833937a9c {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:50:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:50:17 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Creating image(s)
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Did not create local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Ensure instance console log exists: /opt/stack/data/nova/instances/53b64583-bd6a-4829-9ecb-379c28c96246/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Start _get_guest_xml network_info=[{"id": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "address": "fa:16:3e:0f:a9:68", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a4d61-52", "ovs_interfaceid": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmNvetFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '53b64583-bd6a-4829-9ecb-379c28c96246', 'attached_at': '', 'detached_at': '', 'volume_id': '75e9b879-945d-47c3-a7a7-a18b08ada059', 'serial': '75e9b879-945d-47c3-a7a7-a18b08ada059'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '59ded670-9805-4142-b222-71e833937a9c', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:50:17 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:50:17 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmNvetFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:50:17 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:50:17 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:50:17 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f307ab2-cc8b-4471-ad60-76af6aa8bc3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:50:17 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d558f922-aa0f-4a87-83f7-798322d3349f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059] added
Aug 01 15:50:17 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1af6e7-4c95-4f6a-80b6-f69c0b08080f]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[005613a6-f884-4b22-99d0-d61be1c696d2]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmNvetFd {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmNvetFd" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba98bd8-8ebd-4599-87e5-a236ee61577d]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HmNvetFd'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[616ef9f3-fbbc-4bd2-965f-609906715dae]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b384ad55-b929-4a92-8305-88dd2c277dfe]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:50:17 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:50:17 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e89846-cbe9-445a-9c5b-a3a91a3bf86a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059, portal: 172.16.0.220,3260]
Aug 01 15:50:17 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059, portal: 172.16.0.220,3260] successful.
Aug 01 15:50:17 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8855ce20-829f-4f67-86e5-2e96722d3e4a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdf8f56-c0d9-481d-b3e7-f2f34cf04f83]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:50:17 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:50:17 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:50:17 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:50:17 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.035s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f5eb28-2378-4bab-96d9-1279935ada82]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:17 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmNvetFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26263373266636561', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263373266636561', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:49:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-756195912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-756195912',id=43,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ed7463cb6f84c4a8cf1ef0437eca988',ramdisk_id='',reservation_id='r-oon0yq4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:49:59Z,user_data=None,user_id='75b0cb34dac64c61a235470454e0c6bf',uuid=53b64583-bd6a-4829-9ecb-379c28c96246,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "address": "fa:16:3e:0f:a9:68", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a4d61-52", "ovs_interfaceid": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converting VIF {"id": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "address": "fa:16:3e:0f:a9:68", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a4d61-52", "ovs_interfaceid": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a9:68,bridge_name='br-int',has_traffic_filtering=True,id=499a4d61-525d-46d6-9232-4a1b945cd6b2,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499a4d61-52') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG nova.objects.instance [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'pci_devices' on Instance uuid 53b64583-bd6a-4829-9ecb-379c28c96246 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:50:18 user nova-compute[72201]:   <uuid>53b64583-bd6a-4829-9ecb-379c28c96246</uuid>
Aug 01 15:50:18 user nova-compute[72201]:   <name>instance-0000002b</name>
Aug 01 15:50:18 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:50:18 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:50:18 user nova-compute[72201]:   <metadata>
Aug 01 15:50:18 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:50:18 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:50:18 user nova-compute[72201]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-756195912</nova:name>
Aug 01 15:50:18 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:50:17</nova:creationTime>
Aug 01 15:50:18 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:50:18 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:50:18 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:50:18 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:50:18 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:50:18 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:50:18 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:50:18 user nova-compute[72201]:       <nova:owner>
Aug 01 15:50:18 user nova-compute[72201]:         <nova:user uuid="75b0cb34dac64c61a235470454e0c6bf">tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member</nova:user>
Aug 01 15:50:18 user nova-compute[72201]:         <nova:project uuid="2ed7463cb6f84c4a8cf1ef0437eca988">tempest-ServerBootFromVolumeStableRescueTest-1836467291</nova:project>
Aug 01 15:50:18 user nova-compute[72201]:       </nova:owner>
Aug 01 15:50:18 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:50:18 user nova-compute[72201]:       <nova:ports>
Aug 01 15:50:18 user nova-compute[72201]:         <nova:port uuid="499a4d61-525d-46d6-9232-4a1b945cd6b2">
Aug 01 15:50:18 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 15:50:18 user nova-compute[72201]:         </nova:port>
Aug 01 15:50:18 user nova-compute[72201]:       </nova:ports>
Aug 01 15:50:18 user nova-compute[72201]:     </nova:instance>
Aug 01 15:50:18 user nova-compute[72201]:   </metadata>
Aug 01 15:50:18 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:50:18 user nova-compute[72201]:     <system>
Aug 01 15:50:18 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:50:18 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:50:18 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:50:18 user nova-compute[72201]:       <entry name="serial">53b64583-bd6a-4829-9ecb-379c28c96246</entry>
Aug 01 15:50:18 user nova-compute[72201]:       <entry name="uuid">53b64583-bd6a-4829-9ecb-379c28c96246</entry>
Aug 01 15:50:18 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:50:18 user nova-compute[72201]:     </system>
Aug 01 15:50:18 user nova-compute[72201]:   </sysinfo>
Aug 01 15:50:18 user nova-compute[72201]:   <os>
Aug 01 15:50:18 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:50:18 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:50:18 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:50:18 user nova-compute[72201]:   </os>
Aug 01 15:50:18 user nova-compute[72201]:   <features>
Aug 01 15:50:18 user nova-compute[72201]:     <acpi/>
Aug 01 15:50:18 user nova-compute[72201]:     <apic/>
Aug 01 15:50:18 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:50:18 user nova-compute[72201]:   </features>
Aug 01 15:50:18 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:50:18 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:50:18 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:50:18 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:50:18 user nova-compute[72201]:   </clock>
Aug 01 15:50:18 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:50:18 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:50:18 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:50:18 user nova-compute[72201]:   </cpu>
Aug 01 15:50:18 user nova-compute[72201]:   <devices>
Aug 01 15:50:18 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:50:18 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:50:18 user nova-compute[72201]:       <source dev="/dev/sdb"/>
Aug 01 15:50:18 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:50:18 user nova-compute[72201]:       <serial>75e9b879-945d-47c3-a7a7-a18b08ada059</serial>
Aug 01 15:50:18 user nova-compute[72201]:     </disk>
Aug 01 15:50:18 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:50:18 user nova-compute[72201]:       <mac address="fa:16:3e:0f:a9:68"/>
Aug 01 15:50:18 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:50:18 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:50:18 user nova-compute[72201]:       <target dev="tap499a4d61-52"/>
Aug 01 15:50:18 user nova-compute[72201]:     </interface>
Aug 01 15:50:18 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:50:18 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/53b64583-bd6a-4829-9ecb-379c28c96246/console.log" append="off"/>
Aug 01 15:50:18 user nova-compute[72201]:     </serial>
Aug 01 15:50:18 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:50:18 user nova-compute[72201]:     <video>
Aug 01 15:50:18 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:50:18 user nova-compute[72201]:     </video>
Aug 01 15:50:18 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:50:18 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:50:18 user nova-compute[72201]:     </rng>
Aug 01 15:50:18 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:50:18 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:50:18 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:50:18 user nova-compute[72201]:     </memballoon>
Aug 01 15:50:18 user nova-compute[72201]:   </devices>
Aug 01 15:50:18 user nova-compute[72201]: </domain>
Aug 01 15:50:18 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:49:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-756195912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-756195912',id=43,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ed7463cb6f84c4a8cf1ef0437eca988',ramdisk_id='',reservation_id='r-oon0yq4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:49:59Z,user_data=None,user_id='75b0cb34dac64c61a235470454e0c6bf',uuid=53b64583-bd6a-4829-9ecb-379c28c96246,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "address": "fa:16:3e:0f:a9:68", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a4d61-52", "ovs_interfaceid": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converting VIF {"id": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "address": "fa:16:3e:0f:a9:68", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a4d61-52", "ovs_interfaceid": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a9:68,bridge_name='br-int',has_traffic_filtering=True,id=499a4d61-525d-46d6-9232-4a1b945cd6b2,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499a4d61-52') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG os_vif [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a9:68,bridge_name='br-int',has_traffic_filtering=True,id=499a4d61-525d-46d6-9232-4a1b945cd6b2,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499a4d61-52') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap499a4d61-52, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap499a4d61-52, col_values=(('external_ids', {'iface-id': '499a4d61-525d-46d6-9232-4a1b945cd6b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:a9:68', 'vm-uuid': '53b64583-bd6a-4829-9ecb-379c28c96246'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:50:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:18 user nova-compute[72201]: INFO os_vif [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a9:68,bridge_name='br-int',has_traffic_filtering=True,id=499a4d61-525d-46d6-9232-4a1b945cd6b2,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499a4d61-52')
Aug 01 15:50:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:50:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] No VIF found with MAC fa:16:3e:0f:a9:68, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:50:19 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:50:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:20 user nova-compute[72201]: DEBUG nova.compute.manager [req-d2e5dac6-dcb5-4126-b950-9501a4d39a00 req-7b654a20-53d6-414a-9645-0fe072110e53 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received event network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:50:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d2e5dac6-dcb5-4126-b950-9501a4d39a00 req-7b654a20-53d6-414a-9645-0fe072110e53 service nova] Acquiring lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:50:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d2e5dac6-dcb5-4126-b950-9501a4d39a00 req-7b654a20-53d6-414a-9645-0fe072110e53 service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:50:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d2e5dac6-dcb5-4126-b950-9501a4d39a00 req-7b654a20-53d6-414a-9645-0fe072110e53 service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:50:20 user nova-compute[72201]: DEBUG nova.compute.manager [req-d2e5dac6-dcb5-4126-b950-9501a4d39a00 req-7b654a20-53d6-414a-9645-0fe072110e53 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] No waiting events found dispatching network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:50:20 user nova-compute[72201]: WARNING nova.compute.manager [req-d2e5dac6-dcb5-4126-b950-9501a4d39a00 req-7b654a20-53d6-414a-9645-0fe072110e53 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received unexpected event network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 for instance with vm_state building and task_state spawning.
Aug 01 15:50:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:22 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:50:22 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690905022.4077296, 53b64583-bd6a-4829-9ecb-379c28c96246 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:50:22 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] VM Resumed (Lifecycle Event)
Aug 01 15:50:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:50:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:50:22 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Instance spawned successfully.
Aug 01 15:50:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:50:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:50:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:50:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:50:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:50:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:50:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:50:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:50:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:50:22 user nova-compute[72201]: DEBUG nova.compute.manager [req-eb3caf16-9b43-4da8-9288-b89ceba70ebd req-f3803384-39c8-4a6b-84df-d8dd5d8157b8 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received event network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:50:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-eb3caf16-9b43-4da8-9288-b89ceba70ebd req-f3803384-39c8-4a6b-84df-d8dd5d8157b8 service nova] Acquiring lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:50:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-eb3caf16-9b43-4da8-9288-b89ceba70ebd req-f3803384-39c8-4a6b-84df-d8dd5d8157b8 service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:50:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-eb3caf16-9b43-4da8-9288-b89ceba70ebd req-f3803384-39c8-4a6b-84df-d8dd5d8157b8 service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:50:22 user nova-compute[72201]: DEBUG nova.compute.manager [req-eb3caf16-9b43-4da8-9288-b89ceba70ebd req-f3803384-39c8-4a6b-84df-d8dd5d8157b8 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] No waiting events found dispatching network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:50:22 user nova-compute[72201]: WARNING nova.compute.manager [req-eb3caf16-9b43-4da8-9288-b89ceba70ebd req-f3803384-39c8-4a6b-84df-d8dd5d8157b8 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received unexpected event network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 for instance with vm_state building and task_state spawning.
Aug 01 15:50:22 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:50:22 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690905022.4089096, 53b64583-bd6a-4829-9ecb-379c28c96246 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:50:22 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] VM Started (Lifecycle Event)
Aug 01 15:50:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:50:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:50:22 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:50:22 user nova-compute[72201]: INFO nova.compute.manager [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Took 5.00 seconds to spawn the instance on the hypervisor.
Aug 01 15:50:22 user nova-compute[72201]: DEBUG nova.compute.manager [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:50:22 user nova-compute[72201]: INFO nova.compute.manager [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Took 23.81 seconds to build instance.
Aug 01 15:50:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-76bbb56c-bab7-4f10-8c2d-9b97c349453d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "53b64583-bd6a-4829-9ecb-379c28c96246" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.914s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:50:23 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:50:23 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:50:23 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 15:50:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:50:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:50:23 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:50:23 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid f0743332-223f-4507-b8b1-40d63b7b5e80 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:50:23 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Updating instance_info_cache with network_info: [{"id": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "address": "fa:16:3e:6a:5e:e0", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6062f511-71", "ovs_interfaceid": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:50:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:50:23 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:50:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:25 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:50:25 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:50:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:50:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:50:25 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:50:25 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:50:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:50:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:50:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:27 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:50:27 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:50:27 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8328MB free_disk=25.064254760742188GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:50:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:50:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:50:27 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f0743332-223f-4507-b8b1-40d63b7b5e80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:50:27 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:50:27 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e4f06d05-b05a-459c-9a44-0af858b2570d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:50:27 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 27dfe137-c422-4c0b-b7c0-8cb2935806b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:50:27 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance c1120ed7-15d6-4c45-9949-4bf59be4c2c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:50:27 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 53b64583-bd6a-4829-9ecb-379c28c96246 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:50:27 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:50:27 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:50:27 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:50:27 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:50:27 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:50:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:50:28 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:50:28 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:50:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:29 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:50:31 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:50:31 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:50:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:50:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:50:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:50:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:50:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:50:39 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:50:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:40 user nova-compute[72201]: DEBUG nova.compute.manager [req-c32d5bf3-9ce4-4983-a0e9-8048e5a7fc14 req-fe1dd440-a4d5-496e-ac1f-5524a582ddbf service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Received event network-changed-7478a101-d462-4cc1-908b-9a5c0ce2b1b5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:50:40 user nova-compute[72201]: DEBUG nova.compute.manager [req-c32d5bf3-9ce4-4983-a0e9-8048e5a7fc14 req-fe1dd440-a4d5-496e-ac1f-5524a582ddbf service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Refreshing instance network info cache due to event network-changed-7478a101-d462-4cc1-908b-9a5c0ce2b1b5. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:50:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c32d5bf3-9ce4-4983-a0e9-8048e5a7fc14 req-fe1dd440-a4d5-496e-ac1f-5524a582ddbf service nova] Acquiring lock "refresh_cache-27dfe137-c422-4c0b-b7c0-8cb2935806b1" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:50:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c32d5bf3-9ce4-4983-a0e9-8048e5a7fc14 req-fe1dd440-a4d5-496e-ac1f-5524a582ddbf service nova] Acquired lock "refresh_cache-27dfe137-c422-4c0b-b7c0-8cb2935806b1" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:50:40 user nova-compute[72201]: DEBUG nova.network.neutron [req-c32d5bf3-9ce4-4983-a0e9-8048e5a7fc14 req-fe1dd440-a4d5-496e-ac1f-5524a582ddbf service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Refreshing network info cache for port 7478a101-d462-4cc1-908b-9a5c0ce2b1b5 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:50:41 user nova-compute[72201]: DEBUG nova.network.neutron [req-c32d5bf3-9ce4-4983-a0e9-8048e5a7fc14 req-fe1dd440-a4d5-496e-ac1f-5524a582ddbf service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Updated VIF entry in instance network info cache for port 7478a101-d462-4cc1-908b-9a5c0ce2b1b5. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:50:41 user nova-compute[72201]: DEBUG nova.network.neutron [req-c32d5bf3-9ce4-4983-a0e9-8048e5a7fc14 req-fe1dd440-a4d5-496e-ac1f-5524a582ddbf service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Updating instance_info_cache with network_info: [{"id": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "address": "fa:16:3e:0c:e1:85", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7478a101-d4", "ovs_interfaceid": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:50:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c32d5bf3-9ce4-4983-a0e9-8048e5a7fc14 req-fe1dd440-a4d5-496e-ac1f-5524a582ddbf service nova] Releasing lock "refresh_cache-27dfe137-c422-4c0b-b7c0-8cb2935806b1" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:50:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG nova.objects.instance [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'flavor' on Instance uuid 27dfe137-c422-4c0b-b7c0-8cb2935806b1 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:50:44 user nova-compute[72201]: INFO nova.compute.manager [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Attaching volume 0f6e03f8-ccab-4057-bd3d-8f9627734bc9 to /dev/vdb
Aug 01 15:50:44 user nova-compute[72201]: DEBUG os_brick.utils [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0713c6f-4228-4402-8a97-fdf2f4da83c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f02f9c-f7a7-4985-a9f4-6662523a3789]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[15071f37-4241-4641-8530-5ed1a62cd20f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[76237992-58be-47b1-820c-9d47f980d626]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:50:44 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:50:44 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c4e329-a5db-498b-a53a-c16699be72ff]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG os_brick.utils [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:50:44 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Updating existing volume attachment record: 376e4cb3-8259-4667-ab28-a717dc56286c {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:50:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:50:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:50:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:50:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:50:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:50:49 user nova-compute[72201]: INFO nova.compute.manager [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Terminating instance
Aug 01 15:50:49 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:50:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-a0c98b19-1b8b-471a-b58f-ac945bd713f9 req-7363e9f5-4dbd-413d-9eb8-ac8c6065aaae service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Received event network-vif-unplugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:50:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a0c98b19-1b8b-471a-b58f-ac945bd713f9 req-7363e9f5-4dbd-413d-9eb8-ac8c6065aaae service nova] Acquiring lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:50:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a0c98b19-1b8b-471a-b58f-ac945bd713f9 req-7363e9f5-4dbd-413d-9eb8-ac8c6065aaae service nova] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:50:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a0c98b19-1b8b-471a-b58f-ac945bd713f9 req-7363e9f5-4dbd-413d-9eb8-ac8c6065aaae service nova] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:50:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-a0c98b19-1b8b-471a-b58f-ac945bd713f9 req-7363e9f5-4dbd-413d-9eb8-ac8c6065aaae service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] No waiting events found dispatching network-vif-unplugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:50:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-a0c98b19-1b8b-471a-b58f-ac945bd713f9 req-7363e9f5-4dbd-413d-9eb8-ac8c6065aaae service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Received event network-vif-unplugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:50:50 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Instance destroyed successfully.
Aug 01 15:50:50 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lazy-loading 'resources' on Instance uuid c1120ed7-15d6-4c45-9949-4bf59be4c2c0 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:50:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T15:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-21922150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-21922150',id=40,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQ7fCan9R/LO3/o5uRQNerNLwjF3c0FjKZQZ6wJkoAlnRCkjfKf7HrcJXA0edFSt/4HZ6yiyiLzvckXXuRRY9eKAx2iUqC+q3sOcLS8IYNO4r3rCdUoFv23o2p1n0gcFQ==',key_name='tempest-keypair-2143760373',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:49:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbe1b0601b564f789cbd45138114e95b',ramdisk_id='',reservation_id='r-48jtcvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-858719582',owner_user_name='tempest-AttachVolumeShelveTestJSON-858719582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:49:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2caf51668cff454284097f6e91661c17',uuid=c1120ed7-15d6-4c45-9949-4bf59be4c2c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:50:50 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converting VIF {"id": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "address": "fa:16:3e:57:8b:2d", "network": {"id": "59d666c0-6b04-4a38-b496-16c9b319bbc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-414374997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbe1b0601b564f789cbd45138114e95b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4c3a15-35", "ovs_interfaceid": "5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:50:50 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:8b:2d,bridge_name='br-int',has_traffic_filtering=True,id=5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4c3a15-35') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:50:50 user nova-compute[72201]: DEBUG os_vif [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:8b:2d,bridge_name='br-int',has_traffic_filtering=True,id=5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4c3a15-35') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:50:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e4c3a15-35, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:50:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:50:50 user nova-compute[72201]: INFO os_vif [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:8b:2d,bridge_name='br-int',has_traffic_filtering=True,id=5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a,network=Network(59d666c0-6b04-4a38-b496-16c9b319bbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4c3a15-35')
Aug 01 15:50:50 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Deleting instance files /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0_del
Aug 01 15:50:50 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Deletion of /opt/stack/data/nova/instances/c1120ed7-15d6-4c45-9949-4bf59be4c2c0_del complete
Aug 01 15:50:50 user nova-compute[72201]: INFO nova.compute.manager [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 15:50:50 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:50:50 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:50:50 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:50:51 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:50:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiOIgnZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:50:51 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:50:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:50:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:50:51 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:50:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:50:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:50:51 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:50:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:51 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cbbd0b-b5cf-4ac0-a27b-9b0bc761fac2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:50:51 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:50:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:51 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7044576-8193-420b-86b0-1c72ff3bec64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9] added
Aug 01 15:50:51 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa359a6-14b7-44df-8e44-bf96e4f94b06]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9415d541-77e3-4009-8186-966f9012ec1e]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UiOIgnZV {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UiOIgnZV" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6714e334-a8b2-4bbb-9b95-a6a6d505f1d1]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UiOIgnZV'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG nova.compute.manager [req-b292c085-a779-4a1a-9b55-c0faff51f439 req-9706358f-e98a-4b50-8e89-d6209fe62e7c service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Received event network-vif-plugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b292c085-a779-4a1a-9b55-c0faff51f439 req-9706358f-e98a-4b50-8e89-d6209fe62e7c service nova] Acquiring lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b292c085-a779-4a1a-9b55-c0faff51f439 req-9706358f-e98a-4b50-8e89-d6209fe62e7c service nova] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b292c085-a779-4a1a-9b55-c0faff51f439 req-9706358f-e98a-4b50-8e89-d6209fe62e7c service nova] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG nova.compute.manager [req-b292c085-a779-4a1a-9b55-c0faff51f439 req-9706358f-e98a-4b50-8e89-d6209fe62e7c service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] No waiting events found dispatching network-vif-plugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:50:52 user nova-compute[72201]: WARNING nova.compute.manager [req-b292c085-a779-4a1a-9b55-c0faff51f439 req-9706358f-e98a-4b50-8e89-d6209fe62e7c service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Received unexpected event network-vif-plugged-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a for instance with vm_state active and task_state deleting.
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4976bef5-cd03-430e-b781-b332c304fccb]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fbb5f9-8111-4fe2-9520-92c9c1369c00]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:50:52 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:50:52 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:50:52 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:50:52 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a393ba-2853-4e95-bf34-7caa3456178f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9, portal: 172.16.0.220,3260]
Aug 01 15:50:52 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9, portal: 172.16.0.220,3260] successful.
Aug 01 15:50:52 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbc6400-f136-4285-bd6c-70831327835f]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:50:52 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Took 1.60 seconds to deallocate network for instance.
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd3afbb-d9a1-4955-b7f1-68199bda3ae8]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:50:52 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:50:52 user nova-compute[72201]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 (non-flash)
Aug 01 15:50:52 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:50:52 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:50:52 user nova-compute[72201]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 (non-flash)
Aug 01 15:50:52 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21562a4-0d74-42a2-94ce-d8db908c396a]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiOIgnZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:50:52 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Deleted allocations for instance c1120ed7-15d6-4c45-9949-4bf59be4c2c0
Aug 01 15:50:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8e3dece-7b5f-49a2-83f3-460b39371c8b tempest-AttachVolumeShelveTestJSON-858719582 tempest-AttachVolumeShelveTestJSON-858719582-project-member] Lock "c1120ed7-15d6-4c45-9949-4bf59be4c2c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.863s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:50:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:50:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26335333131323733', 'path': '/dev/sdd'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:50:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335333131323733', 'path': '/dev/sdd'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:50:53 user nova-compute[72201]: DEBUG nova.objects.instance [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'flavor' on Instance uuid 27dfe137-c422-4c0b-b7c0-8cb2935806b1 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:50:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:50:53 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:50:53 user nova-compute[72201]:   <source dev="/dev/sdd"/>
Aug 01 15:50:53 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:50:53 user nova-compute[72201]:   <serial>0f6e03f8-ccab-4057-bd3d-8f9627734bc9</serial>
Aug 01 15:50:53 user nova-compute[72201]: </disk>
Aug 01 15:50:53 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:50:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:50:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:50:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] No VIF found with MAC fa:16:3e:0c:e1:85, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:50:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-619b2d4c-bdfa-4439-81f1-79fb4379de76 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.294s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:50:54 user nova-compute[72201]: DEBUG nova.compute.manager [req-e5f6e62b-aa77-4205-af84-239d5df9a68c req-966753d6-ac1b-480c-8e25-7439f96b99fc service nova] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Received event network-vif-deleted-5e4c3a15-3513-4f7b-9d5f-5f3a87718b0a {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:50:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG nova.objects.instance [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'flavor' on Instance uuid 27dfe137-c422-4c0b-b7c0-8cb2935806b1 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:50:58 user nova-compute[72201]: INFO nova.compute.manager [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Attaching volume e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad to /dev/vdc
Aug 01 15:50:58 user nova-compute[72201]: DEBUG os_brick.utils [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0b6bc5-55f9-4a72-9946-9f7cfde47387]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f13e9c-92ac-4980-9a5f-2cbb8423836c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[be97da03-750c-49c8-859e-0a9aea76743c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[844c5e27-29f8-4f84-a280-c967b4bb3b19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:50:58 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:50:58 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9b8336-1859-46c0-8a75-8c0e23e62d56]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG os_brick.utils [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:50:58 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Updating existing volume attachment record: 6af50dee-de6a-45bf-a28d-c538a48a822e {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:50:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:05 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690905050.5046551, c1120ed7-15d6-4c45-9949-4bf59be4c2c0 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:51:05 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] VM Stopped (Lifecycle Event)
Aug 01 15:51:05 user nova-compute[72201]: DEBUG nova.compute.manager [None req-762b34c4-7d6d-456f-9738-2e9b8f88d3e1 None None] [instance: c1120ed7-15d6-4c45-9949-4bf59be4c2c0] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:51:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RPbtpykw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:51:10 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:51:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:51:10 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:51:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:51:10 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c185e6e0-3fb6-49d4-a51a-7cb53d44e82e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:51:10 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8928c310-e248-426c-ac39-3d32c2783627]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad] added
Aug 01 15:51:10 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7627094d-3c97-4037-9fb6-0325e1830326]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fa9d5a-a6f2-418e-b702-cfc154d96114]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RPbtpykw {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RPbtpykw" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c31efb-83f3-46c9-9bd3-57564d2974c2]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RPbtpykw'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaa36b7-bd10-4169-9890-320c19bf981c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8749606e-40af-41e7-93b0-070bfe6577d5]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:51:10 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:51:10 user nova-compute[72201]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 (non-flash)
Aug 01 15:51:10 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:51:10 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:51:10 user nova-compute[72201]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 (non-flash)
Aug 01 15:51:10 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff649f3-9b75-47c8-bbb7-2e9221580518]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad, portal: 172.16.0.220,3260]
Aug 01 15:51:11 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad, portal: 172.16.0.220,3260] successful.
Aug 01 15:51:11 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:51:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b38765e-dc05-4ebc-905a-b7b263afed34]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:51:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a580a37e-073e-4cec-b713-cffc6524c689]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:51:11 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:51:11 user nova-compute[72201]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 (non-flash)
Aug 01 15:51:11 user nova-compute[72201]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad (non-flash)
Aug 01 15:51:11 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:51:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:51:11 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:51:11 user nova-compute[72201]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 (non-flash)
Aug 01 15:51:11 user nova-compute[72201]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad (non-flash)
Aug 01 15:51:11 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:51:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:51:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:51:11 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:51:11 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:51:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cddcc55-1f2b-4ee2-9f27-8e877a4a2823]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:11 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:51:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RPbtpykw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:51:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:51:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23734363336303662', 'path': '/dev/sde'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:51:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734363336303662', 'path': '/dev/sde'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:51:12 user nova-compute[72201]: DEBUG nova.objects.instance [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'flavor' on Instance uuid 27dfe137-c422-4c0b-b7c0-8cb2935806b1 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:51:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:51:12 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:51:12 user nova-compute[72201]:   <source dev="/dev/sde"/>
Aug 01 15:51:12 user nova-compute[72201]:   <target dev="vdc" bus="virtio"/>
Aug 01 15:51:12 user nova-compute[72201]:   <serial>e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad</serial>
Aug 01 15:51:12 user nova-compute[72201]: </disk>
Aug 01 15:51:12 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:51:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:51:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:51:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:51:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] No VIF found with MAC fa:16:3e:0c:e1:85, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:51:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-05352085-0d9f-4e87-b813-3eb90427ced1 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.387s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:51:14 user nova-compute[72201]: INFO nova.compute.manager [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Detaching volume 0f6e03f8-ccab-4057-bd3d-8f9627734bc9
Aug 01 15:51:14 user nova-compute[72201]: INFO nova.virt.block_device [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Attempting to driver detach volume 0f6e03f8-ccab-4057-bd3d-8f9627734bc9 from mountpoint /dev/vdb
Aug 01 15:51:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Attempting to detach device vdb from instance 27dfe137-c422-4c0b-b7c0-8cb2935806b1 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:51:14 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:51:14 user nova-compute[72201]:   <source dev="/dev/sdd"/>
Aug 01 15:51:14 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:51:14 user nova-compute[72201]:   <serial>0f6e03f8-ccab-4057-bd3d-8f9627734bc9</serial>
Aug 01 15:51:14 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:51:14 user nova-compute[72201]: </disk>
Aug 01 15:51:14 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:51:14 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Successfully detached device vdb from instance 27dfe137-c422-4c0b-b7c0-8cb2935806b1 from the persistent domain config.
Aug 01 15:51:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 27dfe137-c422-4c0b-b7c0-8cb2935806b1 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:51:14 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:51:14 user nova-compute[72201]:   <source dev="/dev/sdd"/>
Aug 01 15:51:14 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:51:14 user nova-compute[72201]:   <serial>0f6e03f8-ccab-4057-bd3d-8f9627734bc9</serial>
Aug 01 15:51:14 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:51:14 user nova-compute[72201]: </disk>
Aug 01 15:51:14 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690905074.530113, 27dfe137-c422-4c0b-b7c0-8cb2935806b1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 27dfe137-c422-4c0b-b7c0-8cb2935806b1 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:51:14 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Successfully detached device vdb from instance 27dfe137-c422-4c0b-b7c0-8cb2935806b1 from the live domain config.
Aug 01 15:51:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiOIgnZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:51:14 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:51:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d653ea8d-5d5a-4cec-88a6-6576056ca382]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22eab1b-f6a4-4c5e-b4c2-0644a737e9f2]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:51:14 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:51:14 user nova-compute[72201]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 (non-flash)
Aug 01 15:51:14 user nova-compute[72201]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad (non-flash)
Aug 01 15:51:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:51:14 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:51:14 user nova-compute[72201]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 (non-flash)
Aug 01 15:51:14 user nova-compute[72201]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad (non-flash)
Aug 01 15:51:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c180940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9'): ({'sdd'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Removing single pathed devices sdd {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e68329-a492-4928-aae6-0a3067619291]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[97784a83-8ec4-4ef8-96b3-f2d5173d4e25]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Flushing IO for device /dev/sdd {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df8b38e-4975-4191-af2c-6c007a43ec9d]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0945769-cf25-4767-92de-8209691e0174]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] SCSI volumes sdd have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f7ff9a-36e5-43ae-9356-6f09bb83c57e]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7333cbcf-2100-4875-b48e-17e01cbde15d]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9, portal: 172.16.0.220,3260]
Aug 01 15:51:14 user nova-compute[72201]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9, portal: 172.16.0.220,3260] successful.
Aug 01 15:51:14 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f6e03f8-ccab-4057-bd3d-8f9627734bc9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba315ced-d0d2-44f9-89da-f5a33992f7f0]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] <== disconnect_volume: return (296ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:51:14 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:51:15 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:51:15 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72201) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 15:51:15 user nova-compute[72201]: DEBUG nova.objects.instance [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'flavor' on Instance uuid 27dfe137-c422-4c0b-b7c0-8cb2935806b1 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:51:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-c8e1ad27-2c20-4311-b593-76a621c9036d tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.578s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:51:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:51:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:51:16 user nova-compute[72201]: INFO nova.compute.manager [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Detaching volume e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad
Aug 01 15:51:16 user nova-compute[72201]: INFO nova.virt.block_device [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Attempting to driver detach volume e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad from mountpoint /dev/vdc
Aug 01 15:51:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Attempting to detach device vdc from instance 27dfe137-c422-4c0b-b7c0-8cb2935806b1 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:51:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:51:16 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:51:16 user nova-compute[72201]:   <source dev="/dev/sde"/>
Aug 01 15:51:16 user nova-compute[72201]:   <target dev="vdc" bus="virtio"/>
Aug 01 15:51:16 user nova-compute[72201]:   <serial>e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad</serial>
Aug 01 15:51:16 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 15:51:16 user nova-compute[72201]: </disk>
Aug 01 15:51:16 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:51:16 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Successfully detached device vdc from instance 27dfe137-c422-4c0b-b7c0-8cb2935806b1 from the persistent domain config.
Aug 01 15:51:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 27dfe137-c422-4c0b-b7c0-8cb2935806b1 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:51:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:51:16 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:51:16 user nova-compute[72201]:   <source dev="/dev/sde"/>
Aug 01 15:51:16 user nova-compute[72201]:   <target dev="vdc" bus="virtio"/>
Aug 01 15:51:16 user nova-compute[72201]:   <serial>e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad</serial>
Aug 01 15:51:16 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 15:51:16 user nova-compute[72201]: </disk>
Aug 01 15:51:16 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:51:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690905076.9375384, 27dfe137-c422-4c0b-b7c0-8cb2935806b1 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:51:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 27dfe137-c422-4c0b-b7c0-8cb2935806b1 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:51:16 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Successfully detached device vdc from instance 27dfe137-c422-4c0b-b7c0-8cb2935806b1 from the live domain config.
Aug 01 15:51:16 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:51:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RPbtpykw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:51:16 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:51:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:51:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:51:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:51:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:16 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17a23ef-99d5-4cda-a287-6ba0166fa38c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ef9b24-a022-441b-8c08-cc1e54209681]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:51:17 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:51:17 user nova-compute[72201]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad (non-flash)
Aug 01 15:51:17 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:51:17 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:51:17 user nova-compute[72201]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad (non-flash)
Aug 01 15:51:17 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc54414f130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad'): ({'sde'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Removing single pathed devices sde {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4d1a72-012c-4b02-83f7-108ce91adc8a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[602ef8ad-abe7-4810-85d6-19c9768ba139]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Flushing IO for device /dev/sde {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b953b4-114e-4d64-8aaf-60e1edca621e]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9accc7-f5ba-4d98-9f5b-271906fa8d80]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] SCSI volumes sde have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b1d982-1a96-42c9-b91d-574d358b9c91]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c04b37b-c3ed-4c26-87ce-467181ba4509]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad, portal: 172.16.0.220,3260]
Aug 01 15:51:17 user nova-compute[72201]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad, portal: 172.16.0.220,3260] successful.
Aug 01 15:51:17 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3ebe0f3-0f25-41c4-8c8f-c5de214a47ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2643cec3-37c7-47b2-891a-8929966aac2b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] <== disconnect_volume: return (293ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:51:17 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:51:18 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'flavor' on Instance uuid 27dfe137-c422-4c0b-b7c0-8cb2935806b1 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:51:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ffdb2e96-cacb-4047-abc2-55fa5be42871 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.705s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:51:19 user nova-compute[72201]: INFO nova.compute.manager [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Terminating instance
Aug 01 15:51:19 user nova-compute[72201]: DEBUG nova.compute.manager [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG nova.compute.manager [req-ffa1369e-bfa6-47c8-884c-659e6c3e98b6 req-662c30db-54b1-4057-892f-977a33430422 service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Received event network-vif-unplugged-7478a101-d462-4cc1-908b-9a5c0ce2b1b5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ffa1369e-bfa6-47c8-884c-659e6c3e98b6 req-662c30db-54b1-4057-892f-977a33430422 service nova] Acquiring lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ffa1369e-bfa6-47c8-884c-659e6c3e98b6 req-662c30db-54b1-4057-892f-977a33430422 service nova] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ffa1369e-bfa6-47c8-884c-659e6c3e98b6 req-662c30db-54b1-4057-892f-977a33430422 service nova] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG nova.compute.manager [req-ffa1369e-bfa6-47c8-884c-659e6c3e98b6 req-662c30db-54b1-4057-892f-977a33430422 service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] No waiting events found dispatching network-vif-unplugged-7478a101-d462-4cc1-908b-9a5c0ce2b1b5 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG nova.compute.manager [req-ffa1369e-bfa6-47c8-884c-659e6c3e98b6 req-662c30db-54b1-4057-892f-977a33430422 service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Received event network-vif-unplugged-7478a101-d462-4cc1-908b-9a5c0ce2b1b5 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:19 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Instance destroyed successfully.
Aug 01 15:51:19 user nova-compute[72201]: DEBUG nova.objects.instance [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lazy-loading 'resources' on Instance uuid 27dfe137-c422-4c0b-b7c0-8cb2935806b1 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:48:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-610200022',display_name='tempest-AttachVolumeTestJSON-server-610200022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-610200022',id=42,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApN0k1TNcZzPS0ncHOwIRF0A0QKEjXgNRD3d/wUNZS/8nnR+oRuxEt3tZbiduGf0PLJgqXvrzVvWz0mEH6JWvLrfufXB1Uc2vCeFB4Xg3kCrMzrZ1FsSR26C2pC59Joqg==',key_name='tempest-keypair-85936855',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:48:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b9978ab74a743b6870f1a86469debb4',ramdisk_id='',reservation_id='r-48a5sxt8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-570587534',owner_user_name='tempest-AttachVolumeTestJSON-570587534-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:48:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='243e1aae552d43b7b892618022460e1b',uuid=27dfe137-c422-4c0b-b7c0-8cb2935806b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "address": "fa:16:3e:0c:e1:85", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7478a101-d4", "ovs_interfaceid": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converting VIF {"id": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "address": "fa:16:3e:0c:e1:85", "network": {"id": "ffd8c7cf-0c02-402c-b89c-25df7801b47c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202395501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b9978ab74a743b6870f1a86469debb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7478a101-d4", "ovs_interfaceid": "7478a101-d462-4cc1-908b-9a5c0ce2b1b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:e1:85,bridge_name='br-int',has_traffic_filtering=True,id=7478a101-d462-4cc1-908b-9a5c0ce2b1b5,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7478a101-d4') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG os_vif [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:e1:85,bridge_name='br-int',has_traffic_filtering=True,id=7478a101-d462-4cc1-908b-9a5c0ce2b1b5,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7478a101-d4') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7478a101-d4, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:51:19 user nova-compute[72201]: INFO os_vif [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:e1:85,bridge_name='br-int',has_traffic_filtering=True,id=7478a101-d462-4cc1-908b-9a5c0ce2b1b5,network=Network(ffd8c7cf-0c02-402c-b89c-25df7801b47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7478a101-d4')
Aug 01 15:51:19 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Deleting instance files /opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1_del
Aug 01 15:51:19 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Deletion of /opt/stack/data/nova/instances/27dfe137-c422-4c0b-b7c0-8cb2935806b1_del complete
Aug 01 15:51:19 user nova-compute[72201]: INFO nova.compute.manager [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 15:51:19 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:51:19 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:51:20 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:51:20 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Took 1.05 seconds to deallocate network for instance.
Aug 01 15:51:20 user nova-compute[72201]: DEBUG nova.compute.manager [req-2eba8381-a850-48d9-b63e-e320d8776dea req-c8bb77a6-6ac7-40a3-aa54-05dd8cb10529 service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Received event network-vif-deleted-7478a101-d462-4cc1-908b-9a5c0ce2b1b5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:51:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:51:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:51:21 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:51:21 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:51:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:51:21 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Deleted allocations for instance 27dfe137-c422-4c0b-b7c0-8cb2935806b1
Aug 01 15:51:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7248a514-f4f5-4acf-ab48-6170f993c405 tempest-AttachVolumeTestJSON-570587534 tempest-AttachVolumeTestJSON-570587534-project-member] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.261s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:51:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-a35226d4-f02e-464d-a9f8-a21f675c13c6 req-0ca34606-4388-4558-946a-0ac6540c04ec service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Received event network-vif-plugged-7478a101-d462-4cc1-908b-9a5c0ce2b1b5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:51:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a35226d4-f02e-464d-a9f8-a21f675c13c6 req-0ca34606-4388-4558-946a-0ac6540c04ec service nova] Acquiring lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:51:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a35226d4-f02e-464d-a9f8-a21f675c13c6 req-0ca34606-4388-4558-946a-0ac6540c04ec service nova] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:51:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a35226d4-f02e-464d-a9f8-a21f675c13c6 req-0ca34606-4388-4558-946a-0ac6540c04ec service nova] Lock "27dfe137-c422-4c0b-b7c0-8cb2935806b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:51:21 user nova-compute[72201]: DEBUG nova.compute.manager [req-a35226d4-f02e-464d-a9f8-a21f675c13c6 req-0ca34606-4388-4558-946a-0ac6540c04ec service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] No waiting events found dispatching network-vif-plugged-7478a101-d462-4cc1-908b-9a5c0ce2b1b5 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:51:21 user nova-compute[72201]: WARNING nova.compute.manager [req-a35226d4-f02e-464d-a9f8-a21f675c13c6 req-0ca34606-4388-4558-946a-0ac6540c04ec service nova] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Received unexpected event network-vif-plugged-7478a101-d462-4cc1-908b-9a5c0ce2b1b5 for instance with vm_state deleted and task_state None.
Aug 01 15:51:24 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:51:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:51:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:51:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:51:24 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:51:24 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Updating instance_info_cache with network_info: [{"id": "fa130bf4-53dc-43f7-8932-0aec318054d9", "address": "fa:16:3e:92:e7:b2", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa130bf4-53", "ovs_interfaceid": "fa130bf4-53dc-43f7-8932-0aec318054d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:51:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:51:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:51:24 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:51:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:25 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:51:27 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:51:27 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:51:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:51:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:51:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:51:27 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:51:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:51:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:51:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:28 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:51:28 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:51:28 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8428MB free_disk=25.118206024169922GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:51:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:51:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:51:28 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f0743332-223f-4507-b8b1-40d63b7b5e80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:51:28 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:51:28 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e4f06d05-b05a-459c-9a44-0af858b2570d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:51:28 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 53b64583-bd6a-4829-9ecb-379c28c96246 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:51:28 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:51:28 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:51:28 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing inventories for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 15:51:28 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating ProviderTree inventory for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 15:51:28 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating inventory in ProviderTree for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 15:51:28 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing aggregate associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, aggregates: None {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 15:51:28 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing trait associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 15:51:28 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:51:28 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:51:28 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:51:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:51:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:51:30 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:51:30 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:51:31 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:51:33 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:51:33 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:51:34 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690905079.7793171, 27dfe137-c422-4c0b-b7c0-8cb2935806b1 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:51:34 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] VM Stopped (Lifecycle Event)
Aug 01 15:51:34 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ec745342-7bcd-4c12-a6f7-ea47e8a02a6b None None] [instance: 27dfe137-c422-4c0b-b7c0-8cb2935806b1] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:51:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:51:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:51:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:51:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:51:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:51:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:51:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:51:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:51:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:51:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:49 user nova-compute[72201]: INFO nova.compute.manager [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Rescuing
Aug 01 15:51:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "refresh_cache-53b64583-bd6a-4829-9ecb-379c28c96246" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:51:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquired lock "refresh_cache-53b64583-bd6a-4829-9ecb-379c28c96246" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:51:49 user nova-compute[72201]: DEBUG nova.network.neutron [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:51:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:49 user nova-compute[72201]: DEBUG nova.network.neutron [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Updating instance_info_cache with network_info: [{"id": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "address": "fa:16:3e:0f:a9:68", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a4d61-52", "ovs_interfaceid": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:51:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Releasing lock "refresh_cache-53b64583-bd6a-4829-9ecb-379c28c96246" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:51:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-5d8f13a7-0a95-4364-afff-a9ff594eecdd req-45c547c8-ec10-4bd3-b375-8e6d69dc0ace service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received event network-vif-unplugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:51:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5d8f13a7-0a95-4364-afff-a9ff594eecdd req-45c547c8-ec10-4bd3-b375-8e6d69dc0ace service nova] Acquiring lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:51:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5d8f13a7-0a95-4364-afff-a9ff594eecdd req-45c547c8-ec10-4bd3-b375-8e6d69dc0ace service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:51:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5d8f13a7-0a95-4364-afff-a9ff594eecdd req-45c547c8-ec10-4bd3-b375-8e6d69dc0ace service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:51:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-5d8f13a7-0a95-4364-afff-a9ff594eecdd req-45c547c8-ec10-4bd3-b375-8e6d69dc0ace service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] No waiting events found dispatching network-vif-unplugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:51:50 user nova-compute[72201]: WARNING nova.compute.manager [req-5d8f13a7-0a95-4364-afff-a9ff594eecdd req-45c547c8-ec10-4bd3-b375-8e6d69dc0ace service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received unexpected event network-vif-unplugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 for instance with vm_state active and task_state rescuing.
Aug 01 15:51:50 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Instance destroyed successfully.
Aug 01 15:51:50 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Attempting a stable device rescue
Aug 01 15:51:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72201) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 15:51:50 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Instance directory exists: not creating {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 15:51:50 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Creating image(s)
Aug 01 15:51:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "/opt/stack/data/nova/instances/53b64583-bd6a-4829-9ecb-379c28c96246/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:51:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "/opt/stack/data/nova/instances/53b64583-bd6a-4829-9ecb-379c28c96246/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:51:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "/opt/stack/data/nova/instances/53b64583-bd6a-4829-9ecb-379c28c96246/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:51:50 user nova-compute[72201]: DEBUG nova.objects.instance [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'trusted_certs' on Instance uuid 53b64583-bd6a-4829-9ecb-379c28c96246 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:51:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "5845f6b547611e04b5d798cf471ef36cdf7baa42" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:51:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "5845f6b547611e04b5d798cf471ef36cdf7baa42" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:51:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5845f6b547611e04b5d798cf471ef36cdf7baa42.part --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5845f6b547611e04b5d798cf471ef36cdf7baa42.part --force-share --output=json" returned: 0 in 0.206s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:51 user nova-compute[72201]: DEBUG nova.virt.images [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] c381cbbd-1520-4ff7-9c7c-22cbfae97a70 was qcow2, converting to raw {{(pid=72201) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 15:51:51 user nova-compute[72201]: DEBUG nova.privsep.utils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72201) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 15:51:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5845f6b547611e04b5d798cf471ef36cdf7baa42.part /opt/stack/data/nova/instances/_base/5845f6b547611e04b5d798cf471ef36cdf7baa42.converted {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5845f6b547611e04b5d798cf471ef36cdf7baa42.part /opt/stack/data/nova/instances/_base/5845f6b547611e04b5d798cf471ef36cdf7baa42.converted" returned: 0 in 0.302s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5845f6b547611e04b5d798cf471ef36cdf7baa42.converted --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] There are 0 instances to clean {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5845f6b547611e04b5d798cf471ef36cdf7baa42.converted --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "5845f6b547611e04b5d798cf471ef36cdf7baa42" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.512s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "5845f6b547611e04b5d798cf471ef36cdf7baa42" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "5845f6b547611e04b5d798cf471ef36cdf7baa42" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5845f6b547611e04b5d798cf471ef36cdf7baa42 --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5845f6b547611e04b5d798cf471ef36cdf7baa42 --force-share --output=json" returned: 0 in 0.129s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5845f6b547611e04b5d798cf471ef36cdf7baa42,backing_fmt=raw /opt/stack/data/nova/instances/53b64583-bd6a-4829-9ecb-379c28c96246/disk.rescue {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5845f6b547611e04b5d798cf471ef36cdf7baa42,backing_fmt=raw /opt/stack/data/nova/instances/53b64583-bd6a-4829-9ecb-379c28c96246/disk.rescue" returned: 0 in 0.047s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "5845f6b547611e04b5d798cf471ef36cdf7baa42" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.objects.instance [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'migration_context' on Instance uuid 53b64583-bd6a-4829-9ecb-379c28c96246 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Start _get_guest_xml network_info=[{"id": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "address": "fa:16:3e:0f:a9:68", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "vif_mac": "fa:16:3e:0f:a9:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a4d61-52", "ovs_interfaceid": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c381cbbd-1520-4ff7-9c7c-22cbfae97a70', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmNvetFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '53b64583-bd6a-4829-9ecb-379c28c96246', 'attached_at': '', 'detached_at': '', 'volume_id': '75e9b879-945d-47c3-a7a7-a18b08ada059', 'serial': '75e9b879-945d-47c3-a7a7-a18b08ada059'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '59ded670-9805-4142-b222-71e833937a9c', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.objects.instance [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'resources' on Instance uuid 53b64583-bd6a-4829-9ecb-379c28c96246 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.objects.instance [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'numa_topology' on Instance uuid 53b64583-bd6a-4829-9ecb-379c28c96246 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:51:52 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:51:52 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.objects.instance [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'vcpu_model' on Instance uuid 53b64583-bd6a-4829-9ecb-379c28c96246 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmNvetFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:51:52 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:51:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:51:52 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:51:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:51:52 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.compute.manager [req-61c9a70a-4412-4f6f-8f33-7ec7f279763f req-956dfad6-883e-4fa1-a4be-2762f2c73733 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received event network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-61c9a70a-4412-4f6f-8f33-7ec7f279763f req-956dfad6-883e-4fa1-a4be-2762f2c73733 service nova] Acquiring lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-61c9a70a-4412-4f6f-8f33-7ec7f279763f req-956dfad6-883e-4fa1-a4be-2762f2c73733 service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-61c9a70a-4412-4f6f-8f33-7ec7f279763f req-956dfad6-883e-4fa1-a4be-2762f2c73733 service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.compute.manager [req-61c9a70a-4412-4f6f-8f33-7ec7f279763f req-956dfad6-883e-4fa1-a4be-2762f2c73733 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] No waiting events found dispatching network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:51:52 user nova-compute[72201]: WARNING nova.compute.manager [req-61c9a70a-4412-4f6f-8f33-7ec7f279763f req-956dfad6-883e-4fa1-a4be-2762f2c73733 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received unexpected event network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 for instance with vm_state active and task_state rescuing.
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dc122f-ae35-4128-ba90-f2cdf75f2b58]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = HmNvetFd\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 15:51:52 user nova-compute[72201]: node.name = iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059
Aug 01 15:51:52 user nova-compute[72201]: node.tpgt = -1
Aug 01 15:51:52 user nova-compute[72201]: node.startup = automatic
Aug 01 15:51:52 user nova-compute[72201]: node.leading_login = No
Aug 01 15:51:52 user nova-compute[72201]: iface.iscsi_ifacename = default
Aug 01 15:51:52 user nova-compute[72201]: iface.net_ifacename = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.ipaddress = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.prefix_len = 0
Aug 01 15:51:52 user nova-compute[72201]: iface.hwaddress = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.transport_name = tcp
Aug 01 15:51:52 user nova-compute[72201]: iface.initiatorname = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.state = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.vlan_id = 0
Aug 01 15:51:52 user nova-compute[72201]: iface.vlan_priority = 0
Aug 01 15:51:52 user nova-compute[72201]: iface.vlan_state = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.iface_num = 0
Aug 01 15:51:52 user nova-compute[72201]: iface.mtu = 0
Aug 01 15:51:52 user nova-compute[72201]: iface.port = 0
Aug 01 15:51:52 user nova-compute[72201]: iface.bootproto = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.subnet_mask = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.gateway = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.dhcp_alt_client_id = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.dhcp_dns = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.dhcp_learn_iqn = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.dhcp_vendor_id_state = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.dhcp_vendor_id = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.dhcp_slp_da = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.fragmentation = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.gratuitous_arp = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.incoming_forwarding = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.tos_state = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.tos = 0
Aug 01 15:51:52 user nova-compute[72201]: iface.ttl = 0
Aug 01 15:51:52 user nova-compute[72201]: iface.delayed_ack = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.tcp_nagle = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.tcp_wsf_state = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.tcp_wsf = 0
Aug 01 15:51:52 user nova-compute[72201]: iface.tcp_timer_scale = 0
Aug 01 15:51:52 user nova-compute[72201]: iface.tcp_timestamp = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.redirect = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.def_task_mgmt_timeout = 0
Aug 01 15:51:52 user nova-compute[72201]: iface.header_digest = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.data_digest = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.immediate_data = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.initial_r2t = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.data_seq_inorder = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.data_pdu_inorder = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.erl = 0
Aug 01 15:51:52 user nova-compute[72201]: iface.max_receive_data_len = 0
Aug 01 15:51:52 user nova-compute[72201]: iface.first_burst_len = 0
Aug 01 15:51:52 user nova-compute[72201]: iface.max_outstanding_r2t = 0
Aug 01 15:51:52 user nova-compute[72201]: iface.max_burst_len = 0
Aug 01 15:51:52 user nova-compute[72201]: iface.chap_auth = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.bidi_chap = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.strict_login_compliance = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.discovery_auth = <empty>
Aug 01 15:51:52 user nova-compute[72201]: iface.discovery_logout = <empty>
Aug 01 15:51:52 user nova-compute[72201]: node.discovery_address = <empty>
Aug 01 15:51:52 user nova-compute[72201]: node.discovery_port = 0
Aug 01 15:51:52 user nova-compute[72201]: node.discovery_type = static
Aug 01 15:51:52 user nova-compute[72201]: node.session.initial_cmdsn = 0
Aug 01 15:51:52 user nova-compute[72201]: node.session.initial_login_retry_max = 8
Aug 01 15:51:52 user nova-compute[72201]: node.session.xmit_thread_priority = -20
Aug 01 15:51:52 user nova-compute[72201]: node.session.cmds_max = 128
Aug 01 15:51:52 user nova-compute[72201]: node.session.queue_depth = 32
Aug 01 15:51:52 user nova-compute[72201]: node.session.nr_sessions = 1
Aug 01 15:51:52 user nova-compute[72201]: node.session.auth.authmethod = CHAP
Aug 01 15:51:52 user nova-compute[72201]: node.session.auth.username = HmNvetFd
Aug 01 15:51:52 user nova-compute[72201]: node.session.auth.password = ***
Aug 01 15:51:52 user nova-compute[72201]: node.session.auth.username_in = <empty>
Aug 01 15:51:52 user nova-compute[72201]: node.session.auth.password_in = <empty>
Aug 01 15:51:52 user nova-compute[72201]: node.session.auth.chap_algs = MD5
Aug 01 15:51:52 user nova-compute[72201]: node.session.timeo.replacement_timeout = 120
Aug 01 15:51:52 user nova-compute[72201]: node.session.err_timeo.abort_timeout = 15
Aug 01 15:51:52 user nova-compute[72201]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 15:51:52 user nova-compute[72201]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 15:51:52 user nova-compute[72201]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 15:51:52 user nova-compute[72201]: node.session.iscsi.FastAbort = Yes
Aug 01 15:51:52 user nova-compute[72201]: node.session.iscsi.InitialR2T = No
Aug 01 15:51:52 user nova-compute[72201]: node.session.iscsi.ImmediateData = Yes
Aug 01 15:51:52 user nova-compute[72201]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 15:51:52 user nova-compute[72201]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 15:51:52 user nova-compute[72201]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 15:51:52 user nova-compute[72201]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 15:51:52 user nova-compute[72201]: node.session.iscsi.MaxConnections = 1
Aug 01 15:51:52 user nova-compute[72201]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 15:51:52 user nova-compute[72201]: node.session.iscsi.ERL = 0
Aug 01 15:51:52 user nova-compute[72201]: node.session.scan = manual
Aug 01 15:51:52 user nova-compute[72201]: node.session.reopen_max = 0
Aug 01 15:51:52 user nova-compute[72201]: node.conn[0].address = 172.16.0.220
Aug 01 15:51:52 user nova-compute[72201]: node.conn[0].port = 3260
Aug 01 15:51:52 user nova-compute[72201]: node.conn[0].startup = manual
Aug 01 15:51:52 user nova-compute[72201]: node.conn[0].tcp.window_size = 524288
Aug 01 15:51:52 user nova-compute[72201]: node.conn[0].tcp.type_of_service = 0
Aug 01 15:51:52 user nova-compute[72201]: node.conn[0].timeo.logout_timeout = 15
Aug 01 15:51:52 user nova-compute[72201]: node.conn[0].timeo.login_timeout = 15
Aug 01 15:51:52 user nova-compute[72201]: node.conn[0].timeo.auth_timeout = 45
Aug 01 15:51:52 user nova-compute[72201]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 15:51:52 user nova-compute[72201]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 15:51:52 user nova-compute[72201]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 15:51:52 user nova-compute[72201]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 15:51:52 user nova-compute[72201]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 15:51:52 user nova-compute[72201]: node.conn[0].iscsi.DataDigest = None
Aug 01 15:51:52 user nova-compute[72201]: node.conn[0].iscsi.IFMarker = No
Aug 01 15:51:52 user nova-compute[72201]: node.conn[0].iscsi.OFMarker = No
Aug 01 15:51:52 user nova-compute[72201]: # END RECORD
Aug 01 15:51:52 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4aac402-5e14-48bc-a611-dc4495471c05]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0028a0-2758-458d-91a3-9a2d3b84c857]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmNvetFd {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmNvetFd" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d41641-d484-4e5a-acf3-093e9f28557a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HmNvetFd'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9520ed90-534b-42e9-8755-d9164417bc32]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[55abe014-8392-4e09-b04d-c0807e2eea87]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:51:52 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:51:52 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:51:52 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:51:52 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.137s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] HCTL ('33', '0', '0', 0) found on session 49 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ecfc70-e15e-444b-96b4-9f8904ecb8a8]: (4, ('0 0 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Searching for a device in session 49 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmNvetFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.164s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] <== connect_volume: return (166ms) {'type': 'block', 'scsi_wwn': '26263373266636561', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263373266636561', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:49:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-756195912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-756195912',id=43,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:50:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ed7463cb6f84c4a8cf1ef0437eca988',ramdisk_id='',reservation_id='r-oon0yq4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:50:23Z,user_data=None,user_id='75b0cb34dac64c61a235470454e0c6bf',uuid=53b64583-bd6a-4829-9ecb-379c28c96246,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "address": "fa:16:3e:0f:a9:68", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "vif_mac": "fa:16:3e:0f:a9:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a4d61-52", "ovs_interfaceid": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converting VIF {"id": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "address": "fa:16:3e:0f:a9:68", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "vif_mac": "fa:16:3e:0f:a9:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a4d61-52", "ovs_interfaceid": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:a9:68,bridge_name='br-int',has_traffic_filtering=True,id=499a4d61-525d-46d6-9232-4a1b945cd6b2,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499a4d61-52') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.objects.instance [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'pci_devices' on Instance uuid 53b64583-bd6a-4829-9ecb-379c28c96246 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:51:52 user nova-compute[72201]:   <uuid>53b64583-bd6a-4829-9ecb-379c28c96246</uuid>
Aug 01 15:51:52 user nova-compute[72201]:   <name>instance-0000002b</name>
Aug 01 15:51:52 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:51:52 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:51:52 user nova-compute[72201]:   <metadata>
Aug 01 15:51:52 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:51:52 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:51:52 user nova-compute[72201]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-756195912</nova:name>
Aug 01 15:51:52 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:51:52</nova:creationTime>
Aug 01 15:51:52 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:51:52 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:51:52 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:51:52 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:51:52 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:51:52 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:51:52 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:51:52 user nova-compute[72201]:       <nova:owner>
Aug 01 15:51:52 user nova-compute[72201]:         <nova:user uuid="75b0cb34dac64c61a235470454e0c6bf">tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member</nova:user>
Aug 01 15:51:52 user nova-compute[72201]:         <nova:project uuid="2ed7463cb6f84c4a8cf1ef0437eca988">tempest-ServerBootFromVolumeStableRescueTest-1836467291</nova:project>
Aug 01 15:51:52 user nova-compute[72201]:       </nova:owner>
Aug 01 15:51:52 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:51:52 user nova-compute[72201]:       <nova:ports>
Aug 01 15:51:52 user nova-compute[72201]:         <nova:port uuid="499a4d61-525d-46d6-9232-4a1b945cd6b2">
Aug 01 15:51:52 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 15:51:52 user nova-compute[72201]:         </nova:port>
Aug 01 15:51:52 user nova-compute[72201]:       </nova:ports>
Aug 01 15:51:52 user nova-compute[72201]:     </nova:instance>
Aug 01 15:51:52 user nova-compute[72201]:   </metadata>
Aug 01 15:51:52 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:51:52 user nova-compute[72201]:     <system>
Aug 01 15:51:52 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:51:52 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:51:52 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:51:52 user nova-compute[72201]:       <entry name="serial">53b64583-bd6a-4829-9ecb-379c28c96246</entry>
Aug 01 15:51:52 user nova-compute[72201]:       <entry name="uuid">53b64583-bd6a-4829-9ecb-379c28c96246</entry>
Aug 01 15:51:52 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:51:52 user nova-compute[72201]:     </system>
Aug 01 15:51:52 user nova-compute[72201]:   </sysinfo>
Aug 01 15:51:52 user nova-compute[72201]:   <os>
Aug 01 15:51:52 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:51:52 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:51:52 user nova-compute[72201]:   </os>
Aug 01 15:51:52 user nova-compute[72201]:   <features>
Aug 01 15:51:52 user nova-compute[72201]:     <acpi/>
Aug 01 15:51:52 user nova-compute[72201]:     <apic/>
Aug 01 15:51:52 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:51:52 user nova-compute[72201]:   </features>
Aug 01 15:51:52 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:51:52 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:51:52 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:51:52 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:51:52 user nova-compute[72201]:   </clock>
Aug 01 15:51:52 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:51:52 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:51:52 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:51:52 user nova-compute[72201]:   </cpu>
Aug 01 15:51:52 user nova-compute[72201]:   <devices>
Aug 01 15:51:52 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:51:52 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:51:52 user nova-compute[72201]:       <source dev="/dev/sdb"/>
Aug 01 15:51:52 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:51:52 user nova-compute[72201]:       <serial>75e9b879-945d-47c3-a7a7-a18b08ada059</serial>
Aug 01 15:51:52 user nova-compute[72201]:     </disk>
Aug 01 15:51:52 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:51:52 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:51:52 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/53b64583-bd6a-4829-9ecb-379c28c96246/disk.rescue"/>
Aug 01 15:51:52 user nova-compute[72201]:       <target dev="vdb" bus="virtio"/>
Aug 01 15:51:52 user nova-compute[72201]:       <boot order="1"/>
Aug 01 15:51:52 user nova-compute[72201]:     </disk>
Aug 01 15:51:52 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:51:52 user nova-compute[72201]:       <mac address="fa:16:3e:0f:a9:68"/>
Aug 01 15:51:52 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:51:52 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:51:52 user nova-compute[72201]:       <target dev="tap499a4d61-52"/>
Aug 01 15:51:52 user nova-compute[72201]:     </interface>
Aug 01 15:51:52 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:51:52 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/53b64583-bd6a-4829-9ecb-379c28c96246/console.log" append="off"/>
Aug 01 15:51:52 user nova-compute[72201]:     </serial>
Aug 01 15:51:52 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:51:52 user nova-compute[72201]:     <video>
Aug 01 15:51:52 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:51:52 user nova-compute[72201]:     </video>
Aug 01 15:51:52 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:51:52 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:51:52 user nova-compute[72201]:     </rng>
Aug 01 15:51:52 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:51:52 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:51:52 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:51:52 user nova-compute[72201]:     </memballoon>
Aug 01 15:51:52 user nova-compute[72201]:   </devices>
Aug 01 15:51:52 user nova-compute[72201]: </domain>
Aug 01 15:51:52 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:51:52 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Instance destroyed successfully.
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:51:52 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] No VIF found with MAC fa:16:3e:0f:a9:68, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:51:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:54 user nova-compute[72201]: DEBUG nova.compute.manager [req-69c34917-d467-46ab-9fa8-74234aa83eb9 req-7ba0d4cb-f2c4-48b9-a8df-3c82e1cda437 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received event network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:51:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-69c34917-d467-46ab-9fa8-74234aa83eb9 req-7ba0d4cb-f2c4-48b9-a8df-3c82e1cda437 service nova] Acquiring lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:51:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-69c34917-d467-46ab-9fa8-74234aa83eb9 req-7ba0d4cb-f2c4-48b9-a8df-3c82e1cda437 service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:51:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-69c34917-d467-46ab-9fa8-74234aa83eb9 req-7ba0d4cb-f2c4-48b9-a8df-3c82e1cda437 service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:51:54 user nova-compute[72201]: DEBUG nova.compute.manager [req-69c34917-d467-46ab-9fa8-74234aa83eb9 req-7ba0d4cb-f2c4-48b9-a8df-3c82e1cda437 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] No waiting events found dispatching network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:51:54 user nova-compute[72201]: WARNING nova.compute.manager [req-69c34917-d467-46ab-9fa8-74234aa83eb9 req-7ba0d4cb-f2c4-48b9-a8df-3c82e1cda437 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received unexpected event network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 for instance with vm_state active and task_state rescuing.
Aug 01 15:51:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Removed pending event for 53b64583-bd6a-4829-9ecb-379c28c96246 due to event {{(pid=72201) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 15:51:56 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690905116.3893838, 53b64583-bd6a-4829-9ecb-379c28c96246 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:51:56 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] VM Resumed (Lifecycle Event)
Aug 01 15:51:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-82a22bcb-ed8d-4093-b0a3-c87eb10930ca tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:51:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:51:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:51:56 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 15:51:56 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690905116.3910863, 53b64583-bd6a-4829-9ecb-379c28c96246 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:51:56 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] VM Started (Lifecycle Event)
Aug 01 15:51:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:51:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:51:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-163ed6aa-7bf0-41e1-bf87-b0fe343eb343 req-b2f897e8-0d9e-44b5-83ac-704da1bc5da5 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received event network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:51:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-163ed6aa-7bf0-41e1-bf87-b0fe343eb343 req-b2f897e8-0d9e-44b5-83ac-704da1bc5da5 service nova] Acquiring lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:51:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-163ed6aa-7bf0-41e1-bf87-b0fe343eb343 req-b2f897e8-0d9e-44b5-83ac-704da1bc5da5 service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:51:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-163ed6aa-7bf0-41e1-bf87-b0fe343eb343 req-b2f897e8-0d9e-44b5-83ac-704da1bc5da5 service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:51:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-163ed6aa-7bf0-41e1-bf87-b0fe343eb343 req-b2f897e8-0d9e-44b5-83ac-704da1bc5da5 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] No waiting events found dispatching network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:51:56 user nova-compute[72201]: WARNING nova.compute.manager [req-163ed6aa-7bf0-41e1-bf87-b0fe343eb343 req-b2f897e8-0d9e-44b5-83ac-704da1bc5da5 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received unexpected event network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 for instance with vm_state rescued and task_state None.
Aug 01 15:51:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:51:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:52:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:52:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:52:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:52:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:52:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:52:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:52:21 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:52:24 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:52:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:52:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-e4f06d05-b05a-459c-9a44-0af858b2570d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:52:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-e4f06d05-b05a-459c-9a44-0af858b2570d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:52:24 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:52:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:52:24 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Updating instance_info_cache with network_info: [{"id": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "address": "fa:16:3e:77:73:42", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd914fa0-b0", "ovs_interfaceid": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:52:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-e4f06d05-b05a-459c-9a44-0af858b2570d" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:52:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:52:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:52:26 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:52:27 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:52:27 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:52:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:52:28 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:52:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:52:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:52:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:52:28 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:52:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:52:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:52:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b64583-bd6a-4829-9ecb-379c28c96246/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:52:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b64583-bd6a-4829-9ecb-379c28c96246/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:52:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b64583-bd6a-4829-9ecb-379c28c96246/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:52:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b64583-bd6a-4829-9ecb-379c28c96246/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:52:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:52:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:52:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:52:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:52:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:52:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:52:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:52:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:52:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:52:29 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:52:29 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:52:29 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8459MB free_disk=25.01198959350586GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:52:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:52:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:52:29 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f0743332-223f-4507-b8b1-40d63b7b5e80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:52:29 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:52:29 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e4f06d05-b05a-459c-9a44-0af858b2570d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:52:29 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 53b64583-bd6a-4829-9ecb-379c28c96246 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:52:29 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:52:29 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:52:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:52:29 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:52:29 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:52:29 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:52:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:52:31 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:52:33 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:52:34 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:52:34 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:52:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:52:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:52:39 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:52:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:52:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:52:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:52:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:52:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:52:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:52:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:52:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "f6b868e7-336a-48de-9a80-01a2a92980e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:53:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "f6b868e7-336a-48de-9a80-01a2a92980e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:53:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:53:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:53:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:53:18 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:53:18 user nova-compute[72201]: INFO nova.compute.claims [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Claim successful on node user
Aug 01 15:53:19 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:53:19 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:53:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:53:19 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:53:19 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:53:19 user nova-compute[72201]: DEBUG nova.network.neutron [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:53:19 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:53:19 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:53:19 user nova-compute[72201]: INFO nova.virt.block_device [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Booting with volume snapshot d60bdc81-34ab-471a-9cf7-a74c89187ae8 at /dev/vda
Aug 01 15:53:19 user nova-compute[72201]: DEBUG nova.policy [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '222a94fd4bed425a8d80ba777c2361f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a49e4769bf348be8fedc8b70f65cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:53:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:19 user nova-compute[72201]: DEBUG nova.network.neutron [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Successfully created port: 0dacd2ba-c940-400f-9b4b-532eecf373b1 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:53:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:20 user nova-compute[72201]: DEBUG nova.network.neutron [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Successfully updated port: 0dacd2ba-c940-400f-9b4b-532eecf373b1 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:53:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "refresh_cache-f6b868e7-336a-48de-9a80-01a2a92980e5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:53:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquired lock "refresh_cache-f6b868e7-336a-48de-9a80-01a2a92980e5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:53:20 user nova-compute[72201]: DEBUG nova.network.neutron [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:53:20 user nova-compute[72201]: DEBUG nova.network.neutron [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:53:20 user nova-compute[72201]: DEBUG nova.compute.manager [req-a03f538b-6426-42bf-b6e3-3f817fa50c4e req-455802ef-3cd2-4929-8f63-d3d8229af1dc service nova] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Received event network-changed-0dacd2ba-c940-400f-9b4b-532eecf373b1 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:53:20 user nova-compute[72201]: DEBUG nova.compute.manager [req-a03f538b-6426-42bf-b6e3-3f817fa50c4e req-455802ef-3cd2-4929-8f63-d3d8229af1dc service nova] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Refreshing instance network info cache due to event network-changed-0dacd2ba-c940-400f-9b4b-532eecf373b1. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:53:20 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a03f538b-6426-42bf-b6e3-3f817fa50c4e req-455802ef-3cd2-4929-8f63-d3d8229af1dc service nova] Acquiring lock "refresh_cache-f6b868e7-336a-48de-9a80-01a2a92980e5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:53:21 user nova-compute[72201]: DEBUG nova.network.neutron [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Updating instance_info_cache with network_info: [{"id": "0dacd2ba-c940-400f-9b4b-532eecf373b1", "address": "fa:16:3e:fd:d3:9d", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dacd2ba-c9", "ovs_interfaceid": "0dacd2ba-c940-400f-9b4b-532eecf373b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:53:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Releasing lock "refresh_cache-f6b868e7-336a-48de-9a80-01a2a92980e5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:53:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Instance network_info: |[{"id": "0dacd2ba-c940-400f-9b4b-532eecf373b1", "address": "fa:16:3e:fd:d3:9d", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dacd2ba-c9", "ovs_interfaceid": "0dacd2ba-c940-400f-9b4b-532eecf373b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:53:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a03f538b-6426-42bf-b6e3-3f817fa50c4e req-455802ef-3cd2-4929-8f63-d3d8229af1dc service nova] Acquired lock "refresh_cache-f6b868e7-336a-48de-9a80-01a2a92980e5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:53:21 user nova-compute[72201]: DEBUG nova.network.neutron [req-a03f538b-6426-42bf-b6e3-3f817fa50c4e req-455802ef-3cd2-4929-8f63-d3d8229af1dc service nova] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Refreshing network info cache for port 0dacd2ba-c940-400f-9b4b-532eecf373b1 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:53:21 user nova-compute[72201]: DEBUG nova.network.neutron [req-a03f538b-6426-42bf-b6e3-3f817fa50c4e req-455802ef-3cd2-4929-8f63-d3d8229af1dc service nova] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Updated VIF entry in instance network info cache for port 0dacd2ba-c940-400f-9b4b-532eecf373b1. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:53:21 user nova-compute[72201]: DEBUG nova.network.neutron [req-a03f538b-6426-42bf-b6e3-3f817fa50c4e req-455802ef-3cd2-4929-8f63-d3d8229af1dc service nova] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Updating instance_info_cache with network_info: [{"id": "0dacd2ba-c940-400f-9b4b-532eecf373b1", "address": "fa:16:3e:fd:d3:9d", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dacd2ba-c9", "ovs_interfaceid": "0dacd2ba-c940-400f-9b4b-532eecf373b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:53:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a03f538b-6426-42bf-b6e3-3f817fa50c4e req-455802ef-3cd2-4929-8f63-d3d8229af1dc service nova] Releasing lock "refresh_cache-f6b868e7-336a-48de-9a80-01a2a92980e5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:53:23 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:53:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:25 user nova-compute[72201]: DEBUG os_brick.utils [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:53:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf1e920-efa1-4fea-9559-f95473e44296]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:53:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a41c22-4377-4d9f-9525-35e0a8b018f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:53:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af773c6-6f4a-46b1-aa8b-215a220d67b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:53:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af7a25d-8d2a-4a15-84e7-ced4d6e55b72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:53:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:53:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:53:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:53:25 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:53:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc1d14e-6002-48d5-9460-aa7643664ccc]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:53:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:53:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:53:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:53:25 user nova-compute[72201]: DEBUG os_brick.utils [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:53:25 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Updating existing volume attachment record: a3904d04-6257-40ff-9840-c17c41a7851f {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:53:26 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:53:26 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:53:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-53b64583-bd6a-4829-9ecb-379c28c96246" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:53:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-53b64583-bd6a-4829-9ecb-379c28c96246" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:53:26 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:53:26 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Updating instance_info_cache with network_info: [{"id": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "address": "fa:16:3e:0f:a9:68", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a4d61-52", "ovs_interfaceid": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:53:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-53b64583-bd6a-4829-9ecb-379c28c96246" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:53:26 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:53:26 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:53:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:28 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:53:29 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:53:29 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:53:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:53:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:53:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:53:29 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:53:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:53:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:53:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b64583-bd6a-4829-9ecb-379c28c96246/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b64583-bd6a-4829-9ecb-379c28c96246/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b64583-bd6a-4829-9ecb-379c28c96246/disk.rescue --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b64583-bd6a-4829-9ecb-379c28c96246/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:30 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:53:30 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:53:30 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8477MB free_disk=25.006561279296875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:53:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:53:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:53:30 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f0743332-223f-4507-b8b1-40d63b7b5e80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:53:30 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:53:30 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e4f06d05-b05a-459c-9a44-0af858b2570d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:53:30 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 53b64583-bd6a-4829-9ecb-379c28c96246 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:53:30 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f6b868e7-336a-48de-9a80-01a2a92980e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:53:30 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:53:30 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:53:30 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:53:30 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:53:30 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:53:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.322s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:53:33 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Creating image(s)
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Did not create local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Ensure instance console log exists: /opt/stack/data/nova/instances/f6b868e7-336a-48de-9a80-01a2a92980e5/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Start _get_guest_xml network_info=[{"id": "0dacd2ba-c940-400f-9b4b-532eecf373b1", "address": "fa:16:3e:fd:d3:9d", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dacd2ba-c9", "ovs_interfaceid": "0dacd2ba-c940-400f-9b4b-532eecf373b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuDNWUht', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f6b868e7-336a-48de-9a80-01a2a92980e5', 'attached_at': '', 'detached_at': '', 'volume_id': '85a827ff-3ad6-42c0-b92f-4e73814c897d', 'serial': '85a827ff-3ad6-42c0-b92f-4e73814c897d'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'a3904d04-6257-40ff-9840-c17c41a7851f', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:53:33 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:53:33 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuDNWUht', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:53:33 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:53:33 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:53:33 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c629f63-d82e-445c-81d2-fb1e44d30965]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:53:33 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6106ce4a-7724-411f-90aa-d16da7a915dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d] added
Aug 01 15:53:33 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[444eb8d0-35a9-47d3-ac7a-209b2e89373a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[365caa7a-32f9-4d27-b5eb-ae5d0e8ed0f8]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VuDNWUht {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VuDNWUht" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bbeb12-bcee-487e-91b2-4d5dcdf981eb]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VuDNWUht'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[33394531-34b4-486e-8295-313dcd02ba3c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[216e118e-8e47-453f-a025-664ff26cdf82]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:53:33 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:53:33 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:53:33 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:53:33 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4210b057-1001-48e6-b891-5ad937e92605]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d, portal: 172.16.0.220,3260]
Aug 01 15:53:33 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d, portal: 172.16.0.220,3260] successful.
Aug 01 15:53:33 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3b91d7-3aa4-45b8-9bba-0c3c5d553b83]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c6e6e1-a16c-453f-be03-d38600f5ccc5]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:53:33 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:53:33 user nova-compute[72201]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d (non-flash)
Aug 01 15:53:33 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:53:33 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:53:33 user nova-compute[72201]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d (non-flash)
Aug 01 15:53:33 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19dee8d-485e-43bc-aecc-546d57c08769]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuDNWUht', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:53:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23637353663366334', 'path': '/dev/sdd'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637353663366334', 'path': '/dev/sdd'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-304429462',display_name='tempest-TestVolumeBootPattern-server-304429462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-304429462',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a49e4769bf348be8fedc8b70f65cea2',ramdisk_id='',reservation_id='r-5jl0gk50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1110722165',owner_user_name='tempest-TestVolumeBootPattern-1110722165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:53:19Z,user_data=None,user_id='222a94fd4bed425a8d80ba777c2361f0',uuid=f6b868e7-336a-48de-9a80-01a2a92980e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dacd2ba-c940-400f-9b4b-532eecf373b1", "address": "fa:16:3e:fd:d3:9d", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dacd2ba-c9", "ovs_interfaceid": "0dacd2ba-c940-400f-9b4b-532eecf373b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converting VIF {"id": "0dacd2ba-c940-400f-9b4b-532eecf373b1", "address": "fa:16:3e:fd:d3:9d", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dacd2ba-c9", "ovs_interfaceid": "0dacd2ba-c940-400f-9b4b-532eecf373b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:d3:9d,bridge_name='br-int',has_traffic_filtering=True,id=0dacd2ba-c940-400f-9b4b-532eecf373b1,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dacd2ba-c9') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG nova.objects.instance [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lazy-loading 'pci_devices' on Instance uuid f6b868e7-336a-48de-9a80-01a2a92980e5 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:53:34 user nova-compute[72201]:   <uuid>f6b868e7-336a-48de-9a80-01a2a92980e5</uuid>
Aug 01 15:53:34 user nova-compute[72201]:   <name>instance-0000002c</name>
Aug 01 15:53:34 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:53:34 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:53:34 user nova-compute[72201]:   <metadata>
Aug 01 15:53:34 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:53:34 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:53:34 user nova-compute[72201]:       <nova:name>tempest-TestVolumeBootPattern-server-304429462</nova:name>
Aug 01 15:53:34 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:53:33</nova:creationTime>
Aug 01 15:53:34 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:53:34 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:53:34 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:53:34 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:53:34 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:53:34 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:53:34 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:53:34 user nova-compute[72201]:       <nova:owner>
Aug 01 15:53:34 user nova-compute[72201]:         <nova:user uuid="222a94fd4bed425a8d80ba777c2361f0">tempest-TestVolumeBootPattern-1110722165-project-member</nova:user>
Aug 01 15:53:34 user nova-compute[72201]:         <nova:project uuid="3a49e4769bf348be8fedc8b70f65cea2">tempest-TestVolumeBootPattern-1110722165</nova:project>
Aug 01 15:53:34 user nova-compute[72201]:       </nova:owner>
Aug 01 15:53:34 user nova-compute[72201]:       <nova:ports>
Aug 01 15:53:34 user nova-compute[72201]:         <nova:port uuid="0dacd2ba-c940-400f-9b4b-532eecf373b1">
Aug 01 15:53:34 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 15:53:34 user nova-compute[72201]:         </nova:port>
Aug 01 15:53:34 user nova-compute[72201]:       </nova:ports>
Aug 01 15:53:34 user nova-compute[72201]:     </nova:instance>
Aug 01 15:53:34 user nova-compute[72201]:   </metadata>
Aug 01 15:53:34 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:53:34 user nova-compute[72201]:     <system>
Aug 01 15:53:34 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:53:34 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:53:34 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:53:34 user nova-compute[72201]:       <entry name="serial">f6b868e7-336a-48de-9a80-01a2a92980e5</entry>
Aug 01 15:53:34 user nova-compute[72201]:       <entry name="uuid">f6b868e7-336a-48de-9a80-01a2a92980e5</entry>
Aug 01 15:53:34 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:53:34 user nova-compute[72201]:     </system>
Aug 01 15:53:34 user nova-compute[72201]:   </sysinfo>
Aug 01 15:53:34 user nova-compute[72201]:   <os>
Aug 01 15:53:34 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:53:34 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:53:34 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:53:34 user nova-compute[72201]:   </os>
Aug 01 15:53:34 user nova-compute[72201]:   <features>
Aug 01 15:53:34 user nova-compute[72201]:     <acpi/>
Aug 01 15:53:34 user nova-compute[72201]:     <apic/>
Aug 01 15:53:34 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:53:34 user nova-compute[72201]:   </features>
Aug 01 15:53:34 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:53:34 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:53:34 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:53:34 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:53:34 user nova-compute[72201]:   </clock>
Aug 01 15:53:34 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:53:34 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:53:34 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:53:34 user nova-compute[72201]:   </cpu>
Aug 01 15:53:34 user nova-compute[72201]:   <devices>
Aug 01 15:53:34 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:53:34 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:53:34 user nova-compute[72201]:       <source dev="/dev/sdd"/>
Aug 01 15:53:34 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:53:34 user nova-compute[72201]:       <serial>85a827ff-3ad6-42c0-b92f-4e73814c897d</serial>
Aug 01 15:53:34 user nova-compute[72201]:     </disk>
Aug 01 15:53:34 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:53:34 user nova-compute[72201]:       <mac address="fa:16:3e:fd:d3:9d"/>
Aug 01 15:53:34 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:53:34 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:53:34 user nova-compute[72201]:       <target dev="tap0dacd2ba-c9"/>
Aug 01 15:53:34 user nova-compute[72201]:     </interface>
Aug 01 15:53:34 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:53:34 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/f6b868e7-336a-48de-9a80-01a2a92980e5/console.log" append="off"/>
Aug 01 15:53:34 user nova-compute[72201]:     </serial>
Aug 01 15:53:34 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:53:34 user nova-compute[72201]:     <video>
Aug 01 15:53:34 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:53:34 user nova-compute[72201]:     </video>
Aug 01 15:53:34 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:53:34 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:53:34 user nova-compute[72201]:     </rng>
Aug 01 15:53:34 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:53:34 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:53:34 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:53:34 user nova-compute[72201]:     </memballoon>
Aug 01 15:53:34 user nova-compute[72201]:   </devices>
Aug 01 15:53:34 user nova-compute[72201]: </domain>
Aug 01 15:53:34 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-304429462',display_name='tempest-TestVolumeBootPattern-server-304429462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-304429462',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a49e4769bf348be8fedc8b70f65cea2',ramdisk_id='',reservation_id='r-5jl0gk50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1110722165',owner_user_name='tempest-TestVolumeBootPattern-1110722165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:53:19Z,user_data=None,user_id='222a94fd4bed425a8d80ba777c2361f0',uuid=f6b868e7-336a-48de-9a80-01a2a92980e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dacd2ba-c940-400f-9b4b-532eecf373b1", "address": "fa:16:3e:fd:d3:9d", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dacd2ba-c9", "ovs_interfaceid": "0dacd2ba-c940-400f-9b4b-532eecf373b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converting VIF {"id": "0dacd2ba-c940-400f-9b4b-532eecf373b1", "address": "fa:16:3e:fd:d3:9d", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dacd2ba-c9", "ovs_interfaceid": "0dacd2ba-c940-400f-9b4b-532eecf373b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:d3:9d,bridge_name='br-int',has_traffic_filtering=True,id=0dacd2ba-c940-400f-9b4b-532eecf373b1,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dacd2ba-c9') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG os_vif [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:d3:9d,bridge_name='br-int',has_traffic_filtering=True,id=0dacd2ba-c940-400f-9b4b-532eecf373b1,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dacd2ba-c9') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0dacd2ba-c9, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0dacd2ba-c9, col_values=(('external_ids', {'iface-id': '0dacd2ba-c940-400f-9b4b-532eecf373b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:d3:9d', 'vm-uuid': 'f6b868e7-336a-48de-9a80-01a2a92980e5'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:34 user nova-compute[72201]: INFO os_vif [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:d3:9d,bridge_name='br-int',has_traffic_filtering=True,id=0dacd2ba-c940-400f-9b4b-532eecf373b1,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dacd2ba-c9')
Aug 01 15:53:34 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:53:34 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] No VIF found with MAC fa:16:3e:fd:d3:9d, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:53:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:36 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:53:36 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:53:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:37 user nova-compute[72201]: DEBUG nova.compute.manager [req-351e6ee7-aef8-4881-ada4-eec4892b2dce req-22c61c7f-e329-4d67-8093-fe387b834666 service nova] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Received event network-vif-plugged-0dacd2ba-c940-400f-9b4b-532eecf373b1 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:53:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-351e6ee7-aef8-4881-ada4-eec4892b2dce req-22c61c7f-e329-4d67-8093-fe387b834666 service nova] Acquiring lock "f6b868e7-336a-48de-9a80-01a2a92980e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:53:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-351e6ee7-aef8-4881-ada4-eec4892b2dce req-22c61c7f-e329-4d67-8093-fe387b834666 service nova] Lock "f6b868e7-336a-48de-9a80-01a2a92980e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:53:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-351e6ee7-aef8-4881-ada4-eec4892b2dce req-22c61c7f-e329-4d67-8093-fe387b834666 service nova] Lock "f6b868e7-336a-48de-9a80-01a2a92980e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:53:37 user nova-compute[72201]: DEBUG nova.compute.manager [req-351e6ee7-aef8-4881-ada4-eec4892b2dce req-22c61c7f-e329-4d67-8093-fe387b834666 service nova] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] No waiting events found dispatching network-vif-plugged-0dacd2ba-c940-400f-9b4b-532eecf373b1 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:53:37 user nova-compute[72201]: WARNING nova.compute.manager [req-351e6ee7-aef8-4881-ada4-eec4892b2dce req-22c61c7f-e329-4d67-8093-fe387b834666 service nova] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Received unexpected event network-vif-plugged-0dacd2ba-c940-400f-9b4b-532eecf373b1 for instance with vm_state building and task_state spawning.
Aug 01 15:53:37 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690905217.9460263, f6b868e7-336a-48de-9a80-01a2a92980e5 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:53:37 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] VM Resumed (Lifecycle Event)
Aug 01 15:53:37 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:53:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:53:37 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:53:37 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Instance spawned successfully.
Aug 01 15:53:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:53:37 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:53:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:53:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:53:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:53:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:53:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:53:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:53:38 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:53:38 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690905217.9473386, f6b868e7-336a-48de-9a80-01a2a92980e5 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:53:38 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] VM Started (Lifecycle Event)
Aug 01 15:53:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:53:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:53:38 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:53:38 user nova-compute[72201]: INFO nova.compute.manager [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Took 4.95 seconds to spawn the instance on the hypervisor.
Aug 01 15:53:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:53:38 user nova-compute[72201]: INFO nova.compute.manager [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Took 19.40 seconds to build instance.
Aug 01 15:53:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3a0f93b6-abe8-4d36-a0c0-4fd2cf499347 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "f6b868e7-336a-48de-9a80-01a2a92980e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.491s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-b842351b-617c-4c7b-85e9-12777834da91 req-bd994659-bacc-4874-8fc4-8ca4203be2b6 service nova] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Received event network-vif-plugged-0dacd2ba-c940-400f-9b4b-532eecf373b1 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b842351b-617c-4c7b-85e9-12777834da91 req-bd994659-bacc-4874-8fc4-8ca4203be2b6 service nova] Acquiring lock "f6b868e7-336a-48de-9a80-01a2a92980e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b842351b-617c-4c7b-85e9-12777834da91 req-bd994659-bacc-4874-8fc4-8ca4203be2b6 service nova] Lock "f6b868e7-336a-48de-9a80-01a2a92980e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b842351b-617c-4c7b-85e9-12777834da91 req-bd994659-bacc-4874-8fc4-8ca4203be2b6 service nova] Lock "f6b868e7-336a-48de-9a80-01a2a92980e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-b842351b-617c-4c7b-85e9-12777834da91 req-bd994659-bacc-4874-8fc4-8ca4203be2b6 service nova] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] No waiting events found dispatching network-vif-plugged-0dacd2ba-c940-400f-9b4b-532eecf373b1 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:53:39 user nova-compute[72201]: WARNING nova.compute.manager [req-b842351b-617c-4c7b-85e9-12777834da91 req-bd994659-bacc-4874-8fc4-8ca4203be2b6 service nova] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Received unexpected event network-vif-plugged-0dacd2ba-c940-400f-9b4b-532eecf373b1 for instance with vm_state active and task_state None.
Aug 01 15:53:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Acquiring lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:53:39 user nova-compute[72201]: INFO nova.compute.claims [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Claim successful on node user
Aug 01 15:53:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:53:39 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:53:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG nova.policy [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e2aeb6d917c4f5d92155f66bc31c493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd696a8fae3e493098ace053951b81c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:53:39 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Creating image(s)
Aug 01 15:53:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "/opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "/opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:53:39 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.175s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.154s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:40 user nova-compute[72201]: INFO nova.compute.manager [None req-3e434c75-1cfb-48e1-8f29-0fa383bf2966 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Unrescuing
Aug 01 15:53:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3e434c75-1cfb-48e1-8f29-0fa383bf2966 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "refresh_cache-53b64583-bd6a-4829-9ecb-379c28c96246" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3e434c75-1cfb-48e1-8f29-0fa383bf2966 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquired lock "refresh_cache-53b64583-bd6a-4829-9ecb-379c28c96246" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG nova.network.neutron [None req-3e434c75-1cfb-48e1-8f29-0fa383bf2966 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk 1073741824" returned: 0 in 0.069s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.165s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Successfully created port: 71f6bc8a-3b92-44d0-9556-89649ac6cb95 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Cannot resize image /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG nova.objects.instance [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lazy-loading 'migration_context' on Instance uuid 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Ensure instance console log exists: /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:53:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.network.neutron [None req-3e434c75-1cfb-48e1-8f29-0fa383bf2966 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Updating instance_info_cache with network_info: [{"id": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "address": "fa:16:3e:0f:a9:68", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a4d61-52", "ovs_interfaceid": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-3e434c75-1cfb-48e1-8f29-0fa383bf2966 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Releasing lock "refresh_cache-53b64583-bd6a-4829-9ecb-379c28c96246" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.objects.instance [None req-3e434c75-1cfb-48e1-8f29-0fa383bf2966 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'flavor' on Instance uuid 53b64583-bd6a-4829-9ecb-379c28c96246 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-efa89206-3bf3-4392-a1f7-2fa0cec3842a req-d4470334-8d38-4d22-b3d3-80232c0fa1dc service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received event network-vif-unplugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-efa89206-3bf3-4392-a1f7-2fa0cec3842a req-d4470334-8d38-4d22-b3d3-80232c0fa1dc service nova] Acquiring lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-efa89206-3bf3-4392-a1f7-2fa0cec3842a req-d4470334-8d38-4d22-b3d3-80232c0fa1dc service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-efa89206-3bf3-4392-a1f7-2fa0cec3842a req-d4470334-8d38-4d22-b3d3-80232c0fa1dc service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-efa89206-3bf3-4392-a1f7-2fa0cec3842a req-d4470334-8d38-4d22-b3d3-80232c0fa1dc service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] No waiting events found dispatching network-vif-unplugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:53:41 user nova-compute[72201]: WARNING nova.compute.manager [req-efa89206-3bf3-4392-a1f7-2fa0cec3842a req-d4470334-8d38-4d22-b3d3-80232c0fa1dc service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received unexpected event network-vif-unplugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 15:53:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Successfully updated port: 71f6bc8a-3b92-44d0-9556-89649ac6cb95 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Acquiring lock "refresh_cache-8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Acquired lock "refresh_cache-8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-f6f12eba-a288-4a16-96ab-f7c8b19d954e req-36c82474-59fd-4475-b0e8-721cf8f43fbd service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Received event network-changed-71f6bc8a-3b92-44d0-9556-89649ac6cb95 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-f6f12eba-a288-4a16-96ab-f7c8b19d954e req-36c82474-59fd-4475-b0e8-721cf8f43fbd service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Refreshing instance network info cache due to event network-changed-71f6bc8a-3b92-44d0-9556-89649ac6cb95. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f6f12eba-a288-4a16-96ab-f7c8b19d954e req-36c82474-59fd-4475-b0e8-721cf8f43fbd service nova] Acquiring lock "refresh_cache-8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:41 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Instance destroyed successfully.
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.network.neutron [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Updating instance_info_cache with network_info: [{"id": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "address": "fa:16:3e:cc:e9:a4", "network": {"id": "cfe3e809-8e24-492c-b1dd-3c9575fe9614", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1264648726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd696a8fae3e493098ace053951b81c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f6bc8a-3b", "ovs_interfaceid": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Releasing lock "refresh_cache-8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Instance network_info: |[{"id": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "address": "fa:16:3e:cc:e9:a4", "network": {"id": "cfe3e809-8e24-492c-b1dd-3c9575fe9614", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1264648726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd696a8fae3e493098ace053951b81c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f6bc8a-3b", "ovs_interfaceid": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f6f12eba-a288-4a16-96ab-f7c8b19d954e req-36c82474-59fd-4475-b0e8-721cf8f43fbd service nova] Acquired lock "refresh_cache-8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.network.neutron [req-f6f12eba-a288-4a16-96ab-f7c8b19d954e req-36c82474-59fd-4475-b0e8-721cf8f43fbd service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Refreshing network info cache for port 71f6bc8a-3b92-44d0-9556-89649ac6cb95 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Start _get_guest_xml network_info=[{"id": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "address": "fa:16:3e:cc:e9:a4", "network": {"id": "cfe3e809-8e24-492c-b1dd-3c9575fe9614", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1264648726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd696a8fae3e493098ace053951b81c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f6bc8a-3b", "ovs_interfaceid": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:53:41 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:53:41 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:53:41 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-135068720',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-135068720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1350687',id=45,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPS7xAfpJyDLtrZQpduPaMOX7Xjv3nPMzBgLFs6wBqg8s6ELN/S0zmZD2gT9OCszxsRh3bc/tRdh7hlOn4/cYYJ8eO1HsXN7IVTZm8rssa32DLaluFkCZg9NBLoYvEEhOQ==',key_name='tempest-keypair-200123604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd696a8fae3e493098ace053951b81c3',ramdisk_id='',reservation_id='r-f0uqvuek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1843605665',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:53:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e2aeb6d917c4f5d92155f66bc31c493',uuid=8f1840c4-0c6f-4d84-913a-ebd3b5d2407b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "address": "fa:16:3e:cc:e9:a4", "network": {"id": "cfe3e809-8e24-492c-b1dd-3c9575fe9614", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1264648726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd696a8fae3e493098ace053951b81c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f6bc8a-3b", "ovs_interfaceid": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Converting VIF {"id": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "address": "fa:16:3e:cc:e9:a4", "network": {"id": "cfe3e809-8e24-492c-b1dd-3c9575fe9614", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1264648726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd696a8fae3e493098ace053951b81c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f6bc8a-3b", "ovs_interfaceid": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e9:a4,bridge_name='br-int',has_traffic_filtering=True,id=71f6bc8a-3b92-44d0-9556-89649ac6cb95,network=Network(cfe3e809-8e24-492c-b1dd-3c9575fe9614),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f6bc8a-3b') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG nova.objects.instance [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:53:42 user nova-compute[72201]:   <uuid>8f1840c4-0c6f-4d84-913a-ebd3b5d2407b</uuid>
Aug 01 15:53:42 user nova-compute[72201]:   <name>instance-0000002d</name>
Aug 01 15:53:42 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:53:42 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:53:42 user nova-compute[72201]:   <metadata>
Aug 01 15:53:42 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:53:42 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:53:42 user nova-compute[72201]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-135068720</nova:name>
Aug 01 15:53:42 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:53:41</nova:creationTime>
Aug 01 15:53:42 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:53:42 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:53:42 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:53:42 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:53:42 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:53:42 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:53:42 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:53:42 user nova-compute[72201]:       <nova:owner>
Aug 01 15:53:42 user nova-compute[72201]:         <nova:user uuid="5e2aeb6d917c4f5d92155f66bc31c493">tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member</nova:user>
Aug 01 15:53:42 user nova-compute[72201]:         <nova:project uuid="fd696a8fae3e493098ace053951b81c3">tempest-TestServerVolumeAttachScenarioOldVersion-1843605665</nova:project>
Aug 01 15:53:42 user nova-compute[72201]:       </nova:owner>
Aug 01 15:53:42 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:53:42 user nova-compute[72201]:       <nova:ports>
Aug 01 15:53:42 user nova-compute[72201]:         <nova:port uuid="71f6bc8a-3b92-44d0-9556-89649ac6cb95">
Aug 01 15:53:42 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 15:53:42 user nova-compute[72201]:         </nova:port>
Aug 01 15:53:42 user nova-compute[72201]:       </nova:ports>
Aug 01 15:53:42 user nova-compute[72201]:     </nova:instance>
Aug 01 15:53:42 user nova-compute[72201]:   </metadata>
Aug 01 15:53:42 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:53:42 user nova-compute[72201]:     <system>
Aug 01 15:53:42 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:53:42 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:53:42 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:53:42 user nova-compute[72201]:       <entry name="serial">8f1840c4-0c6f-4d84-913a-ebd3b5d2407b</entry>
Aug 01 15:53:42 user nova-compute[72201]:       <entry name="uuid">8f1840c4-0c6f-4d84-913a-ebd3b5d2407b</entry>
Aug 01 15:53:42 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:53:42 user nova-compute[72201]:     </system>
Aug 01 15:53:42 user nova-compute[72201]:   </sysinfo>
Aug 01 15:53:42 user nova-compute[72201]:   <os>
Aug 01 15:53:42 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:53:42 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:53:42 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:53:42 user nova-compute[72201]:   </os>
Aug 01 15:53:42 user nova-compute[72201]:   <features>
Aug 01 15:53:42 user nova-compute[72201]:     <acpi/>
Aug 01 15:53:42 user nova-compute[72201]:     <apic/>
Aug 01 15:53:42 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:53:42 user nova-compute[72201]:   </features>
Aug 01 15:53:42 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:53:42 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:53:42 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:53:42 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:53:42 user nova-compute[72201]:   </clock>
Aug 01 15:53:42 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:53:42 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:53:42 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:53:42 user nova-compute[72201]:   </cpu>
Aug 01 15:53:42 user nova-compute[72201]:   <devices>
Aug 01 15:53:42 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:53:42 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:53:42 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk"/>
Aug 01 15:53:42 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:53:42 user nova-compute[72201]:     </disk>
Aug 01 15:53:42 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:53:42 user nova-compute[72201]:       <mac address="fa:16:3e:cc:e9:a4"/>
Aug 01 15:53:42 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:53:42 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:53:42 user nova-compute[72201]:       <target dev="tap71f6bc8a-3b"/>
Aug 01 15:53:42 user nova-compute[72201]:     </interface>
Aug 01 15:53:42 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:53:42 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/console.log" append="off"/>
Aug 01 15:53:42 user nova-compute[72201]:     </serial>
Aug 01 15:53:42 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:53:42 user nova-compute[72201]:     <video>
Aug 01 15:53:42 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:53:42 user nova-compute[72201]:     </video>
Aug 01 15:53:42 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:53:42 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:53:42 user nova-compute[72201]:     </rng>
Aug 01 15:53:42 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:53:42 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:53:42 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:53:42 user nova-compute[72201]:     </memballoon>
Aug 01 15:53:42 user nova-compute[72201]:   </devices>
Aug 01 15:53:42 user nova-compute[72201]: </domain>
Aug 01 15:53:42 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-135068720',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-135068720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1350687',id=45,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPS7xAfpJyDLtrZQpduPaMOX7Xjv3nPMzBgLFs6wBqg8s6ELN/S0zmZD2gT9OCszxsRh3bc/tRdh7hlOn4/cYYJ8eO1HsXN7IVTZm8rssa32DLaluFkCZg9NBLoYvEEhOQ==',key_name='tempest-keypair-200123604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd696a8fae3e493098ace053951b81c3',ramdisk_id='',reservation_id='r-f0uqvuek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1843605665',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:53:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e2aeb6d917c4f5d92155f66bc31c493',uuid=8f1840c4-0c6f-4d84-913a-ebd3b5d2407b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "address": "fa:16:3e:cc:e9:a4", "network": {"id": "cfe3e809-8e24-492c-b1dd-3c9575fe9614", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1264648726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd696a8fae3e493098ace053951b81c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f6bc8a-3b", "ovs_interfaceid": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Converting VIF {"id": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "address": "fa:16:3e:cc:e9:a4", "network": {"id": "cfe3e809-8e24-492c-b1dd-3c9575fe9614", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1264648726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd696a8fae3e493098ace053951b81c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f6bc8a-3b", "ovs_interfaceid": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e9:a4,bridge_name='br-int',has_traffic_filtering=True,id=71f6bc8a-3b92-44d0-9556-89649ac6cb95,network=Network(cfe3e809-8e24-492c-b1dd-3c9575fe9614),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f6bc8a-3b') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG os_vif [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e9:a4,bridge_name='br-int',has_traffic_filtering=True,id=71f6bc8a-3b92-44d0-9556-89649ac6cb95,network=Network(cfe3e809-8e24-492c-b1dd-3c9575fe9614),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f6bc8a-3b') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71f6bc8a-3b, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap71f6bc8a-3b, col_values=(('external_ids', {'iface-id': '71f6bc8a-3b92-44d0-9556-89649ac6cb95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:e9:a4', 'vm-uuid': '8f1840c4-0c6f-4d84-913a-ebd3b5d2407b'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:42 user nova-compute[72201]: INFO os_vif [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e9:a4,bridge_name='br-int',has_traffic_filtering=True,id=71f6bc8a-3b92-44d0-9556-89649ac6cb95,network=Network(cfe3e809-8e24-492c-b1dd-3c9575fe9614),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f6bc8a-3b')
Aug 01 15:53:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] No VIF found with MAC fa:16:3e:cc:e9:a4, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG nova.network.neutron [req-f6f12eba-a288-4a16-96ab-f7c8b19d954e req-36c82474-59fd-4475-b0e8-721cf8f43fbd service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Updated VIF entry in instance network info cache for port 71f6bc8a-3b92-44d0-9556-89649ac6cb95. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG nova.network.neutron [req-f6f12eba-a288-4a16-96ab-f7c8b19d954e req-36c82474-59fd-4475-b0e8-721cf8f43fbd service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Updating instance_info_cache with network_info: [{"id": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "address": "fa:16:3e:cc:e9:a4", "network": {"id": "cfe3e809-8e24-492c-b1dd-3c9575fe9614", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1264648726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd696a8fae3e493098ace053951b81c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f6bc8a-3b", "ovs_interfaceid": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:53:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f6f12eba-a288-4a16-96ab-f7c8b19d954e req-36c82474-59fd-4475-b0e8-721cf8f43fbd service nova] Releasing lock "refresh_cache-8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:53:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-fc5a4749-e2b7-4a98-b344-9f1c909b371e req-52cfb363-24ed-4ef2-8976-177c800b53a1 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received event network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:53:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-fc5a4749-e2b7-4a98-b344-9f1c909b371e req-52cfb363-24ed-4ef2-8976-177c800b53a1 service nova] Acquiring lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:53:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-fc5a4749-e2b7-4a98-b344-9f1c909b371e req-52cfb363-24ed-4ef2-8976-177c800b53a1 service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:53:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-fc5a4749-e2b7-4a98-b344-9f1c909b371e req-52cfb363-24ed-4ef2-8976-177c800b53a1 service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:53:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-fc5a4749-e2b7-4a98-b344-9f1c909b371e req-52cfb363-24ed-4ef2-8976-177c800b53a1 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] No waiting events found dispatching network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:53:43 user nova-compute[72201]: WARNING nova.compute.manager [req-fc5a4749-e2b7-4a98-b344-9f1c909b371e req-52cfb363-24ed-4ef2-8976-177c800b53a1 service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received unexpected event network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 15:53:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-4c2bc1ba-2e82-4f7d-8eb1-8cc310aef849 req-8a9eb31b-db64-48d5-920d-e37db6c39c31 service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Received event network-vif-plugged-71f6bc8a-3b92-44d0-9556-89649ac6cb95 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:53:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4c2bc1ba-2e82-4f7d-8eb1-8cc310aef849 req-8a9eb31b-db64-48d5-920d-e37db6c39c31 service nova] Acquiring lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:53:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4c2bc1ba-2e82-4f7d-8eb1-8cc310aef849 req-8a9eb31b-db64-48d5-920d-e37db6c39c31 service nova] Lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:53:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-4c2bc1ba-2e82-4f7d-8eb1-8cc310aef849 req-8a9eb31b-db64-48d5-920d-e37db6c39c31 service nova] Lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:53:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-4c2bc1ba-2e82-4f7d-8eb1-8cc310aef849 req-8a9eb31b-db64-48d5-920d-e37db6c39c31 service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] No waiting events found dispatching network-vif-plugged-71f6bc8a-3b92-44d0-9556-89649ac6cb95 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:53:44 user nova-compute[72201]: WARNING nova.compute.manager [req-4c2bc1ba-2e82-4f7d-8eb1-8cc310aef849 req-8a9eb31b-db64-48d5-920d-e37db6c39c31 service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Received unexpected event network-vif-plugged-71f6bc8a-3b92-44d0-9556-89649ac6cb95 for instance with vm_state building and task_state spawning.
Aug 01 15:53:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-5b0652e5-798b-4189-854a-e50f799f7a3c req-161c7425-dca0-4755-aac1-1e495d713cfa service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received event network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:53:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5b0652e5-798b-4189-854a-e50f799f7a3c req-161c7425-dca0-4755-aac1-1e495d713cfa service nova] Acquiring lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:53:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5b0652e5-798b-4189-854a-e50f799f7a3c req-161c7425-dca0-4755-aac1-1e495d713cfa service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:53:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5b0652e5-798b-4189-854a-e50f799f7a3c req-161c7425-dca0-4755-aac1-1e495d713cfa service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:53:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-5b0652e5-798b-4189-854a-e50f799f7a3c req-161c7425-dca0-4755-aac1-1e495d713cfa service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] No waiting events found dispatching network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:53:45 user nova-compute[72201]: WARNING nova.compute.manager [req-5b0652e5-798b-4189-854a-e50f799f7a3c req-161c7425-dca0-4755-aac1-1e495d713cfa service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received unexpected event network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 15:53:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-5b0652e5-798b-4189-854a-e50f799f7a3c req-161c7425-dca0-4755-aac1-1e495d713cfa service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received event network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:53:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5b0652e5-798b-4189-854a-e50f799f7a3c req-161c7425-dca0-4755-aac1-1e495d713cfa service nova] Acquiring lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:53:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5b0652e5-798b-4189-854a-e50f799f7a3c req-161c7425-dca0-4755-aac1-1e495d713cfa service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:53:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5b0652e5-798b-4189-854a-e50f799f7a3c req-161c7425-dca0-4755-aac1-1e495d713cfa service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:53:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-5b0652e5-798b-4189-854a-e50f799f7a3c req-161c7425-dca0-4755-aac1-1e495d713cfa service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] No waiting events found dispatching network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:53:45 user nova-compute[72201]: WARNING nova.compute.manager [req-5b0652e5-798b-4189-854a-e50f799f7a3c req-161c7425-dca0-4755-aac1-1e495d713cfa service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received unexpected event network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.compute.manager [req-5134bde7-a95f-4115-b652-0cd3a5c519e0 req-84b717f7-5b28-4627-9adc-4a5426b660c9 service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Received event network-vif-plugged-71f6bc8a-3b92-44d0-9556-89649ac6cb95 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:53:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5134bde7-a95f-4115-b652-0cd3a5c519e0 req-84b717f7-5b28-4627-9adc-4a5426b660c9 service nova] Acquiring lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:53:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5134bde7-a95f-4115-b652-0cd3a5c519e0 req-84b717f7-5b28-4627-9adc-4a5426b660c9 service nova] Lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:53:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5134bde7-a95f-4115-b652-0cd3a5c519e0 req-84b717f7-5b28-4627-9adc-4a5426b660c9 service nova] Lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.compute.manager [req-5134bde7-a95f-4115-b652-0cd3a5c519e0 req-84b717f7-5b28-4627-9adc-4a5426b660c9 service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] No waiting events found dispatching network-vif-plugged-71f6bc8a-3b92-44d0-9556-89649ac6cb95 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:53:46 user nova-compute[72201]: WARNING nova.compute.manager [req-5134bde7-a95f-4115-b652-0cd3a5c519e0 req-84b717f7-5b28-4627-9adc-4a5426b660c9 service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Received unexpected event network-vif-plugged-71f6bc8a-3b92-44d0-9556-89649ac6cb95 for instance with vm_state building and task_state spawning.
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Removed pending event for 53b64583-bd6a-4829-9ecb-379c28c96246 due to event {{(pid=72201) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690905226.7273555, 53b64583-bd6a-4829-9ecb-379c28c96246 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:53:46 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] VM Resumed (Lifecycle Event)
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-3e434c75-1cfb-48e1-8f29-0fa383bf2966 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:53:46 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690905226.7303956, 53b64583-bd6a-4829-9ecb-379c28c96246 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:53:46 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] VM Started (Lifecycle Event)
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690905226.8389232, 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:53:46 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] VM Resumed (Lifecycle Event)
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:53:46 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Instance spawned successfully.
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:53:46 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690905226.8427799, 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:53:46 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] VM Started (Lifecycle Event)
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:53:46 user nova-compute[72201]: INFO nova.compute.manager [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Took 7.09 seconds to spawn the instance on the hypervisor.
Aug 01 15:53:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:53:47 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:53:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:47 user nova-compute[72201]: INFO nova.compute.manager [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Took 7.70 seconds to build instance.
Aug 01 15:53:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-6e4a7b50-7860-4aa7-89ec-45920e893025 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.796s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:53:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:53:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:54:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:54:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:54:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:54:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:54:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:54:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:54:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:54:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:54:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:54:24 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:54:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:54:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:54:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:54:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:54:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:54:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:54:28 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:54:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:54:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 15:54:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:54:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:54:28 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:54:28 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid f0743332-223f-4507-b8b1-40d63b7b5e80 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:54:28 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Updating instance_info_cache with network_info: [{"id": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "address": "fa:16:3e:6a:5e:e0", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6062f511-71", "ovs_interfaceid": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:54:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:54:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:54:28 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:54:29 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:54:30 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:54:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:54:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:54:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:54:30 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:54:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:54:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:54:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:54:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:54:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:54:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:54:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:54:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:54:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:54:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:54:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:54:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:54:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:54:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:54:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:54:31 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:54:31 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:54:31 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8128MB free_disk=24.968463897705078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:54:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:54:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:54:31 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f0743332-223f-4507-b8b1-40d63b7b5e80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:54:31 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:54:31 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e4f06d05-b05a-459c-9a44-0af858b2570d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:54:31 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 53b64583-bd6a-4829-9ecb-379c28c96246 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:54:31 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f6b868e7-336a-48de-9a80-01a2a92980e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:54:31 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:54:31 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:54:31 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:54:31 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:54:31 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:54:31 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:54:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.353s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:54:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:54:32 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:54:33 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:54:36 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:54:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:54:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:54:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:54:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:54:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:54:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:54:37 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:54:37 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:54:40 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:54:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:54:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:54:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:54:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:54:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:54:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:54:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:54:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:54:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:54:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:54:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:54:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:54:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:54:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:55:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:55:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:55:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:55:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:55:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:55:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:55:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:55:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:55:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:55:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:55:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:55:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "f6b868e7-336a-48de-9a80-01a2a92980e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "f6b868e7-336a-48de-9a80-01a2a92980e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "f6b868e7-336a-48de-9a80-01a2a92980e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "f6b868e7-336a-48de-9a80-01a2a92980e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "f6b868e7-336a-48de-9a80-01a2a92980e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:55:09 user nova-compute[72201]: INFO nova.compute.manager [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Terminating instance
Aug 01 15:55:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-efe09a95-f022-4164-9016-067317e774a3 req-943da092-1864-476b-bc2e-a5c881c7ae20 service nova] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Received event network-vif-unplugged-0dacd2ba-c940-400f-9b4b-532eecf373b1 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-efe09a95-f022-4164-9016-067317e774a3 req-943da092-1864-476b-bc2e-a5c881c7ae20 service nova] Acquiring lock "f6b868e7-336a-48de-9a80-01a2a92980e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-efe09a95-f022-4164-9016-067317e774a3 req-943da092-1864-476b-bc2e-a5c881c7ae20 service nova] Lock "f6b868e7-336a-48de-9a80-01a2a92980e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-efe09a95-f022-4164-9016-067317e774a3 req-943da092-1864-476b-bc2e-a5c881c7ae20 service nova] Lock "f6b868e7-336a-48de-9a80-01a2a92980e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-efe09a95-f022-4164-9016-067317e774a3 req-943da092-1864-476b-bc2e-a5c881c7ae20 service nova] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] No waiting events found dispatching network-vif-unplugged-0dacd2ba-c940-400f-9b4b-532eecf373b1 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-efe09a95-f022-4164-9016-067317e774a3 req-943da092-1864-476b-bc2e-a5c881c7ae20 service nova] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Received event network-vif-unplugged-0dacd2ba-c940-400f-9b4b-532eecf373b1 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:09 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Instance destroyed successfully.
Aug 01 15:55:09 user nova-compute[72201]: DEBUG nova.objects.instance [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lazy-loading 'resources' on Instance uuid f6b868e7-336a-48de-9a80-01a2a92980e5 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-304429462',display_name='tempest-TestVolumeBootPattern-server-304429462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-304429462',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:53:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a49e4769bf348be8fedc8b70f65cea2',ramdisk_id='',reservation_id='r-5jl0gk50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1110722165',owner_user_name='tempest-TestVolumeBootPattern-1110722165-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:53:38Z,user_data=None,user_id='222a94fd4bed425a8d80ba777c2361f0',uuid=f6b868e7-336a-48de-9a80-01a2a92980e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dacd2ba-c940-400f-9b4b-532eecf373b1", "address": "fa:16:3e:fd:d3:9d", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dacd2ba-c9", "ovs_interfaceid": "0dacd2ba-c940-400f-9b4b-532eecf373b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converting VIF {"id": "0dacd2ba-c940-400f-9b4b-532eecf373b1", "address": "fa:16:3e:fd:d3:9d", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dacd2ba-c9", "ovs_interfaceid": "0dacd2ba-c940-400f-9b4b-532eecf373b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:d3:9d,bridge_name='br-int',has_traffic_filtering=True,id=0dacd2ba-c940-400f-9b4b-532eecf373b1,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dacd2ba-c9') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG os_vif [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:d3:9d,bridge_name='br-int',has_traffic_filtering=True,id=0dacd2ba-c940-400f-9b4b-532eecf373b1,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dacd2ba-c9') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0dacd2ba-c9, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:55:09 user nova-compute[72201]: INFO os_vif [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:d3:9d,bridge_name='br-int',has_traffic_filtering=True,id=0dacd2ba-c940-400f-9b4b-532eecf373b1,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dacd2ba-c9')
Aug 01 15:55:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuDNWUht', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:55:09 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:55:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce3aed6-dd04-47d4-9ac7-0a6893a7ecb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[099f7a8d-2dbf-4976-bcc5-561def753a97]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:55:09 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:55:09 user nova-compute[72201]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d (non-flash)
Aug 01 15:55:09 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:55:09 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:55:09 user nova-compute[72201]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d (non-flash)
Aug 01 15:55:09 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5440b5b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d'): ({'sdd'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Removing single pathed devices sdd {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e2a8e5-469d-4d16-9d9d-50ca7fc332ec]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:09 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ff7ec6-96e3-4fca-96bb-cc68dbcaab8d]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Flushing IO for device /dev/sdd {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d289f422-9a41-4eb1-97a5-76a9a7cc0698]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c61547-a62a-4da7-a225-2c924328b060]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] SCSI volumes sdd have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOed7e118-6756c6c46232c557', '/dev/disk/by-id/scsi-23637353663366334', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ed7e118') {{(pid=83290) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 15:55:10 user nova-compute[72201]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOed7e118-6756c6c46232c557
Aug 01 15:55:10 user nova-compute[72201]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23637353663366334
Aug 01 15:55:10 user nova-compute[72201]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_ed7e118
Aug 01 15:55:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f7016d-b061-495f-9fa4-4c01cd17c6c2]: (4, None) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[292a6ec7-4c6c-43e8-a7f4-3e40fd949cdc]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec5dc5c-24ce-4aa7-bb4d-faa8a2c511bf]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d, portal: 172.16.0.220,3260]
Aug 01 15:55:10 user nova-compute[72201]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d, portal: 172.16.0.220,3260] successful.
Aug 01 15:55:10 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a827ff-3ad6-42c0-b92f-4e73814c897d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[055c2ba0-3629-4fa2-840d-cd4001ab96d5]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] <== disconnect_volume: return (320ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:55:10 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Deleting instance files /opt/stack/data/nova/instances/f6b868e7-336a-48de-9a80-01a2a92980e5_del
Aug 01 15:55:10 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Deletion of /opt/stack/data/nova/instances/f6b868e7-336a-48de-9a80-01a2a92980e5_del complete
Aug 01 15:55:10 user nova-compute[72201]: INFO nova.compute.manager [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 01 15:55:10 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:55:10 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:55:10 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Took 0.64 seconds to deallocate network for instance.
Aug 01 15:55:11 user nova-compute[72201]: DEBUG nova.compute.manager [req-088df30a-6997-45ee-9bf4-e29779431712 req-bffc0256-879d-4ba1-a6b4-4bcf9d03b00e service nova] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Received event network-vif-plugged-0dacd2ba-c940-400f-9b4b-532eecf373b1 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:55:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-088df30a-6997-45ee-9bf4-e29779431712 req-bffc0256-879d-4ba1-a6b4-4bcf9d03b00e service nova] Acquiring lock "f6b868e7-336a-48de-9a80-01a2a92980e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:55:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-088df30a-6997-45ee-9bf4-e29779431712 req-bffc0256-879d-4ba1-a6b4-4bcf9d03b00e service nova] Lock "f6b868e7-336a-48de-9a80-01a2a92980e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:55:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-088df30a-6997-45ee-9bf4-e29779431712 req-bffc0256-879d-4ba1-a6b4-4bcf9d03b00e service nova] Lock "f6b868e7-336a-48de-9a80-01a2a92980e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:55:11 user nova-compute[72201]: DEBUG nova.compute.manager [req-088df30a-6997-45ee-9bf4-e29779431712 req-bffc0256-879d-4ba1-a6b4-4bcf9d03b00e service nova] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] No waiting events found dispatching network-vif-plugged-0dacd2ba-c940-400f-9b4b-532eecf373b1 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:55:11 user nova-compute[72201]: WARNING nova.compute.manager [req-088df30a-6997-45ee-9bf4-e29779431712 req-bffc0256-879d-4ba1-a6b4-4bcf9d03b00e service nova] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Received unexpected event network-vif-plugged-0dacd2ba-c940-400f-9b4b-532eecf373b1 for instance with vm_state active and task_state deleting.
Aug 01 15:55:11 user nova-compute[72201]: DEBUG nova.compute.manager [req-088df30a-6997-45ee-9bf4-e29779431712 req-bffc0256-879d-4ba1-a6b4-4bcf9d03b00e service nova] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Received event network-vif-deleted-0dacd2ba-c940-400f-9b4b-532eecf373b1 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:55:11 user nova-compute[72201]: INFO nova.compute.manager [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Took 0.73 seconds to detach 1 volumes for instance.
Aug 01 15:55:11 user nova-compute[72201]: DEBUG nova.compute.manager [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Deleting volume: 85a827ff-3ad6-42c0-b92f-4e73814c897d {{(pid=72201) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 15:55:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:55:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:55:11 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:55:12 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:55:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:55:12 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Deleted allocations for instance f6b868e7-336a-48de-9a80-01a2a92980e5
Aug 01 15:55:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2c59c3cb-eb9a-44ed-b2c1-2baa39460002 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "f6b868e7-336a-48de-9a80-01a2a92980e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.032s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:55:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:55:24 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:55:24 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690905309.8533325, f6b868e7-336a-48de-9a80-01a2a92980e5 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:55:24 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] VM Stopped (Lifecycle Event)
Aug 01 15:55:24 user nova-compute[72201]: DEBUG nova.compute.manager [None req-16afa9e1-fa24-435a-86b6-34883fd9da7f None None] [instance: f6b868e7-336a-48de-9a80-01a2a92980e5] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:55:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:28 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:55:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:55:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:55:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:55:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:55:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:30 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:55:30 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:55:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:55:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:55:30 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:55:30 user nova-compute[72201]: DEBUG nova.compute.manager [req-72beda6c-fa39-465f-a400-3f52ef0d96c6 req-5174dbe7-a79c-49d5-bc0a-301cddd04234 service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Received event network-changed-71f6bc8a-3b92-44d0-9556-89649ac6cb95 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:55:30 user nova-compute[72201]: DEBUG nova.compute.manager [req-72beda6c-fa39-465f-a400-3f52ef0d96c6 req-5174dbe7-a79c-49d5-bc0a-301cddd04234 service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Refreshing instance network info cache due to event network-changed-71f6bc8a-3b92-44d0-9556-89649ac6cb95. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:55:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-72beda6c-fa39-465f-a400-3f52ef0d96c6 req-5174dbe7-a79c-49d5-bc0a-301cddd04234 service nova] Acquiring lock "refresh_cache-8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:55:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-72beda6c-fa39-465f-a400-3f52ef0d96c6 req-5174dbe7-a79c-49d5-bc0a-301cddd04234 service nova] Acquired lock "refresh_cache-8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:55:30 user nova-compute[72201]: DEBUG nova.network.neutron [req-72beda6c-fa39-465f-a400-3f52ef0d96c6 req-5174dbe7-a79c-49d5-bc0a-301cddd04234 service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Refreshing network info cache for port 71f6bc8a-3b92-44d0-9556-89649ac6cb95 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:55:30 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Updating instance_info_cache with network_info: [{"id": "fa130bf4-53dc-43f7-8932-0aec318054d9", "address": "fa:16:3e:92:e7:b2", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa130bf4-53", "ovs_interfaceid": "fa130bf4-53dc-43f7-8932-0aec318054d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:55:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:55:30 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:55:30 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:55:30 user nova-compute[72201]: DEBUG nova.network.neutron [req-72beda6c-fa39-465f-a400-3f52ef0d96c6 req-5174dbe7-a79c-49d5-bc0a-301cddd04234 service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Updated VIF entry in instance network info cache for port 71f6bc8a-3b92-44d0-9556-89649ac6cb95. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:55:30 user nova-compute[72201]: DEBUG nova.network.neutron [req-72beda6c-fa39-465f-a400-3f52ef0d96c6 req-5174dbe7-a79c-49d5-bc0a-301cddd04234 service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Updating instance_info_cache with network_info: [{"id": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "address": "fa:16:3e:cc:e9:a4", "network": {"id": "cfe3e809-8e24-492c-b1dd-3c9575fe9614", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1264648726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd696a8fae3e493098ace053951b81c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f6bc8a-3b", "ovs_interfaceid": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:55:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-72beda6c-fa39-465f-a400-3f52ef0d96c6 req-5174dbe7-a79c-49d5-bc0a-301cddd04234 service nova] Releasing lock "refresh_cache-8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "53b64583-bd6a-4829-9ecb-379c28c96246" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "53b64583-bd6a-4829-9ecb-379c28c96246" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:55:31 user nova-compute[72201]: INFO nova.compute.manager [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Terminating instance
Aug 01 15:55:31 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-069b6d0f-4ef1-4d00-842e-0d714ddacae0 req-3e6d915d-792a-42a2-ad45-9a69a6e688ee service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received event network-vif-unplugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-069b6d0f-4ef1-4d00-842e-0d714ddacae0 req-3e6d915d-792a-42a2-ad45-9a69a6e688ee service nova] Acquiring lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-069b6d0f-4ef1-4d00-842e-0d714ddacae0 req-3e6d915d-792a-42a2-ad45-9a69a6e688ee service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-069b6d0f-4ef1-4d00-842e-0d714ddacae0 req-3e6d915d-792a-42a2-ad45-9a69a6e688ee service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-069b6d0f-4ef1-4d00-842e-0d714ddacae0 req-3e6d915d-792a-42a2-ad45-9a69a6e688ee service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] No waiting events found dispatching network-vif-unplugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-069b6d0f-4ef1-4d00-842e-0d714ddacae0 req-3e6d915d-792a-42a2-ad45-9a69a6e688ee service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received event network-vif-unplugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:31 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Instance destroyed successfully.
Aug 01 15:55:31 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'resources' on Instance uuid 53b64583-bd6a-4829-9ecb-379c28c96246 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:49:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-756195912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-756195912',id=43,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:51:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ed7463cb6f84c4a8cf1ef0437eca988',ramdisk_id='',reservation_id='r-oon0yq4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:53:47Z,user_data=None,user_id='75b0cb34dac64c61a235470454e0c6bf',uuid=53b64583-bd6a-4829-9ecb-379c28c96246,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "address": "fa:16:3e:0f:a9:68", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a4d61-52", "ovs_interfaceid": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converting VIF {"id": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "address": "fa:16:3e:0f:a9:68", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap499a4d61-52", "ovs_interfaceid": "499a4d61-525d-46d6-9232-4a1b945cd6b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:a9:68,bridge_name='br-int',has_traffic_filtering=True,id=499a4d61-525d-46d6-9232-4a1b945cd6b2,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499a4d61-52') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG os_vif [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:a9:68,bridge_name='br-int',has_traffic_filtering=True,id=499a4d61-525d-46d6-9232-4a1b945cd6b2,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499a4d61-52') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap499a4d61-52, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:55:31 user nova-compute[72201]: INFO os_vif [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:a9:68,bridge_name='br-int',has_traffic_filtering=True,id=499a4d61-525d-46d6-9232-4a1b945cd6b2,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap499a4d61-52')
Aug 01 15:55:31 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmNvetFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:55:31 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:55:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca071c40-fb85-4166-bc97-0ab988a3e531]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca29fde-02e6-4116-91e0-ab1416f475cf]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:55:31 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:55:31 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:55:31 user nova-compute[72201]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 (non-flash)
Aug 01 15:55:31 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5441bf5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059'): ({'sdb'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Removing single pathed devices sdb {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e954c1b-ada7-4d9d-a49b-3c5ba05d12b6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: True\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfc5ee2-d765-4928-be62-68ca0663f873]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Flushing IO for device /dev/sdb {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1a7700-9104-4289-95f6-b468f3d76edc]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a796abe2-ca33-482f-a843-937d6f5fa348]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_7d1554c2', '/dev/disk/by-id/scsi-1SCST_BIO7d1554c2-bc72fcea9e5bd031', '/dev/disk/by-id/scsi-26263373266636561') {{(pid=83290) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[37735962-83e5-4307-9b17-1d3137b08d9b]: (4, None) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[af27aa5f-5508-4521-a04c-37f5e171ed61]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c532fbec-736f-4c49-990c-082bdaeffe86]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059, portal: 172.16.0.220,3260]
Aug 01 15:55:32 user nova-compute[72201]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059, portal: 172.16.0.220,3260] successful.
Aug 01 15:55:32 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e9b879-945d-47c3-a7a7-a18b08ada059 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e9b92a-f866-4cfc-b07c-d312aea76f4c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] <== disconnect_volume: return (333ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:55:32 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Deleting instance files /opt/stack/data/nova/instances/53b64583-bd6a-4829-9ecb-379c28c96246_del
Aug 01 15:55:32 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Deletion of /opt/stack/data/nova/instances/53b64583-bd6a-4829-9ecb-379c28c96246_del complete
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:55:32 user nova-compute[72201]: INFO nova.compute.manager [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:32 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:55:32 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Took 0.57 seconds to deallocate network for instance.
Aug 01 15:55:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:33 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:55:33 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:55:33 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8422MB free_disk=24.96734619140625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG nova.compute.manager [req-d5ffc23d-4d4a-437a-a948-e563f6ff9437 req-9bb813ce-1260-4788-bbbb-46307434b4ae service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received event network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d5ffc23d-4d4a-437a-a948-e563f6ff9437 req-9bb813ce-1260-4788-bbbb-46307434b4ae service nova] Acquiring lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d5ffc23d-4d4a-437a-a948-e563f6ff9437 req-9bb813ce-1260-4788-bbbb-46307434b4ae service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d5ffc23d-4d4a-437a-a948-e563f6ff9437 req-9bb813ce-1260-4788-bbbb-46307434b4ae service nova] Lock "53b64583-bd6a-4829-9ecb-379c28c96246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG nova.compute.manager [req-d5ffc23d-4d4a-437a-a948-e563f6ff9437 req-9bb813ce-1260-4788-bbbb-46307434b4ae service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] No waiting events found dispatching network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:55:33 user nova-compute[72201]: WARNING nova.compute.manager [req-d5ffc23d-4d4a-437a-a948-e563f6ff9437 req-9bb813ce-1260-4788-bbbb-46307434b4ae service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received unexpected event network-vif-plugged-499a4d61-525d-46d6-9232-4a1b945cd6b2 for instance with vm_state active and task_state deleting.
Aug 01 15:55:33 user nova-compute[72201]: DEBUG nova.compute.manager [req-d5ffc23d-4d4a-437a-a948-e563f6ff9437 req-9bb813ce-1260-4788-bbbb-46307434b4ae service nova] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Received event network-vif-deleted-499a4d61-525d-46d6-9232-4a1b945cd6b2 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f0743332-223f-4507-b8b1-40d63b7b5e80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e4f06d05-b05a-459c-9a44-0af858b2570d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 53b64583-bd6a-4829-9ecb-379c28c96246 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:55:33 user nova-compute[72201]: INFO nova.compute.manager [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Took 0.73 seconds to detach 1 volumes for instance.
Aug 01 15:55:33 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:55:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:55:33 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Deleted allocations for instance 53b64583-bd6a-4829-9ecb-379c28c96246
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f8aa868c-da9c-4c78-958a-8dfde6ee6d19 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "53b64583-bd6a-4829-9ecb-379c28c96246" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.954s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Acquiring lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG nova.objects.instance [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lazy-loading 'flavor' on Instance uuid 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Acquiring lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:55:34 user nova-compute[72201]: INFO nova.compute.manager [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Attaching volume 0a2d8fe0-ebf9-4467-9658-9df7a3349b9c to /dev/vdb
Aug 01 15:55:34 user nova-compute[72201]: DEBUG os_brick.utils [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[97867894-0c63-4339-8788-a2ee9d840061]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[924693a5-3840-44ea-a5fe-31a1ccd91394]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b75578-a8ea-4590-bd34-4e229f545a1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fbdbe3-2f58-4226-93a0-6c1951bb0ac7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:55:34 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:55:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5563c61-7fe2-4696-b8d6-45d23b2ccdda]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG os_brick.utils [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:55:34 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Updating existing volume attachment record: 4c556522-6d53-455f-bb34-06793aa51d22 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:55:35 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:55:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:37 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:55:39 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:55:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:55:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:55:41 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgyazWJR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:55:41 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:55:41 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:55:41 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:55:41 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:55:41 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:55:41 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:55:41 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:55:41 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:41 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:41 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5639aa8b-72c8-4c2f-b929-dba5cb22abaa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:41 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:55:41 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:55:41 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fb9181-8935-4376-94b1-f19cb999ba23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c] added
Aug 01 15:55:42 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7a7c7b-04e9-4758-9f66-110234c50db3]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbb2367-85d3-468c-8f48-9651cb24430c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgyazWJR {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgyazWJR" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a212c7-b1eb-4d98-be82-50cbc902a0d2]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VgyazWJR'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bd979f-bd43-4a67-81d4-b765f6ba6d98]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb5b72b-d9ef-4d47-9ad2-7ea7f74a0a95]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:55:42 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:55:42 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[368d6737-1b2b-49f8-8165-67904c677d8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c, portal: 172.16.0.220,3260]
Aug 01 15:55:42 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c, portal: 172.16.0.220,3260] successful.
Aug 01 15:55:42 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb12b3d-3fa6-4420-909b-252481cf915f]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3c3106-ce2d-4d3f-8780-240403893694]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:55:42 user nova-compute[72201]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c (non-flash)
Aug 01 15:55:42 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:55:42 user nova-compute[72201]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c (non-flash)
Aug 01 15:55:42 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c51906-7bcc-4a34-804c-d24c4b219d37]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:42 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:55:43 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:55:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgyazWJR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:55:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:55:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26264373734393338', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:55:43 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264373734393338', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:55:43 user nova-compute[72201]: DEBUG nova.objects.instance [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lazy-loading 'flavor' on Instance uuid 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:55:43 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 15:55:43 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:55:43 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 15:55:43 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:55:43 user nova-compute[72201]:   <serial>0a2d8fe0-ebf9-4467-9658-9df7a3349b9c</serial>
Aug 01 15:55:43 user nova-compute[72201]: </disk>
Aug 01 15:55:43 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 15:55:43 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:55:43 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:55:43 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] No VIF found with MAC fa:16:3e:cc:e9:a4, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:55:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-788075cd-2347-4616-b392-80213c43757a tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.143s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:55:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Acquiring lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:55:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:55:45 user nova-compute[72201]: INFO nova.compute.manager [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Detaching volume 0a2d8fe0-ebf9-4467-9658-9df7a3349b9c
Aug 01 15:55:45 user nova-compute[72201]: INFO nova.virt.block_device [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Attempting to driver detach volume 0a2d8fe0-ebf9-4467-9658-9df7a3349b9c from mountpoint /dev/vdb
Aug 01 15:55:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Attempting to detach device vdb from instance 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 15:55:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:55:45 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:55:45 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 15:55:45 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:55:45 user nova-compute[72201]:   <serial>0a2d8fe0-ebf9-4467-9658-9df7a3349b9c</serial>
Aug 01 15:55:45 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:55:45 user nova-compute[72201]: </disk>
Aug 01 15:55:45 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:55:45 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Successfully detached device vdb from instance 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b from the persistent domain config.
Aug 01 15:55:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 15:55:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 15:55:45 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:55:45 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 15:55:45 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 15:55:45 user nova-compute[72201]:   <serial>0a2d8fe0-ebf9-4467-9658-9df7a3349b9c</serial>
Aug 01 15:55:45 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 15:55:45 user nova-compute[72201]: </disk>
Aug 01 15:55:45 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690905346.050342, 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 15:55:46 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Successfully detached device vdb from instance 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b from the live domain config.
Aug 01 15:55:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgyazWJR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:55:46 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:55:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db01e3c-281d-4de1-8bff-f53e94ba6bf5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7822b572-2bf6-4733-a462-1512796b6b8e]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:55:46 user nova-compute[72201]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c (non-flash)
Aug 01 15:55:46 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:55:46 user nova-compute[72201]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c (non-flash)
Aug 01 15:55:46 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c5157e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c'): ({'sdb'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Removing single pathed devices sdb {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7418f505-0411-4d21-9f24-94fcda6eddf9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f724e47-ab95-457b-bba1-ded296dd5546]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Flushing IO for device /dev/sdb {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[002f470a-0191-4e9c-8f3d-89a63f53ffb7]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e9158b-3584-4aa6-b7f4-9837c5060ae7]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d213e77-13b5-43ed-9fba-831cb52a6ef3]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d466482-3eca-442d-9819-06ca75fcb0fb]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c, portal: 172.16.0.220,3260]
Aug 01 15:55:46 user nova-compute[72201]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c, portal: 172.16.0.220,3260] successful.
Aug 01 15:55:46 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d8fe0-ebf9-4467-9658-9df7a3349b9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7234f722-f205-49ab-805d-998ecdc68f39]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] <== disconnect_volume: return (286ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690905331.8674753, 53b64583-bd6a-4829-9ecb-379c28c96246 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:55:46 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] VM Stopped (Lifecycle Event)
Aug 01 15:55:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-7f5ea1d0-be85-42b2-b5b7-1e1cb327d75e None None] [instance: 53b64583-bd6a-4829-9ecb-379c28c96246] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:55:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:47 user nova-compute[72201]: DEBUG nova.objects.instance [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lazy-loading 'flavor' on Instance uuid 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:55:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-baf621f8-8a31-4eaa-bb8a-d458b7cece8d tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.594s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:55:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Verify base images {{(pid=72201) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Image id 73af296a-4f5f-49df-a90d-46b9fdcd9a3f yields fingerprint 0322c9d1b247c65744d49c1e219f99c4dc8898ba {{(pid=72201) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 01 15:55:53 user nova-compute[72201]: INFO nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] image 73af296a-4f5f-49df-a90d-46b9fdcd9a3f at (/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba): checking
Aug 01 15:55:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] image 73af296a-4f5f-49df-a90d-46b9fdcd9a3f at (/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba): image is in use {{(pid=72201) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72201) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b is a valid instance name {{(pid=72201) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b has a disk file {{(pid=72201) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b is backed by 0322c9d1b247c65744d49c1e219f99c4dc8898ba {{(pid=72201) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 is a valid instance name {{(pid=72201) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] e4f06d05-b05a-459c-9a44-0af858b2570d is a valid instance name {{(pid=72201) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] e4f06d05-b05a-459c-9a44-0af858b2570d has a disk file {{(pid=72201) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance e4f06d05-b05a-459c-9a44-0af858b2570d is backed by 0322c9d1b247c65744d49c1e219f99c4dc8898ba {{(pid=72201) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] f0743332-223f-4507-b8b1-40d63b7b5e80 is a valid instance name {{(pid=72201) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] f0743332-223f-4507-b8b1-40d63b7b5e80 has a disk file {{(pid=72201) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f0743332-223f-4507-b8b1-40d63b7b5e80 is backed by 0322c9d1b247c65744d49c1e219f99c4dc8898ba {{(pid=72201) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 01 15:55:53 user nova-compute[72201]: WARNING nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Unknown base file: /opt/stack/data/nova/instances/_base/80b319fc241ed8d08e142859a7cbfc917c661fb5
Aug 01 15:55:53 user nova-compute[72201]: WARNING nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5dabb16936b5dfc445343a8222c2af7825a58f3b
Aug 01 15:55:53 user nova-compute[72201]: WARNING nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7055a2c58ffadeca14624ba5cf3b89224d970429
Aug 01 15:55:53 user nova-compute[72201]: WARNING nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5845f6b547611e04b5d798cf471ef36cdf7baa42
Aug 01 15:55:53 user nova-compute[72201]: WARNING nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Unknown base file: /opt/stack/data/nova/instances/_base/49942ec1b8d36fcab05004dc20bcf09b01255950
Aug 01 15:55:53 user nova-compute[72201]: WARNING nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Unknown base file: /opt/stack/data/nova/instances/_base/aa6a60952c87d66d65c04d5719003b06ac2d2cf8
Aug 01 15:55:53 user nova-compute[72201]: WARNING nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b594736f5326cc44b2c21b0265dc7a86f25b8fc2
Aug 01 15:55:53 user nova-compute[72201]: WARNING nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d06d5a0f7806ee60e9cc869b5b8df6ebb242164f
Aug 01 15:55:53 user nova-compute[72201]: WARNING nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87
Aug 01 15:55:53 user nova-compute[72201]: INFO nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Active base files: /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba
Aug 01 15:55:53 user nova-compute[72201]: INFO nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Removable base files: /opt/stack/data/nova/instances/_base/80b319fc241ed8d08e142859a7cbfc917c661fb5 /opt/stack/data/nova/instances/_base/5dabb16936b5dfc445343a8222c2af7825a58f3b /opt/stack/data/nova/instances/_base/7055a2c58ffadeca14624ba5cf3b89224d970429 /opt/stack/data/nova/instances/_base/5845f6b547611e04b5d798cf471ef36cdf7baa42 /opt/stack/data/nova/instances/_base/49942ec1b8d36fcab05004dc20bcf09b01255950 /opt/stack/data/nova/instances/_base/aa6a60952c87d66d65c04d5719003b06ac2d2cf8 /opt/stack/data/nova/instances/_base/b594736f5326cc44b2c21b0265dc7a86f25b8fc2 /opt/stack/data/nova/instances/_base/d06d5a0f7806ee60e9cc869b5b8df6ebb242164f /opt/stack/data/nova/instances/_base/e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87
Aug 01 15:55:53 user nova-compute[72201]: INFO nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/80b319fc241ed8d08e142859a7cbfc917c661fb5
Aug 01 15:55:53 user nova-compute[72201]: INFO nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5dabb16936b5dfc445343a8222c2af7825a58f3b
Aug 01 15:55:53 user nova-compute[72201]: INFO nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7055a2c58ffadeca14624ba5cf3b89224d970429
Aug 01 15:55:53 user nova-compute[72201]: INFO nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5845f6b547611e04b5d798cf471ef36cdf7baa42
Aug 01 15:55:53 user nova-compute[72201]: INFO nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/49942ec1b8d36fcab05004dc20bcf09b01255950
Aug 01 15:55:53 user nova-compute[72201]: INFO nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/aa6a60952c87d66d65c04d5719003b06ac2d2cf8
Aug 01 15:55:53 user nova-compute[72201]: INFO nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b594736f5326cc44b2c21b0265dc7a86f25b8fc2
Aug 01 15:55:53 user nova-compute[72201]: INFO nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d06d5a0f7806ee60e9cc869b5b8df6ebb242164f
Aug 01 15:55:53 user nova-compute[72201]: INFO nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e598bd3e63dee021c8f3a7fdf715c9fd7c6a8f87
Aug 01 15:55:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Verification complete {{(pid=72201) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Verify swap images {{(pid=72201) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 01 15:55:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.imagecache [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Verify ephemeral images {{(pid=72201) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 01 15:55:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:56:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "26f5b55c-8ade-4f95-8756-7ab7319b1556" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:56:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "26f5b55c-8ade-4f95-8756-7ab7319b1556" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:56:15 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:56:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:56:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:56:15 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:56:15 user nova-compute[72201]: INFO nova.compute.claims [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Claim successful on node user
Aug 01 15:56:15 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:56:16 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:56:16 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:56:16 user nova-compute[72201]: INFO nova.virt.block_device [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Booting with volume 2572a4c8-01fa-4997-88f8-91d90f79843f at /dev/vda
Aug 01 15:56:16 user nova-compute[72201]: DEBUG nova.policy [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '222a94fd4bed425a8d80ba777c2361f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a49e4769bf348be8fedc8b70f65cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG os_brick.utils [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1ec4e8-1c3f-4a17-bbc2-e66ae878fd8b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f53435-93e0-4e30-b4a6-2d086cb3e88d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8462d4-786c-4f7a-afdd-57caef8746f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd8be99-d9a3-4354-afe0-1175ce9947b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:56:16 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:56:16 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4f2a8f-e75d-4533-9c51-f692ad49e3e6]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG os_brick.utils [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Updating existing volume attachment record: 1e9ec90e-9edf-4c17-a4e4-5ec163ceddf7 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Successfully created port: 30c6582f-7060-4694-99a3-1eff3a514631 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:56:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:56:17 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:56:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72201) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 15:56:17 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Successfully updated port: 30c6582f-7060-4694-99a3-1eff3a514631 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:56:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "refresh_cache-26f5b55c-8ade-4f95-8756-7ab7319b1556" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:56:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquired lock "refresh_cache-26f5b55c-8ade-4f95-8756-7ab7319b1556" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:56:17 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:56:17 user nova-compute[72201]: DEBUG nova.compute.manager [req-bcf7a478-32ee-47d0-9705-f0f0170f8953 req-6d782da0-4ada-46e8-8e5b-86c38b901827 service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Received event network-changed-30c6582f-7060-4694-99a3-1eff3a514631 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:56:17 user nova-compute[72201]: DEBUG nova.compute.manager [req-bcf7a478-32ee-47d0-9705-f0f0170f8953 req-6d782da0-4ada-46e8-8e5b-86c38b901827 service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Refreshing instance network info cache due to event network-changed-30c6582f-7060-4694-99a3-1eff3a514631. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:56:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bcf7a478-32ee-47d0-9705-f0f0170f8953 req-6d782da0-4ada-46e8-8e5b-86c38b901827 service nova] Acquiring lock "refresh_cache-26f5b55c-8ade-4f95-8756-7ab7319b1556" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:56:17 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:56:17 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Updating instance_info_cache with network_info: [{"id": "30c6582f-7060-4694-99a3-1eff3a514631", "address": "fa:16:3e:0c:e3:80", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30c6582f-70", "ovs_interfaceid": "30c6582f-7060-4694-99a3-1eff3a514631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:56:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Releasing lock "refresh_cache-26f5b55c-8ade-4f95-8756-7ab7319b1556" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:56:18 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Instance network_info: |[{"id": "30c6582f-7060-4694-99a3-1eff3a514631", "address": "fa:16:3e:0c:e3:80", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30c6582f-70", "ovs_interfaceid": "30c6582f-7060-4694-99a3-1eff3a514631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:56:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bcf7a478-32ee-47d0-9705-f0f0170f8953 req-6d782da0-4ada-46e8-8e5b-86c38b901827 service nova] Acquired lock "refresh_cache-26f5b55c-8ade-4f95-8756-7ab7319b1556" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:56:18 user nova-compute[72201]: DEBUG nova.network.neutron [req-bcf7a478-32ee-47d0-9705-f0f0170f8953 req-6d782da0-4ada-46e8-8e5b-86c38b901827 service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Refreshing network info cache for port 30c6582f-7060-4694-99a3-1eff3a514631 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:56:18 user nova-compute[72201]: DEBUG nova.network.neutron [req-bcf7a478-32ee-47d0-9705-f0f0170f8953 req-6d782da0-4ada-46e8-8e5b-86c38b901827 service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Updated VIF entry in instance network info cache for port 30c6582f-7060-4694-99a3-1eff3a514631. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:56:18 user nova-compute[72201]: DEBUG nova.network.neutron [req-bcf7a478-32ee-47d0-9705-f0f0170f8953 req-6d782da0-4ada-46e8-8e5b-86c38b901827 service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Updating instance_info_cache with network_info: [{"id": "30c6582f-7060-4694-99a3-1eff3a514631", "address": "fa:16:3e:0c:e3:80", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30c6582f-70", "ovs_interfaceid": "30c6582f-7060-4694-99a3-1eff3a514631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:56:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bcf7a478-32ee-47d0-9705-f0f0170f8953 req-6d782da0-4ada-46e8-8e5b-86c38b901827 service nova] Releasing lock "refresh_cache-26f5b55c-8ade-4f95-8756-7ab7319b1556" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:56:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "e4f06d05-b05a-459c-9a44-0af858b2570d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:56:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "e4f06d05-b05a-459c-9a44-0af858b2570d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:56:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "e4f06d05-b05a-459c-9a44-0af858b2570d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:56:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "e4f06d05-b05a-459c-9a44-0af858b2570d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:56:21 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "e4f06d05-b05a-459c-9a44-0af858b2570d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:56:21 user nova-compute[72201]: INFO nova.compute.manager [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Terminating instance
Aug 01 15:56:21 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:56:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:22 user nova-compute[72201]: DEBUG nova.compute.manager [req-2aae7eb8-546e-4951-957c-b1fa75caf343 req-0ac70669-7661-434e-8c8f-1fb55ed21dfe service nova] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Received event network-vif-unplugged-cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:56:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2aae7eb8-546e-4951-957c-b1fa75caf343 req-0ac70669-7661-434e-8c8f-1fb55ed21dfe service nova] Acquiring lock "e4f06d05-b05a-459c-9a44-0af858b2570d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:56:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2aae7eb8-546e-4951-957c-b1fa75caf343 req-0ac70669-7661-434e-8c8f-1fb55ed21dfe service nova] Lock "e4f06d05-b05a-459c-9a44-0af858b2570d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:56:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2aae7eb8-546e-4951-957c-b1fa75caf343 req-0ac70669-7661-434e-8c8f-1fb55ed21dfe service nova] Lock "e4f06d05-b05a-459c-9a44-0af858b2570d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:56:22 user nova-compute[72201]: DEBUG nova.compute.manager [req-2aae7eb8-546e-4951-957c-b1fa75caf343 req-0ac70669-7661-434e-8c8f-1fb55ed21dfe service nova] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] No waiting events found dispatching network-vif-unplugged-cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:56:22 user nova-compute[72201]: DEBUG nova.compute.manager [req-2aae7eb8-546e-4951-957c-b1fa75caf343 req-0ac70669-7661-434e-8c8f-1fb55ed21dfe service nova] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Received event network-vif-unplugged-cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:56:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:22 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Instance destroyed successfully.
Aug 01 15:56:22 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'resources' on Instance uuid e4f06d05-b05a-459c-9a44-0af858b2570d {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:56:22 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1191757417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1191757417',id=41,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:47:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ed7463cb6f84c4a8cf1ef0437eca988',ramdisk_id='',reservation_id='r-v478oqcb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:48:57Z,user_data=None,user_id='75b0cb34dac64c61a235470454e0c6bf',uuid=e4f06d05-b05a-459c-9a44-0af858b2570d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "address": "fa:16:3e:77:73:42", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd914fa0-b0", "ovs_interfaceid": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:56:22 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converting VIF {"id": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "address": "fa:16:3e:77:73:42", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd914fa0-b0", "ovs_interfaceid": "cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:56:22 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:73:42,bridge_name='br-int',has_traffic_filtering=True,id=cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd914fa0-b0') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:56:22 user nova-compute[72201]: DEBUG os_vif [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:73:42,bridge_name='br-int',has_traffic_filtering=True,id=cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd914fa0-b0') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:56:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd914fa0-b0, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:56:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:56:22 user nova-compute[72201]: INFO os_vif [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:73:42,bridge_name='br-int',has_traffic_filtering=True,id=cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd914fa0-b0')
Aug 01 15:56:22 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Deleting instance files /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d_del
Aug 01 15:56:22 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Deletion of /opt/stack/data/nova/instances/e4f06d05-b05a-459c-9a44-0af858b2570d_del complete
Aug 01 15:56:22 user nova-compute[72201]: INFO nova.compute.manager [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 01 15:56:22 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:56:22 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:56:22 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:56:23 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Took 0.69 seconds to deallocate network for instance.
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.compute.manager [req-d4183ce4-a93d-4e38-8e8a-08f1418cc8c3 req-48789eba-f225-45de-894f-5e7df0ed9915 service nova] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Received event network-vif-deleted-cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:56:23 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Deleted allocations for instance e4f06d05-b05a-459c-9a44-0af858b2570d
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:56:23 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Creating image(s)
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Did not create local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Ensure instance console log exists: /opt/stack/data/nova/instances/26f5b55c-8ade-4f95-8756-7ab7319b1556/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Start _get_guest_xml network_info=[{"id": "30c6582f-7060-4694-99a3-1eff3a514631", "address": "fa:16:3e:0c:e3:80", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30c6582f-70", "ovs_interfaceid": "30c6582f-7060-4694-99a3-1eff3a514631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrwkQsuT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '26f5b55c-8ade-4f95-8756-7ab7319b1556', 'attached_at': '', 'detached_at': '', 'volume_id': '2572a4c8-01fa-4997-88f8-91d90f79843f', 'serial': '2572a4c8-01fa-4997-88f8-91d90f79843f'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '1e9ec90e-9edf-4c17-a4e4-5ec163ceddf7', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:56:23 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:56:23 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrwkQsuT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:56:23 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:56:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:56:23 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:56:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:56:23 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f729182e-8645-4098-9172-059c2fc19a68 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "e4f06d05-b05a-459c-9a44-0af858b2570d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.939s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d569c45b-59ba-4508-a8a0-e3445f548519]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:56:23 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6cc5b4-85d2-41b9-aec1-f0219c0b9f17]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f] added
Aug 01 15:56:23 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4818f58-d008-4e31-8001-9488b351d298]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6275c7b5-c2a2-4f7d-ad2b-6173a8554274]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrwkQsuT {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrwkQsuT" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cf729c-539e-4860-a857-ed9419b44cff]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HrwkQsuT'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[610b2e53-cba1-4063-aab2-0e93ed9ccfd7]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[62726919-dec1-4d36-8b46-1eab6f79453d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:56:23 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:56:23 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d4d2c8-ec1a-4c7c-b929-e7f87279f12b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f, portal: 172.16.0.220,3260]
Aug 01 15:56:23 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f, portal: 172.16.0.220,3260] successful.
Aug 01 15:56:23 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6f08f4-e9f7-47a2-80ef-fa27ce7d7688]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22b106c-995b-4a80-bbba-ecd3d76b80a8]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:56:23 user nova-compute[72201]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)
Aug 01 15:56:23 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:56:23 user nova-compute[72201]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)
Aug 01 15:56:23 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:56:23 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:56:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:56:24 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[346d1096-4766-4431-863e-e5af9d3add8f]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:56:24 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:56:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrwkQsuT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:56:24 user nova-compute[72201]: DEBUG nova.compute.manager [req-b7250f06-9436-469a-8500-458826a41979 req-295253f2-6c48-48cd-a44a-a93bb4328219 service nova] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Received event network-vif-plugged-cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:56:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b7250f06-9436-469a-8500-458826a41979 req-295253f2-6c48-48cd-a44a-a93bb4328219 service nova] Acquiring lock "e4f06d05-b05a-459c-9a44-0af858b2570d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:56:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b7250f06-9436-469a-8500-458826a41979 req-295253f2-6c48-48cd-a44a-a93bb4328219 service nova] Lock "e4f06d05-b05a-459c-9a44-0af858b2570d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:56:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-b7250f06-9436-469a-8500-458826a41979 req-295253f2-6c48-48cd-a44a-a93bb4328219 service nova] Lock "e4f06d05-b05a-459c-9a44-0af858b2570d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:56:24 user nova-compute[72201]: DEBUG nova.compute.manager [req-b7250f06-9436-469a-8500-458826a41979 req-295253f2-6c48-48cd-a44a-a93bb4328219 service nova] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] No waiting events found dispatching network-vif-plugged-cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:56:24 user nova-compute[72201]: WARNING nova.compute.manager [req-b7250f06-9436-469a-8500-458826a41979 req-295253f2-6c48-48cd-a44a-a93bb4328219 service nova] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Received unexpected event network-vif-plugged-cd914fa0-b0b1-472c-8ccb-a1fe1121c7ae for instance with vm_state deleted and task_state None.
Aug 01 15:56:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:56:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26333346563303164', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:56:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333346563303164', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:56:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:56:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1442669474',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1442669474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1442669474',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5EnuOcORFo96jw5/MK7ttlJ7vEf4302OMI5gbRgxh0lYEWIClYym9S7w7Pij6zkiKPj/zZvqtIVFGscSN1r1aaFh177hoJ37Ncu72z/V8lPD95lJUBkyshWXkTveD98A==',key_name='tempest-keypair-1157667379',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a49e4769bf348be8fedc8b70f65cea2',ramdisk_id='',reservation_id='r-j6h0u70q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1110722165',owner_user_name='tempest-TestVolumeBootPattern-1110722165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:56:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='222a94fd4bed425a8d80ba777c2361f0',uuid=26f5b55c-8ade-4f95-8756-7ab7319b1556,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30c6582f-7060-4694-99a3-1eff3a514631", "address": "fa:16:3e:0c:e3:80", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30c6582f-70", "ovs_interfaceid": "30c6582f-7060-4694-99a3-1eff3a514631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:56:25 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converting VIF {"id": "30c6582f-7060-4694-99a3-1eff3a514631", "address": "fa:16:3e:0c:e3:80", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30c6582f-70", "ovs_interfaceid": "30c6582f-7060-4694-99a3-1eff3a514631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:56:25 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:e3:80,bridge_name='br-int',has_traffic_filtering=True,id=30c6582f-7060-4694-99a3-1eff3a514631,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30c6582f-70') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:56:25 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lazy-loading 'pci_devices' on Instance uuid 26f5b55c-8ade-4f95-8756-7ab7319b1556 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:56:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:56:25 user nova-compute[72201]:   <uuid>26f5b55c-8ade-4f95-8756-7ab7319b1556</uuid>
Aug 01 15:56:25 user nova-compute[72201]:   <name>instance-0000002e</name>
Aug 01 15:56:25 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:56:25 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:56:25 user nova-compute[72201]:   <metadata>
Aug 01 15:56:25 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:56:25 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:56:25 user nova-compute[72201]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1442669474</nova:name>
Aug 01 15:56:25 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:56:23</nova:creationTime>
Aug 01 15:56:25 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:56:25 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:56:25 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:56:25 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:56:25 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:56:25 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:56:25 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:56:25 user nova-compute[72201]:       <nova:owner>
Aug 01 15:56:25 user nova-compute[72201]:         <nova:user uuid="222a94fd4bed425a8d80ba777c2361f0">tempest-TestVolumeBootPattern-1110722165-project-member</nova:user>
Aug 01 15:56:25 user nova-compute[72201]:         <nova:project uuid="3a49e4769bf348be8fedc8b70f65cea2">tempest-TestVolumeBootPattern-1110722165</nova:project>
Aug 01 15:56:25 user nova-compute[72201]:       </nova:owner>
Aug 01 15:56:25 user nova-compute[72201]:       <nova:ports>
Aug 01 15:56:25 user nova-compute[72201]:         <nova:port uuid="30c6582f-7060-4694-99a3-1eff3a514631">
Aug 01 15:56:25 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 15:56:25 user nova-compute[72201]:         </nova:port>
Aug 01 15:56:25 user nova-compute[72201]:       </nova:ports>
Aug 01 15:56:25 user nova-compute[72201]:     </nova:instance>
Aug 01 15:56:25 user nova-compute[72201]:   </metadata>
Aug 01 15:56:25 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:56:25 user nova-compute[72201]:     <system>
Aug 01 15:56:25 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:56:25 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:56:25 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:56:25 user nova-compute[72201]:       <entry name="serial">26f5b55c-8ade-4f95-8756-7ab7319b1556</entry>
Aug 01 15:56:25 user nova-compute[72201]:       <entry name="uuid">26f5b55c-8ade-4f95-8756-7ab7319b1556</entry>
Aug 01 15:56:25 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:56:25 user nova-compute[72201]:     </system>
Aug 01 15:56:25 user nova-compute[72201]:   </sysinfo>
Aug 01 15:56:25 user nova-compute[72201]:   <os>
Aug 01 15:56:25 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:56:25 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:56:25 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:56:25 user nova-compute[72201]:   </os>
Aug 01 15:56:25 user nova-compute[72201]:   <features>
Aug 01 15:56:25 user nova-compute[72201]:     <acpi/>
Aug 01 15:56:25 user nova-compute[72201]:     <apic/>
Aug 01 15:56:25 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:56:25 user nova-compute[72201]:   </features>
Aug 01 15:56:25 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:56:25 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:56:25 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:56:25 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:56:25 user nova-compute[72201]:   </clock>
Aug 01 15:56:25 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:56:25 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:56:25 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:56:25 user nova-compute[72201]:   </cpu>
Aug 01 15:56:25 user nova-compute[72201]:   <devices>
Aug 01 15:56:25 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:56:25 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:56:25 user nova-compute[72201]:       <source dev="/dev/sdb"/>
Aug 01 15:56:25 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:56:25 user nova-compute[72201]:       <serial>2572a4c8-01fa-4997-88f8-91d90f79843f</serial>
Aug 01 15:56:25 user nova-compute[72201]:     </disk>
Aug 01 15:56:25 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:56:25 user nova-compute[72201]:       <mac address="fa:16:3e:0c:e3:80"/>
Aug 01 15:56:25 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:56:25 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:56:25 user nova-compute[72201]:       <target dev="tap30c6582f-70"/>
Aug 01 15:56:25 user nova-compute[72201]:     </interface>
Aug 01 15:56:25 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:56:25 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/26f5b55c-8ade-4f95-8756-7ab7319b1556/console.log" append="off"/>
Aug 01 15:56:25 user nova-compute[72201]:     </serial>
Aug 01 15:56:25 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:56:25 user nova-compute[72201]:     <video>
Aug 01 15:56:25 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:56:25 user nova-compute[72201]:     </video>
Aug 01 15:56:25 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:56:25 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:56:25 user nova-compute[72201]:     </rng>
Aug 01 15:56:25 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:56:25 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:56:25 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:56:25 user nova-compute[72201]:     </memballoon>
Aug 01 15:56:25 user nova-compute[72201]:   </devices>
Aug 01 15:56:25 user nova-compute[72201]: </domain>
Aug 01 15:56:25 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:56:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:56:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1442669474',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1442669474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1442669474',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5EnuOcORFo96jw5/MK7ttlJ7vEf4302OMI5gbRgxh0lYEWIClYym9S7w7Pij6zkiKPj/zZvqtIVFGscSN1r1aaFh177hoJ37Ncu72z/V8lPD95lJUBkyshWXkTveD98A==',key_name='tempest-keypair-1157667379',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a49e4769bf348be8fedc8b70f65cea2',ramdisk_id='',reservation_id='r-j6h0u70q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1110722165',owner_user_name='tempest-TestVolumeBootPattern-1110722165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:56:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='222a94fd4bed425a8d80ba777c2361f0',uuid=26f5b55c-8ade-4f95-8756-7ab7319b1556,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30c6582f-7060-4694-99a3-1eff3a514631", "address": "fa:16:3e:0c:e3:80", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30c6582f-70", "ovs_interfaceid": "30c6582f-7060-4694-99a3-1eff3a514631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:56:25 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converting VIF {"id": "30c6582f-7060-4694-99a3-1eff3a514631", "address": "fa:16:3e:0c:e3:80", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30c6582f-70", "ovs_interfaceid": "30c6582f-7060-4694-99a3-1eff3a514631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:56:25 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:e3:80,bridge_name='br-int',has_traffic_filtering=True,id=30c6582f-7060-4694-99a3-1eff3a514631,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30c6582f-70') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:56:25 user nova-compute[72201]: DEBUG os_vif [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:e3:80,bridge_name='br-int',has_traffic_filtering=True,id=30c6582f-7060-4694-99a3-1eff3a514631,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30c6582f-70') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:56:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:56:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:56:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30c6582f-70, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:56:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap30c6582f-70, col_values=(('external_ids', {'iface-id': '30c6582f-7060-4694-99a3-1eff3a514631', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:e3:80', 'vm-uuid': '26f5b55c-8ade-4f95-8756-7ab7319b1556'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:56:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:56:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:25 user nova-compute[72201]: INFO os_vif [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:e3:80,bridge_name='br-int',has_traffic_filtering=True,id=30c6582f-7060-4694-99a3-1eff3a514631,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30c6582f-70')
Aug 01 15:56:25 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:56:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:56:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] No VIF found with MAC fa:16:3e:0c:e3:80, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:56:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:26 user nova-compute[72201]: DEBUG nova.compute.manager [req-bba76267-9d4c-47e8-a787-48cb3cb0eab4 req-7e232edd-3ac6-4bc7-8d51-ec76255be1f7 service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Received event network-vif-plugged-30c6582f-7060-4694-99a3-1eff3a514631 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:56:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bba76267-9d4c-47e8-a787-48cb3cb0eab4 req-7e232edd-3ac6-4bc7-8d51-ec76255be1f7 service nova] Acquiring lock "26f5b55c-8ade-4f95-8756-7ab7319b1556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:56:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bba76267-9d4c-47e8-a787-48cb3cb0eab4 req-7e232edd-3ac6-4bc7-8d51-ec76255be1f7 service nova] Lock "26f5b55c-8ade-4f95-8756-7ab7319b1556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:56:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-bba76267-9d4c-47e8-a787-48cb3cb0eab4 req-7e232edd-3ac6-4bc7-8d51-ec76255be1f7 service nova] Lock "26f5b55c-8ade-4f95-8756-7ab7319b1556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:56:26 user nova-compute[72201]: DEBUG nova.compute.manager [req-bba76267-9d4c-47e8-a787-48cb3cb0eab4 req-7e232edd-3ac6-4bc7-8d51-ec76255be1f7 service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] No waiting events found dispatching network-vif-plugged-30c6582f-7060-4694-99a3-1eff3a514631 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:56:26 user nova-compute[72201]: WARNING nova.compute.manager [req-bba76267-9d4c-47e8-a787-48cb3cb0eab4 req-7e232edd-3ac6-4bc7-8d51-ec76255be1f7 service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Received unexpected event network-vif-plugged-30c6582f-7060-4694-99a3-1eff3a514631 for instance with vm_state building and task_state spawning.
Aug 01 15:56:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:28 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690905388.4483705, 26f5b55c-8ade-4f95-8756-7ab7319b1556 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:56:28 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] VM Resumed (Lifecycle Event)
Aug 01 15:56:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:56:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:56:28 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Instance spawned successfully.
Aug 01 15:56:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:56:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:56:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:56:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:56:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:56:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:56:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:56:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:56:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:56:28 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:56:28 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690905388.4509425, 26f5b55c-8ade-4f95-8756-7ab7319b1556 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:56:28 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] VM Started (Lifecycle Event)
Aug 01 15:56:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:56:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:56:28 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:56:28 user nova-compute[72201]: INFO nova.compute.manager [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Took 4.91 seconds to spawn the instance on the hypervisor.
Aug 01 15:56:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:56:28 user nova-compute[72201]: INFO nova.compute.manager [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Took 12.89 seconds to build instance.
Aug 01 15:56:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ba513eb8-8f0a-4118-b18e-ddb534f3de69 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "26f5b55c-8ade-4f95-8756-7ab7319b1556" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.977s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:56:28 user nova-compute[72201]: DEBUG nova.compute.manager [req-79f89bfe-0884-4860-9500-dbba30eea65d req-e21a8a61-0c0c-4fea-ab35-a516203220bb service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Received event network-vif-plugged-30c6582f-7060-4694-99a3-1eff3a514631 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:56:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-79f89bfe-0884-4860-9500-dbba30eea65d req-e21a8a61-0c0c-4fea-ab35-a516203220bb service nova] Acquiring lock "26f5b55c-8ade-4f95-8756-7ab7319b1556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:56:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-79f89bfe-0884-4860-9500-dbba30eea65d req-e21a8a61-0c0c-4fea-ab35-a516203220bb service nova] Lock "26f5b55c-8ade-4f95-8756-7ab7319b1556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:56:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-79f89bfe-0884-4860-9500-dbba30eea65d req-e21a8a61-0c0c-4fea-ab35-a516203220bb service nova] Lock "26f5b55c-8ade-4f95-8756-7ab7319b1556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:56:28 user nova-compute[72201]: DEBUG nova.compute.manager [req-79f89bfe-0884-4860-9500-dbba30eea65d req-e21a8a61-0c0c-4fea-ab35-a516203220bb service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] No waiting events found dispatching network-vif-plugged-30c6582f-7060-4694-99a3-1eff3a514631 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:56:28 user nova-compute[72201]: WARNING nova.compute.manager [req-79f89bfe-0884-4860-9500-dbba30eea65d req-e21a8a61-0c0c-4fea-ab35-a516203220bb service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Received unexpected event network-vif-plugged-30c6582f-7060-4694-99a3-1eff3a514631 for instance with vm_state active and task_state None.
Aug 01 15:56:29 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:56:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:30 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:56:32 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:56:32 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:56:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:56:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:56:32 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:56:33 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Updating instance_info_cache with network_info: [{"id": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "address": "fa:16:3e:cc:e9:a4", "network": {"id": "cfe3e809-8e24-492c-b1dd-3c9575fe9614", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1264648726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd696a8fae3e493098ace053951b81c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f6bc8a-3b", "ovs_interfaceid": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:56:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:56:33 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:56:33 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:56:33 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:56:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:56:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:56:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:56:33 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:56:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:56:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:56:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:56:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:56:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:56:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:56:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:56:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:56:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:56:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:56:34 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:56:34 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:56:34 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8447MB free_disk=25.08979034423828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:56:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:56:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:56:34 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f0743332-223f-4507-b8b1-40d63b7b5e80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:56:34 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:56:34 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:56:34 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 26f5b55c-8ade-4f95-8756-7ab7319b1556 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:56:34 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:56:34 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:56:34 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing inventories for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 15:56:34 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating ProviderTree inventory for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 15:56:34 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating inventory in ProviderTree for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 15:56:34 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing aggregate associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, aggregates: None {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 15:56:34 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing trait associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 15:56:35 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:56:35 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:56:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:56:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:56:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:56:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:56:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:35 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:56:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:56:35 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:56:35 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:56:37 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690905382.5325024, e4f06d05-b05a-459c-9a44-0af858b2570d => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:56:37 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] VM Stopped (Lifecycle Event)
Aug 01 15:56:37 user nova-compute[72201]: DEBUG nova.compute.manager [None req-eaf42d0d-1237-4eac-99d8-b3dd102147fd None None] [instance: e4f06d05-b05a-459c-9a44-0af858b2570d] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:56:38 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:56:39 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:56:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:56:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:56:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Acquiring lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:56:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:56:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Acquiring lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:56:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:56:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:56:40 user nova-compute[72201]: INFO nova.compute.manager [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Terminating instance
Aug 01 15:56:40 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:56:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:41 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Instance destroyed successfully.
Aug 01 15:56:41 user nova-compute[72201]: DEBUG nova.objects.instance [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lazy-loading 'resources' on Instance uuid 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:56:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-135068720',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-135068720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1350687',id=45,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPS7xAfpJyDLtrZQpduPaMOX7Xjv3nPMzBgLFs6wBqg8s6ELN/S0zmZD2gT9OCszxsRh3bc/tRdh7hlOn4/cYYJ8eO1HsXN7IVTZm8rssa32DLaluFkCZg9NBLoYvEEhOQ==',key_name='tempest-keypair-200123604',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:53:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd696a8fae3e493098ace053951b81c3',ramdisk_id='',reservation_id='r-f0uqvuek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1843605665',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:53:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e2aeb6d917c4f5d92155f66bc31c493',uuid=8f1840c4-0c6f-4d84-913a-ebd3b5d2407b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "address": "fa:16:3e:cc:e9:a4", "network": {"id": "cfe3e809-8e24-492c-b1dd-3c9575fe9614", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1264648726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd696a8fae3e493098ace053951b81c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f6bc8a-3b", "ovs_interfaceid": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:56:41 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Converting VIF {"id": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "address": "fa:16:3e:cc:e9:a4", "network": {"id": "cfe3e809-8e24-492c-b1dd-3c9575fe9614", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1264648726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd696a8fae3e493098ace053951b81c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f6bc8a-3b", "ovs_interfaceid": "71f6bc8a-3b92-44d0-9556-89649ac6cb95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:56:41 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:e9:a4,bridge_name='br-int',has_traffic_filtering=True,id=71f6bc8a-3b92-44d0-9556-89649ac6cb95,network=Network(cfe3e809-8e24-492c-b1dd-3c9575fe9614),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f6bc8a-3b') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:56:41 user nova-compute[72201]: DEBUG os_vif [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:e9:a4,bridge_name='br-int',has_traffic_filtering=True,id=71f6bc8a-3b92-44d0-9556-89649ac6cb95,network=Network(cfe3e809-8e24-492c-b1dd-3c9575fe9614),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f6bc8a-3b') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:56:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71f6bc8a-3b, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:56:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:56:41 user nova-compute[72201]: INFO os_vif [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:e9:a4,bridge_name='br-int',has_traffic_filtering=True,id=71f6bc8a-3b92-44d0-9556-89649ac6cb95,network=Network(cfe3e809-8e24-492c-b1dd-3c9575fe9614),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f6bc8a-3b')
Aug 01 15:56:41 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Deleting instance files /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b_del
Aug 01 15:56:41 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Deletion of /opt/stack/data/nova/instances/8f1840c4-0c6f-4d84-913a-ebd3b5d2407b_del complete
Aug 01 15:56:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-cbbb1cd2-09dd-4c6f-95d2-676e6cb13d4f req-ef660c00-76d0-4618-ad34-0a6bef928246 service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Received event network-vif-unplugged-71f6bc8a-3b92-44d0-9556-89649ac6cb95 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:56:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cbbb1cd2-09dd-4c6f-95d2-676e6cb13d4f req-ef660c00-76d0-4618-ad34-0a6bef928246 service nova] Acquiring lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:56:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cbbb1cd2-09dd-4c6f-95d2-676e6cb13d4f req-ef660c00-76d0-4618-ad34-0a6bef928246 service nova] Lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:56:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cbbb1cd2-09dd-4c6f-95d2-676e6cb13d4f req-ef660c00-76d0-4618-ad34-0a6bef928246 service nova] Lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:56:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-cbbb1cd2-09dd-4c6f-95d2-676e6cb13d4f req-ef660c00-76d0-4618-ad34-0a6bef928246 service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] No waiting events found dispatching network-vif-unplugged-71f6bc8a-3b92-44d0-9556-89649ac6cb95 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:56:41 user nova-compute[72201]: DEBUG nova.compute.manager [req-cbbb1cd2-09dd-4c6f-95d2-676e6cb13d4f req-ef660c00-76d0-4618-ad34-0a6bef928246 service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Received event network-vif-unplugged-71f6bc8a-3b92-44d0-9556-89649ac6cb95 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:56:41 user nova-compute[72201]: INFO nova.compute.manager [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 15:56:41 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:56:41 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:56:41 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:56:42 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:56:42 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:56:42 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Took 1.00 seconds to deallocate network for instance.
Aug 01 15:56:42 user nova-compute[72201]: DEBUG nova.compute.manager [req-5611d565-e507-40c5-ba3d-b7eb886f7cc9 req-f63a903b-d4fe-4568-bcce-b5fa061d5835 service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Received event network-vif-deleted-71f6bc8a-3b92-44d0-9556-89649ac6cb95 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:56:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:56:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:56:42 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:56:42 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:56:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:56:42 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Deleted allocations for instance 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b
Aug 01 15:56:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9df91f35-3bff-45e8-b4e9-cc42a71c8404 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665 tempest-TestServerVolumeAttachScenarioOldVersion-1843605665-project-member] Lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.270s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:56:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-c1a2b8c8-ee3c-42cb-a6d2-9056cdd27b90 req-f7ab784e-676a-4328-bd00-529b76bb9d54 service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Received event network-vif-plugged-71f6bc8a-3b92-44d0-9556-89649ac6cb95 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:56:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c1a2b8c8-ee3c-42cb-a6d2-9056cdd27b90 req-f7ab784e-676a-4328-bd00-529b76bb9d54 service nova] Acquiring lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:56:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c1a2b8c8-ee3c-42cb-a6d2-9056cdd27b90 req-f7ab784e-676a-4328-bd00-529b76bb9d54 service nova] Lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:56:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c1a2b8c8-ee3c-42cb-a6d2-9056cdd27b90 req-f7ab784e-676a-4328-bd00-529b76bb9d54 service nova] Lock "8f1840c4-0c6f-4d84-913a-ebd3b5d2407b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:56:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-c1a2b8c8-ee3c-42cb-a6d2-9056cdd27b90 req-f7ab784e-676a-4328-bd00-529b76bb9d54 service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] No waiting events found dispatching network-vif-plugged-71f6bc8a-3b92-44d0-9556-89649ac6cb95 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:56:43 user nova-compute[72201]: WARNING nova.compute.manager [req-c1a2b8c8-ee3c-42cb-a6d2-9056cdd27b90 req-f7ab784e-676a-4328-bd00-529b76bb9d54 service nova] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Received unexpected event network-vif-plugged-71f6bc8a-3b92-44d0-9556-89649ac6cb95 for instance with vm_state deleted and task_state None.
Aug 01 15:56:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:56 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690905401.062821, 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:56:56 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] VM Stopped (Lifecycle Event)
Aug 01 15:56:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-7c5deaf6-c610-4c57-b1db-e93e4e48be7f None None] [instance: 8f1840c4-0c6f-4d84-913a-ebd3b5d2407b] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:56:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:56:58 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:56:58 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 15:56:58 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] There are 0 instances to clean {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 15:56:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:10 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:57:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid f0743332-223f-4507-b8b1-40d63b7b5e80 {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:57:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:57:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid 26f5b55c-8ade-4f95-8756-7ab7319b1556 {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 15:57:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "f0743332-223f-4507-b8b1-40d63b7b5e80" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:57:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:57:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:57:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:57:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "26f5b55c-8ade-4f95-8756-7ab7319b1556" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:57:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "26f5b55c-8ade-4f95-8756-7ab7319b1556" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:57:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:57:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:57:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "26f5b55c-8ade-4f95-8756-7ab7319b1556" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:57:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:57:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:57:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:57:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:57:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:57:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:57:12 user nova-compute[72201]: INFO nova.compute.manager [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Terminating instance
Aug 01 15:57:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:57:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-87f70782-c832-482a-b7dc-c423eb29f899 req-ddde5b10-f8d7-4a3a-abdb-f9ee299736b3 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received event network-vif-unplugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:57:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-87f70782-c832-482a-b7dc-c423eb29f899 req-ddde5b10-f8d7-4a3a-abdb-f9ee299736b3 service nova] Acquiring lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:57:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-87f70782-c832-482a-b7dc-c423eb29f899 req-ddde5b10-f8d7-4a3a-abdb-f9ee299736b3 service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:57:12 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-87f70782-c832-482a-b7dc-c423eb29f899 req-ddde5b10-f8d7-4a3a-abdb-f9ee299736b3 service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:57:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-87f70782-c832-482a-b7dc-c423eb29f899 req-ddde5b10-f8d7-4a3a-abdb-f9ee299736b3 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] No waiting events found dispatching network-vif-unplugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:57:12 user nova-compute[72201]: DEBUG nova.compute.manager [req-87f70782-c832-482a-b7dc-c423eb29f899 req-ddde5b10-f8d7-4a3a-abdb-f9ee299736b3 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received event network-vif-unplugged-fa130bf4-53dc-43f7-8932-0aec318054d9 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:57:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:13 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Instance destroyed successfully.
Aug 01 15:57:13 user nova-compute[72201]: DEBUG nova.objects.instance [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'resources' on Instance uuid 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1571805310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1571805310',id=39,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:43:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ed7463cb6f84c4a8cf1ef0437eca988',ramdisk_id='',reservation_id='r-pl830pzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:45:14Z,user_data=None,user_id='75b0cb34dac64c61a235470454e0c6bf',uuid=7e0642bf-a60d-4882-b7fb-38bbcdf69ee5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa130bf4-53dc-43f7-8932-0aec318054d9", "address": "fa:16:3e:92:e7:b2", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa130bf4-53", "ovs_interfaceid": "fa130bf4-53dc-43f7-8932-0aec318054d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converting VIF {"id": "fa130bf4-53dc-43f7-8932-0aec318054d9", "address": "fa:16:3e:92:e7:b2", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa130bf4-53", "ovs_interfaceid": "fa130bf4-53dc-43f7-8932-0aec318054d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:e7:b2,bridge_name='br-int',has_traffic_filtering=True,id=fa130bf4-53dc-43f7-8932-0aec318054d9,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa130bf4-53') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG os_vif [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:e7:b2,bridge_name='br-int',has_traffic_filtering=True,id=fa130bf4-53dc-43f7-8932-0aec318054d9,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa130bf4-53') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa130bf4-53, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:57:13 user nova-compute[72201]: INFO os_vif [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:e7:b2,bridge_name='br-int',has_traffic_filtering=True,id=fa130bf4-53dc-43f7-8932-0aec318054d9,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa130bf4-53')
Aug 01 15:57:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vqZNjAls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:57:13 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:57:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af416e0-d8ab-4817-9bcd-647eabdcf435]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f84a338-1ea0-44bc-a2fd-2791250cf5b0]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:57:13 user nova-compute[72201]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)
Aug 01 15:57:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 (non-flash)
Aug 01 15:57:13 user nova-compute[72201]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)
Aug 01 15:57:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c1a3490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92'): ({'sdc'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Removing single pathed devices sdc {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47852b9-6bd4-40b8-a502-9cef20253b7f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ac95e7-1f7b-4161-a4a0-8d7d4cb29051]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Flushing IO for device /dev/sdc {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ac4e38-a07b-4afc-ab1e-a1a8d8430235]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51c1834-6cd5-49d2-9067-13f15fbfeed3]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70521a2-8181-4b46-9cf6-b4b419dba97e]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c2ca86-d5b1-4ea8-8995-e5287b3a0dc1]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92, portal: 172.16.0.220,3260]
Aug 01 15:57:13 user nova-compute[72201]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92, portal: 172.16.0.220,3260] successful.
Aug 01 15:57:13 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a13640-d808-40a7-8670-a2a67ea37f92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c44e31-0fd5-4899-95fe-9dd7871610a6]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] <== disconnect_volume: return (283ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 15:57:13 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Deleting instance files /opt/stack/data/nova/instances/7e0642bf-a60d-4882-b7fb-38bbcdf69ee5_del
Aug 01 15:57:13 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Deletion of /opt/stack/data/nova/instances/7e0642bf-a60d-4882-b7fb-38bbcdf69ee5_del complete
Aug 01 15:57:13 user nova-compute[72201]: INFO nova.compute.manager [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 01 15:57:13 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:57:13 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:57:14 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:57:14 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Took 0.55 seconds to deallocate network for instance.
Aug 01 15:57:14 user nova-compute[72201]: DEBUG nova.compute.manager [req-2b20ef6e-98ae-498b-83af-827d11b38373 req-aba4a93f-936b-4f7e-872a-5f7ce5801769 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received event network-vif-deleted-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:57:14 user nova-compute[72201]: DEBUG nova.compute.manager [req-462fb82e-442b-4b17-818b-bfe401bda17e req-2ccb0d74-fad7-4825-9a03-59a941e9a411 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received event network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:57:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-462fb82e-442b-4b17-818b-bfe401bda17e req-2ccb0d74-fad7-4825-9a03-59a941e9a411 service nova] Acquiring lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:57:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-462fb82e-442b-4b17-818b-bfe401bda17e req-2ccb0d74-fad7-4825-9a03-59a941e9a411 service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:57:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-462fb82e-442b-4b17-818b-bfe401bda17e req-2ccb0d74-fad7-4825-9a03-59a941e9a411 service nova] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:57:14 user nova-compute[72201]: DEBUG nova.compute.manager [req-462fb82e-442b-4b17-818b-bfe401bda17e req-2ccb0d74-fad7-4825-9a03-59a941e9a411 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] No waiting events found dispatching network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:57:14 user nova-compute[72201]: WARNING nova.compute.manager [req-462fb82e-442b-4b17-818b-bfe401bda17e req-2ccb0d74-fad7-4825-9a03-59a941e9a411 service nova] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Received unexpected event network-vif-plugged-fa130bf4-53dc-43f7-8932-0aec318054d9 for instance with vm_state active and task_state deleting.
Aug 01 15:57:14 user nova-compute[72201]: INFO nova.compute.manager [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Took 0.73 seconds to detach 1 volumes for instance.
Aug 01 15:57:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:57:14 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:57:14 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:57:14 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:57:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:57:15 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Deleted allocations for instance 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5
Aug 01 15:57:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5574e317-1a1f-48fe-8108-23113e61a4b5 tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "7e0642bf-a60d-4882-b7fb-38bbcdf69ee5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.740s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:57:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:26 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:57:28 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690905433.1213555, 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:57:28 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] VM Stopped (Lifecycle Event)
Aug 01 15:57:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-12483bd2-51e3-4f07-ba31-0a1fd0608244 None None] [instance: 7e0642bf-a60d-4882-b7fb-38bbcdf69ee5] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:57:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:30 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:57:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:32 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:57:32 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:57:32 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 15:57:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:57:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:57:32 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:57:32 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid f0743332-223f-4507-b8b1-40d63b7b5e80 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:57:32 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Updating instance_info_cache with network_info: [{"id": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "address": "fa:16:3e:6a:5e:e0", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6062f511-71", "ovs_interfaceid": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:57:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-f0743332-223f-4507-b8b1-40d63b7b5e80" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:57:32 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:57:33 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:57:33 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:57:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:57:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:57:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:57:33 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:57:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:57:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:57:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:57:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:57:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:57:33 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:57:33 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:57:33 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8551MB free_disk=25.11634063720703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:57:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:57:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:57:34 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance f0743332-223f-4507-b8b1-40d63b7b5e80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:57:34 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 26f5b55c-8ade-4f95-8756-7ab7319b1556 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:57:34 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:57:34 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:57:34 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:57:34 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:57:34 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:57:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:57:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:35 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:57:36 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:57:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:40 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:57:40 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:57:40 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:57:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:57:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:57:58 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:57:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:57:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:57:58 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:57:58 user nova-compute[72201]: INFO nova.compute.claims [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Claim successful on node user
Aug 01 15:57:58 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:57:58 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:57:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:57:58 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:57:58 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:57:58 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:57:58 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:57:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG nova.policy [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3962bf288b14e539ca16127713178e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17edafa90e946e5b9092443da878bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:57:59 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Creating image(s)
Aug 01 15:57:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "/opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "/opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.134s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk 1073741824" returned: 0 in 0.058s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Successfully created port: d73227e3-b63d-4772-939e-d51a5d0f944f {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Cannot resize image /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lazy-loading 'migration_context' on Instance uuid a5a2d1de-1be6-4310-95c9-a0e360fcfba2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Ensure instance console log exists: /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:57:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Successfully updated port: d73227e3-b63d-4772-939e-d51a5d0f944f {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "refresh_cache-a5a2d1de-1be6-4310-95c9-a0e360fcfba2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquired lock "refresh_cache-a5a2d1de-1be6-4310-95c9-a0e360fcfba2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.compute.manager [req-f2d356ae-dba5-407f-aa58-89b314a5ccfa req-6df52600-6f30-4233-b8e5-a5ed09fca7c2 service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Received event network-changed-d73227e3-b63d-4772-939e-d51a5d0f944f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.compute.manager [req-f2d356ae-dba5-407f-aa58-89b314a5ccfa req-6df52600-6f30-4233-b8e5-a5ed09fca7c2 service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Refreshing instance network info cache due to event network-changed-d73227e3-b63d-4772-939e-d51a5d0f944f. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f2d356ae-dba5-407f-aa58-89b314a5ccfa req-6df52600-6f30-4233-b8e5-a5ed09fca7c2 service nova] Acquiring lock "refresh_cache-a5a2d1de-1be6-4310-95c9-a0e360fcfba2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.network.neutron [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Updating instance_info_cache with network_info: [{"id": "d73227e3-b63d-4772-939e-d51a5d0f944f", "address": "fa:16:3e:ae:26:84", "network": {"id": "e663c2b6-49c0-4ca9-af67-1b58650f9111", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443771328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17edafa90e946e5b9092443da878bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73227e3-b6", "ovs_interfaceid": "d73227e3-b63d-4772-939e-d51a5d0f944f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Releasing lock "refresh_cache-a5a2d1de-1be6-4310-95c9-a0e360fcfba2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Instance network_info: |[{"id": "d73227e3-b63d-4772-939e-d51a5d0f944f", "address": "fa:16:3e:ae:26:84", "network": {"id": "e663c2b6-49c0-4ca9-af67-1b58650f9111", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443771328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17edafa90e946e5b9092443da878bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73227e3-b6", "ovs_interfaceid": "d73227e3-b63d-4772-939e-d51a5d0f944f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f2d356ae-dba5-407f-aa58-89b314a5ccfa req-6df52600-6f30-4233-b8e5-a5ed09fca7c2 service nova] Acquired lock "refresh_cache-a5a2d1de-1be6-4310-95c9-a0e360fcfba2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.network.neutron [req-f2d356ae-dba5-407f-aa58-89b314a5ccfa req-6df52600-6f30-4233-b8e5-a5ed09fca7c2 service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Refreshing network info cache for port d73227e3-b63d-4772-939e-d51a5d0f944f {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Start _get_guest_xml network_info=[{"id": "d73227e3-b63d-4772-939e-d51a5d0f944f", "address": "fa:16:3e:ae:26:84", "network": {"id": "e663c2b6-49c0-4ca9-af67-1b58650f9111", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443771328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17edafa90e946e5b9092443da878bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73227e3-b6", "ovs_interfaceid": "d73227e3-b63d-4772-939e-d51a5d0f944f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:58:00 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:58:00 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:57:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-821328104',display_name='tempest-SnapshotDataIntegrityTests-server-821328104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-821328104',id=47,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+8Qozkm/YjCA81dj3PJn4XhGrFjytKfQXcKRObZkg7ms2s7cZgDN/cqUMTJbvdY55Mo6pQ0DfkAHlMiyJFwTpZXuV78tHk/9r9eGBO8QmJKZ68unukquAcVgVS3BbD/g==',key_name='tempest-keypair-130889552',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c17edafa90e946e5b9092443da878bad',ramdisk_id='',reservation_id='r-hm4wvukf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1452624855',owner_user_name='tempest-SnapshotDataIntegrityTests-1452624855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3962bf288b14e539ca16127713178e6',uuid=a5a2d1de-1be6-4310-95c9-a0e360fcfba2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d73227e3-b63d-4772-939e-d51a5d0f944f", "address": "fa:16:3e:ae:26:84", "network": {"id": "e663c2b6-49c0-4ca9-af67-1b58650f9111", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443771328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17edafa90e946e5b9092443da878bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73227e3-b6", "ovs_interfaceid": "d73227e3-b63d-4772-939e-d51a5d0f944f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Converting VIF {"id": "d73227e3-b63d-4772-939e-d51a5d0f944f", "address": "fa:16:3e:ae:26:84", "network": {"id": "e663c2b6-49c0-4ca9-af67-1b58650f9111", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443771328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17edafa90e946e5b9092443da878bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73227e3-b6", "ovs_interfaceid": "d73227e3-b63d-4772-939e-d51a5d0f944f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:26:84,bridge_name='br-int',has_traffic_filtering=True,id=d73227e3-b63d-4772-939e-d51a5d0f944f,network=Network(e663c2b6-49c0-4ca9-af67-1b58650f9111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd73227e3-b6') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lazy-loading 'pci_devices' on Instance uuid a5a2d1de-1be6-4310-95c9-a0e360fcfba2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:58:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:58:00 user nova-compute[72201]:   <uuid>a5a2d1de-1be6-4310-95c9-a0e360fcfba2</uuid>
Aug 01 15:58:00 user nova-compute[72201]:   <name>instance-0000002f</name>
Aug 01 15:58:00 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:58:00 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:58:00 user nova-compute[72201]:   <metadata>
Aug 01 15:58:00 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:58:00 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:58:00 user nova-compute[72201]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-821328104</nova:name>
Aug 01 15:58:00 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:58:00</nova:creationTime>
Aug 01 15:58:00 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:58:00 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:58:00 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:58:00 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:58:00 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:58:00 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:58:00 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:58:00 user nova-compute[72201]:       <nova:owner>
Aug 01 15:58:00 user nova-compute[72201]:         <nova:user uuid="c3962bf288b14e539ca16127713178e6">tempest-SnapshotDataIntegrityTests-1452624855-project-member</nova:user>
Aug 01 15:58:00 user nova-compute[72201]:         <nova:project uuid="c17edafa90e946e5b9092443da878bad">tempest-SnapshotDataIntegrityTests-1452624855</nova:project>
Aug 01 15:58:00 user nova-compute[72201]:       </nova:owner>
Aug 01 15:58:00 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 15:58:00 user nova-compute[72201]:       <nova:ports>
Aug 01 15:58:00 user nova-compute[72201]:         <nova:port uuid="d73227e3-b63d-4772-939e-d51a5d0f944f">
Aug 01 15:58:00 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 15:58:00 user nova-compute[72201]:         </nova:port>
Aug 01 15:58:00 user nova-compute[72201]:       </nova:ports>
Aug 01 15:58:00 user nova-compute[72201]:     </nova:instance>
Aug 01 15:58:00 user nova-compute[72201]:   </metadata>
Aug 01 15:58:00 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:58:00 user nova-compute[72201]:     <system>
Aug 01 15:58:00 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:58:00 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:58:00 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:58:00 user nova-compute[72201]:       <entry name="serial">a5a2d1de-1be6-4310-95c9-a0e360fcfba2</entry>
Aug 01 15:58:00 user nova-compute[72201]:       <entry name="uuid">a5a2d1de-1be6-4310-95c9-a0e360fcfba2</entry>
Aug 01 15:58:00 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:58:00 user nova-compute[72201]:     </system>
Aug 01 15:58:00 user nova-compute[72201]:   </sysinfo>
Aug 01 15:58:00 user nova-compute[72201]:   <os>
Aug 01 15:58:00 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:58:00 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:58:00 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:58:00 user nova-compute[72201]:   </os>
Aug 01 15:58:00 user nova-compute[72201]:   <features>
Aug 01 15:58:00 user nova-compute[72201]:     <acpi/>
Aug 01 15:58:00 user nova-compute[72201]:     <apic/>
Aug 01 15:58:00 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:58:00 user nova-compute[72201]:   </features>
Aug 01 15:58:00 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:58:00 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:58:00 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:58:00 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:58:00 user nova-compute[72201]:   </clock>
Aug 01 15:58:00 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:58:00 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:58:00 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:58:00 user nova-compute[72201]:   </cpu>
Aug 01 15:58:00 user nova-compute[72201]:   <devices>
Aug 01 15:58:00 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 15:58:00 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 15:58:00 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk"/>
Aug 01 15:58:00 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:58:00 user nova-compute[72201]:     </disk>
Aug 01 15:58:00 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:58:00 user nova-compute[72201]:       <mac address="fa:16:3e:ae:26:84"/>
Aug 01 15:58:00 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:58:00 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:58:00 user nova-compute[72201]:       <target dev="tapd73227e3-b6"/>
Aug 01 15:58:00 user nova-compute[72201]:     </interface>
Aug 01 15:58:00 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:58:00 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/console.log" append="off"/>
Aug 01 15:58:00 user nova-compute[72201]:     </serial>
Aug 01 15:58:00 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:58:00 user nova-compute[72201]:     <video>
Aug 01 15:58:00 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:58:00 user nova-compute[72201]:     </video>
Aug 01 15:58:00 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:58:00 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:58:00 user nova-compute[72201]:     </rng>
Aug 01 15:58:00 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:58:00 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:58:00 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:58:00 user nova-compute[72201]:     </memballoon>
Aug 01 15:58:00 user nova-compute[72201]:   </devices>
Aug 01 15:58:00 user nova-compute[72201]: </domain>
Aug 01 15:58:00 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:58:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:57:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-821328104',display_name='tempest-SnapshotDataIntegrityTests-server-821328104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-821328104',id=47,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+8Qozkm/YjCA81dj3PJn4XhGrFjytKfQXcKRObZkg7ms2s7cZgDN/cqUMTJbvdY55Mo6pQ0DfkAHlMiyJFwTpZXuV78tHk/9r9eGBO8QmJKZ68unukquAcVgVS3BbD/g==',key_name='tempest-keypair-130889552',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c17edafa90e946e5b9092443da878bad',ramdisk_id='',reservation_id='r-hm4wvukf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1452624855',owner_user_name='tempest-SnapshotDataIntegrityTests-1452624855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3962bf288b14e539ca16127713178e6',uuid=a5a2d1de-1be6-4310-95c9-a0e360fcfba2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d73227e3-b63d-4772-939e-d51a5d0f944f", "address": "fa:16:3e:ae:26:84", "network": {"id": "e663c2b6-49c0-4ca9-af67-1b58650f9111", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443771328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17edafa90e946e5b9092443da878bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73227e3-b6", "ovs_interfaceid": "d73227e3-b63d-4772-939e-d51a5d0f944f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:58:01 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Converting VIF {"id": "d73227e3-b63d-4772-939e-d51a5d0f944f", "address": "fa:16:3e:ae:26:84", "network": {"id": "e663c2b6-49c0-4ca9-af67-1b58650f9111", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443771328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17edafa90e946e5b9092443da878bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73227e3-b6", "ovs_interfaceid": "d73227e3-b63d-4772-939e-d51a5d0f944f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:58:01 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:26:84,bridge_name='br-int',has_traffic_filtering=True,id=d73227e3-b63d-4772-939e-d51a5d0f944f,network=Network(e663c2b6-49c0-4ca9-af67-1b58650f9111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd73227e3-b6') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:58:01 user nova-compute[72201]: DEBUG os_vif [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:26:84,bridge_name='br-int',has_traffic_filtering=True,id=d73227e3-b63d-4772-939e-d51a5d0f944f,network=Network(e663c2b6-49c0-4ca9-af67-1b58650f9111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd73227e3-b6') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:58:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:58:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:58:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd73227e3-b6, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:58:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd73227e3-b6, col_values=(('external_ids', {'iface-id': 'd73227e3-b63d-4772-939e-d51a5d0f944f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:26:84', 'vm-uuid': 'a5a2d1de-1be6-4310-95c9-a0e360fcfba2'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:58:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:58:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:01 user nova-compute[72201]: INFO os_vif [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:26:84,bridge_name='br-int',has_traffic_filtering=True,id=d73227e3-b63d-4772-939e-d51a5d0f944f,network=Network(e663c2b6-49c0-4ca9-af67-1b58650f9111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd73227e3-b6')
Aug 01 15:58:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:58:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] No VIF found with MAC fa:16:3e:ae:26:84, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:58:01 user nova-compute[72201]: DEBUG nova.network.neutron [req-f2d356ae-dba5-407f-aa58-89b314a5ccfa req-6df52600-6f30-4233-b8e5-a5ed09fca7c2 service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Updated VIF entry in instance network info cache for port d73227e3-b63d-4772-939e-d51a5d0f944f. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:58:01 user nova-compute[72201]: DEBUG nova.network.neutron [req-f2d356ae-dba5-407f-aa58-89b314a5ccfa req-6df52600-6f30-4233-b8e5-a5ed09fca7c2 service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Updating instance_info_cache with network_info: [{"id": "d73227e3-b63d-4772-939e-d51a5d0f944f", "address": "fa:16:3e:ae:26:84", "network": {"id": "e663c2b6-49c0-4ca9-af67-1b58650f9111", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443771328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17edafa90e946e5b9092443da878bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73227e3-b6", "ovs_interfaceid": "d73227e3-b63d-4772-939e-d51a5d0f944f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:58:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f2d356ae-dba5-407f-aa58-89b314a5ccfa req-6df52600-6f30-4233-b8e5-a5ed09fca7c2 service nova] Releasing lock "refresh_cache-a5a2d1de-1be6-4310-95c9-a0e360fcfba2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:58:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-140512e8-7688-4f82-8635-e5b5b9885201 req-ab2bcd4b-7074-4d41-a88f-38981578ab01 service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Received event network-vif-plugged-d73227e3-b63d-4772-939e-d51a5d0f944f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:58:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-140512e8-7688-4f82-8635-e5b5b9885201 req-ab2bcd4b-7074-4d41-a88f-38981578ab01 service nova] Acquiring lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:58:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-140512e8-7688-4f82-8635-e5b5b9885201 req-ab2bcd4b-7074-4d41-a88f-38981578ab01 service nova] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:58:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-140512e8-7688-4f82-8635-e5b5b9885201 req-ab2bcd4b-7074-4d41-a88f-38981578ab01 service nova] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:58:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-140512e8-7688-4f82-8635-e5b5b9885201 req-ab2bcd4b-7074-4d41-a88f-38981578ab01 service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] No waiting events found dispatching network-vif-plugged-d73227e3-b63d-4772-939e-d51a5d0f944f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:58:02 user nova-compute[72201]: WARNING nova.compute.manager [req-140512e8-7688-4f82-8635-e5b5b9885201 req-ab2bcd4b-7074-4d41-a88f-38981578ab01 service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Received unexpected event network-vif-plugged-d73227e3-b63d-4772-939e-d51a5d0f944f for instance with vm_state building and task_state spawning.
Aug 01 15:58:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "f0743332-223f-4507-b8b1-40d63b7b5e80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:58:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:58:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:58:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:58:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:58:03 user nova-compute[72201]: INFO nova.compute.manager [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Terminating instance
Aug 01 15:58:03 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 15:58:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:04 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Instance destroyed successfully.
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.objects.instance [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lazy-loading 'resources' on Instance uuid f0743332-223f-4507-b8b1-40d63b7b5e80 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1796964185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1796964185',id=36,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:37:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ed7463cb6f84c4a8cf1ef0437eca988',ramdisk_id='',reservation_id='r-m9zq30r6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:39:35Z,user_data=None,user_id='75b0cb34dac64c61a235470454e0c6bf',uuid=f0743332-223f-4507-b8b1-40d63b7b5e80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "address": "fa:16:3e:6a:5e:e0", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6062f511-71", "ovs_interfaceid": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converting VIF {"id": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "address": "fa:16:3e:6a:5e:e0", "network": {"id": "be20f86b-5a5b-4d52-ae08-874521d7d787", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1021399842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed7463cb6f84c4a8cf1ef0437eca988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6062f511-71", "ovs_interfaceid": "6062f511-7140-4d9d-b36d-148a2f8a7fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:5e:e0,bridge_name='br-int',has_traffic_filtering=True,id=6062f511-7140-4d9d-b36d-148a2f8a7fb5,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6062f511-71') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG os_vif [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:5e:e0,bridge_name='br-int',has_traffic_filtering=True,id=6062f511-7140-4d9d-b36d-148a2f8a7fb5,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6062f511-71') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6062f511-71, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:58:04 user nova-compute[72201]: INFO os_vif [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:5e:e0,bridge_name='br-int',has_traffic_filtering=True,id=6062f511-7140-4d9d-b36d-148a2f8a7fb5,network=Network(be20f86b-5a5b-4d52-ae08-874521d7d787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6062f511-71')
Aug 01 15:58:04 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Deleting instance files /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80_del
Aug 01 15:58:04 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Deletion of /opt/stack/data/nova/instances/f0743332-223f-4507-b8b1-40d63b7b5e80_del complete
Aug 01 15:58:04 user nova-compute[72201]: INFO nova.compute.manager [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 01 15:58:04 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690905484.6962554, a5a2d1de-1be6-4310-95c9-a0e360fcfba2 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:58:04 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] VM Resumed (Lifecycle Event)
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:58:04 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Instance spawned successfully.
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Received event network-vif-plugged-d73227e3-b63d-4772-939e-d51a5d0f944f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] Acquiring lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] No waiting events found dispatching network-vif-plugged-d73227e3-b63d-4772-939e-d51a5d0f944f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:58:04 user nova-compute[72201]: WARNING nova.compute.manager [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Received unexpected event network-vif-plugged-d73227e3-b63d-4772-939e-d51a5d0f944f for instance with vm_state building and task_state spawning.
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Received event network-vif-unplugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] Acquiring lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] No waiting events found dispatching network-vif-unplugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Received event network-vif-unplugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Received event network-vif-plugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] Acquiring lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] No waiting events found dispatching network-vif-plugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:58:04 user nova-compute[72201]: WARNING nova.compute.manager [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Received unexpected event network-vif-plugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 for instance with vm_state active and task_state deleting.
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Received event network-vif-plugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] Acquiring lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] No waiting events found dispatching network-vif-plugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:58:04 user nova-compute[72201]: WARNING nova.compute.manager [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Received unexpected event network-vif-plugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 for instance with vm_state active and task_state deleting.
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Received event network-vif-plugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] Acquiring lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] No waiting events found dispatching network-vif-plugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:58:04 user nova-compute[72201]: WARNING nova.compute.manager [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Received unexpected event network-vif-plugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 for instance with vm_state active and task_state deleting.
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Received event network-vif-unplugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] Acquiring lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] No waiting events found dispatching network-vif-unplugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.compute.manager [req-8514571a-55b6-4fbc-a9e2-e02d662ff6db req-80f93850-b96b-4725-a361-09a8c0cc2a16 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Received event network-vif-unplugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 15:58:04 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690905484.7101345, a5a2d1de-1be6-4310-95c9-a0e360fcfba2 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:58:04 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] VM Started (Lifecycle Event)
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:04 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:58:04 user nova-compute[72201]: INFO nova.compute.manager [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Took 5.77 seconds to spawn the instance on the hypervisor.
Aug 01 15:58:04 user nova-compute[72201]: DEBUG nova.compute.manager [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:58:05 user nova-compute[72201]: INFO nova.compute.manager [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Took 6.41 seconds to build instance.
Aug 01 15:58:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ddf7161c-f62a-467e-90dd-11aa80e1c68b tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.502s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:58:05 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:58:05 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Took 0.98 seconds to deallocate network for instance.
Aug 01 15:58:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-92a15469-122e-471e-9642-da7defc0e1a6 req-bae285bc-1822-46fa-a2b8-5a818c68e4cf service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Received event network-vif-deleted-6062f511-7140-4d9d-b36d-148a2f8a7fb5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:58:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:58:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:58:05 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:58:05 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:58:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:58:05 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Deleted allocations for instance f0743332-223f-4507-b8b1-40d63b7b5e80
Aug 01 15:58:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9788f70a-1fa2-4e93-b961-f2a8e501a76d tempest-ServerBootFromVolumeStableRescueTest-1836467291 tempest-ServerBootFromVolumeStableRescueTest-1836467291-project-member] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.276s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:58:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-a78e65ea-566f-49b8-a03e-3e408ae91977 req-afbdac22-e62b-4918-8cf3-e31125222ca3 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Received event network-vif-plugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:58:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a78e65ea-566f-49b8-a03e-3e408ae91977 req-afbdac22-e62b-4918-8cf3-e31125222ca3 service nova] Acquiring lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:58:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a78e65ea-566f-49b8-a03e-3e408ae91977 req-afbdac22-e62b-4918-8cf3-e31125222ca3 service nova] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:58:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-a78e65ea-566f-49b8-a03e-3e408ae91977 req-afbdac22-e62b-4918-8cf3-e31125222ca3 service nova] Lock "f0743332-223f-4507-b8b1-40d63b7b5e80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:58:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-a78e65ea-566f-49b8-a03e-3e408ae91977 req-afbdac22-e62b-4918-8cf3-e31125222ca3 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] No waiting events found dispatching network-vif-plugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:58:06 user nova-compute[72201]: WARNING nova.compute.manager [req-a78e65ea-566f-49b8-a03e-3e408ae91977 req-afbdac22-e62b-4918-8cf3-e31125222ca3 service nova] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Received unexpected event network-vif-plugged-6062f511-7140-4d9d-b36d-148a2f8a7fb5 for instance with vm_state deleted and task_state None.
Aug 01 15:58:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-c8343c6d-e37f-414e-b28b-617785750867 req-818cdd55-9854-43a6-bde0-6149e7e2a81c service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Received event network-changed-30c6582f-7060-4694-99a3-1eff3a514631 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:58:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-c8343c6d-e37f-414e-b28b-617785750867 req-818cdd55-9854-43a6-bde0-6149e7e2a81c service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Refreshing instance network info cache due to event network-changed-30c6582f-7060-4694-99a3-1eff3a514631. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:58:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c8343c6d-e37f-414e-b28b-617785750867 req-818cdd55-9854-43a6-bde0-6149e7e2a81c service nova] Acquiring lock "refresh_cache-26f5b55c-8ade-4f95-8756-7ab7319b1556" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:58:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c8343c6d-e37f-414e-b28b-617785750867 req-818cdd55-9854-43a6-bde0-6149e7e2a81c service nova] Acquired lock "refresh_cache-26f5b55c-8ade-4f95-8756-7ab7319b1556" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:58:07 user nova-compute[72201]: DEBUG nova.network.neutron [req-c8343c6d-e37f-414e-b28b-617785750867 req-818cdd55-9854-43a6-bde0-6149e7e2a81c service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Refreshing network info cache for port 30c6582f-7060-4694-99a3-1eff3a514631 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:58:07 user nova-compute[72201]: DEBUG nova.network.neutron [req-c8343c6d-e37f-414e-b28b-617785750867 req-818cdd55-9854-43a6-bde0-6149e7e2a81c service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Updated VIF entry in instance network info cache for port 30c6582f-7060-4694-99a3-1eff3a514631. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:58:07 user nova-compute[72201]: DEBUG nova.network.neutron [req-c8343c6d-e37f-414e-b28b-617785750867 req-818cdd55-9854-43a6-bde0-6149e7e2a81c service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Updating instance_info_cache with network_info: [{"id": "30c6582f-7060-4694-99a3-1eff3a514631", "address": "fa:16:3e:0c:e3:80", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30c6582f-70", "ovs_interfaceid": "30c6582f-7060-4694-99a3-1eff3a514631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:58:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c8343c6d-e37f-414e-b28b-617785750867 req-818cdd55-9854-43a6-bde0-6149e7e2a81c service nova] Releasing lock "refresh_cache-26f5b55c-8ade-4f95-8756-7ab7319b1556" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:58:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "7c351954-c05f-4bd9-a8c9-3cfdfe1844be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:58:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "7c351954-c05f-4bd9-a8c9-3cfdfe1844be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:58:15 user nova-compute[72201]: DEBUG nova.compute.manager [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 15:58:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:58:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:58:15 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 15:58:15 user nova-compute[72201]: INFO nova.compute.claims [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Claim successful on node user
Aug 01 15:58:15 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:58:15 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:58:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.237s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:58:15 user nova-compute[72201]: DEBUG nova.compute.manager [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 15:58:15 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 15:58:15 user nova-compute[72201]: DEBUG nova.compute.manager [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 15:58:15 user nova-compute[72201]: DEBUG nova.network.neutron [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 15:58:15 user nova-compute[72201]: DEBUG nova.compute.manager [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 15:58:15 user nova-compute[72201]: INFO nova.virt.block_device [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Booting with volume snapshot 93d80224-77ce-402b-8283-f2bfd1ebb1fc at /dev/vda
Aug 01 15:58:15 user nova-compute[72201]: DEBUG nova.policy [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '222a94fd4bed425a8d80ba777c2361f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a49e4769bf348be8fedc8b70f65cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 15:58:16 user nova-compute[72201]: DEBUG nova.network.neutron [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Successfully created port: 68a7758d-b89a-4c88-8bf3-aa9399af43a4 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 15:58:17 user nova-compute[72201]: DEBUG nova.network.neutron [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Successfully updated port: 68a7758d-b89a-4c88-8bf3-aa9399af43a4 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 15:58:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "refresh_cache-7c351954-c05f-4bd9-a8c9-3cfdfe1844be" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:58:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquired lock "refresh_cache-7c351954-c05f-4bd9-a8c9-3cfdfe1844be" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:58:17 user nova-compute[72201]: DEBUG nova.network.neutron [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 15:58:17 user nova-compute[72201]: DEBUG nova.compute.manager [req-22054b57-0982-452c-9c64-784a27a1e1aa req-a5c9a2a6-93e0-45b5-a660-b1956b81b624 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Received event network-changed-68a7758d-b89a-4c88-8bf3-aa9399af43a4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:58:17 user nova-compute[72201]: DEBUG nova.compute.manager [req-22054b57-0982-452c-9c64-784a27a1e1aa req-a5c9a2a6-93e0-45b5-a660-b1956b81b624 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Refreshing instance network info cache due to event network-changed-68a7758d-b89a-4c88-8bf3-aa9399af43a4. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:58:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-22054b57-0982-452c-9c64-784a27a1e1aa req-a5c9a2a6-93e0-45b5-a660-b1956b81b624 service nova] Acquiring lock "refresh_cache-7c351954-c05f-4bd9-a8c9-3cfdfe1844be" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:58:17 user nova-compute[72201]: DEBUG nova.network.neutron [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 15:58:17 user nova-compute[72201]: DEBUG nova.network.neutron [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Updating instance_info_cache with network_info: [{"id": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "address": "fa:16:3e:62:85:24", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a7758d-b8", "ovs_interfaceid": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:58:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Releasing lock "refresh_cache-7c351954-c05f-4bd9-a8c9-3cfdfe1844be" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:58:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Instance network_info: |[{"id": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "address": "fa:16:3e:62:85:24", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a7758d-b8", "ovs_interfaceid": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 15:58:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-22054b57-0982-452c-9c64-784a27a1e1aa req-a5c9a2a6-93e0-45b5-a660-b1956b81b624 service nova] Acquired lock "refresh_cache-7c351954-c05f-4bd9-a8c9-3cfdfe1844be" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:58:17 user nova-compute[72201]: DEBUG nova.network.neutron [req-22054b57-0982-452c-9c64-784a27a1e1aa req-a5c9a2a6-93e0-45b5-a660-b1956b81b624 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Refreshing network info cache for port 68a7758d-b89a-4c88-8bf3-aa9399af43a4 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:58:17 user nova-compute[72201]: DEBUG nova.network.neutron [req-22054b57-0982-452c-9c64-784a27a1e1aa req-a5c9a2a6-93e0-45b5-a660-b1956b81b624 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Updated VIF entry in instance network info cache for port 68a7758d-b89a-4c88-8bf3-aa9399af43a4. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:58:17 user nova-compute[72201]: DEBUG nova.network.neutron [req-22054b57-0982-452c-9c64-784a27a1e1aa req-a5c9a2a6-93e0-45b5-a660-b1956b81b624 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Updating instance_info_cache with network_info: [{"id": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "address": "fa:16:3e:62:85:24", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a7758d-b8", "ovs_interfaceid": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:58:17 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-22054b57-0982-452c-9c64-784a27a1e1aa req-a5c9a2a6-93e0-45b5-a660-b1956b81b624 service nova] Releasing lock "refresh_cache-7c351954-c05f-4bd9-a8c9-3cfdfe1844be" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:58:19 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690905484.1081278, f0743332-223f-4507-b8b1-40d63b7b5e80 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:58:19 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] VM Stopped (Lifecycle Event)
Aug 01 15:58:19 user nova-compute[72201]: DEBUG nova.compute.manager [None req-b6319cb7-2079-4397-ac1b-4db22118c91e None None] [instance: f0743332-223f-4507-b8b1-40d63b7b5e80] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:58:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:21 user nova-compute[72201]: DEBUG os_brick.utils [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:58:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:58:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:58:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cf7d0e-5e2f-412c-b4f7-ec5cda0d5da1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:58:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:58:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:58:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a21f1a2-a3d8-4152-b3a3-eb67bb2b0ee7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:58:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:58:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:58:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebc63c3-d731-4e64-bb2e-5adff503216a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:58:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef17555-6244-4fee-9581-c33969481ccf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:58:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:58:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:58:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:58:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:58:21 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:58:21 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:58:21 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f450d2a-94d2-4b6b-8e90-cc645126301e]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:58:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:58:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:58:21 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:58:21 user nova-compute[72201]: DEBUG os_brick.utils [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:58:21 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Updating existing volume attachment record: 8f0699f2-7442-41a3-a21f-2d41f09cc13b {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:58:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:27 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.compute.manager [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 15:58:28 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Creating image(s)
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Did not create local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Ensure instance console log exists: /opt/stack/data/nova/instances/7c351954-c05f-4bd9-a8c9-3cfdfe1844be/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Start _get_guest_xml network_info=[{"id": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "address": "fa:16:3e:62:85:24", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a7758d-b8", "ovs_interfaceid": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-01T15:58:09Z,direct_url=<?>,disk_format='qcow2',id=ead1a8c1-dd97-43e4-a72d-4aeb83fceb19,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1384223227',owner='3a49e4769bf348be8fedc8b70f65cea2',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-01T15:58:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFHgpAOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c351954-c05f-4bd9-a8c9-3cfdfe1844be', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34', 'serial': 'b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '8f0699f2-7442-41a3-a21f-2d41f09cc13b', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 15:58:28 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:58:28 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-01T15:58:09Z,direct_url=<?>,disk_format='qcow2',id=ead1a8c1-dd97-43e4-a72d-4aeb83fceb19,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1384223227',owner='3a49e4769bf348be8fedc8b70f65cea2',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-01T15:58:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFHgpAOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:58:28 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:58:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:58:28 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 15:58:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 15:58:28 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1211639f-6bd0-4566-9bee-6a4380c1170a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 15:58:28 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5e5635-c74c-441b-9da1-f173a70d3ef1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34] added
Aug 01 15:58:28 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b20d0d-ab3b-4d43-b9cf-3d5810a8e225]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[172b4812-47c1-46aa-8c9f-9543dcd56f30]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JFHgpAOe {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JFHgpAOe" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7aaacb-8da1-4ff1-b73e-51fdcdb957a1]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JFHgpAOe'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[571a8c8f-34e7-4286-8bd4-aecc648878a4]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:58:28 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7106060-f219-45dc-8930-a4b3442b7554]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)
Aug 01 15:58:29 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)
Aug 01 15:58:29 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4740e807-fc57-4fd8-a6b6-3217a44b6bee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34, portal: 172.16.0.220,3260]
Aug 01 15:58:29 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34, portal: 172.16.0.220,3260] successful.
Aug 01 15:58:29 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abeb323-d629-4bb6-bcae-de78551a9e61]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ba3be9-8a2f-4d2f-9caa-234ac770a58c]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)
Aug 01 15:58:29 user nova-compute[72201]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 (non-flash)
Aug 01 15:58:29 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)
Aug 01 15:58:29 user nova-compute[72201]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 (non-flash)
Aug 01 15:58:29 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce81cb6-fb27-4872-b0c9-541aaec1a1b5]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFHgpAOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 15:58:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23134383462373737', 'path': '/dev/sdc'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134383462373737', 'path': '/dev/sdc'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1633399254',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1633399254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1633399254',id=48,image_ref='ead1a8c1-dd97-43e4-a72d-4aeb83fceb19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgSTD05UGU34TyRl1FdjRTNzGdxfloliwTyAHB6nchhlSLOmXiDXy5S0NLQqoiJ00ISn0PG5bpGaRDXgw2pIii/IssbdPiSTZp5wuaFhHo92/zjxY5rVdz+OJ1p4Iw00w==',key_name='tempest-keypair-373068770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a49e4769bf348be8fedc8b70f65cea2',ramdisk_id='',reservation_id='r-7sq99ik2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1110722165',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1110722165-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1110722165',owner_user_name='tempest-TestVolumeBootPattern-1110722165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:58:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='222a94fd4bed425a8d80ba777c2361f0',uuid=7c351954-c05f-4bd9-a8c9-3cfdfe1844be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "address": "fa:16:3e:62:85:24", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a7758d-b8", "ovs_interfaceid": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converting VIF {"id": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "address": "fa:16:3e:62:85:24", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a7758d-b8", "ovs_interfaceid": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:85:24,bridge_name='br-int',has_traffic_filtering=True,id=68a7758d-b89a-4c88-8bf3-aa9399af43a4,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a7758d-b8') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG nova.objects.instance [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c351954-c05f-4bd9-a8c9-3cfdfe1844be {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] End _get_guest_xml xml=<domain type="kvm">
Aug 01 15:58:30 user nova-compute[72201]:   <uuid>7c351954-c05f-4bd9-a8c9-3cfdfe1844be</uuid>
Aug 01 15:58:30 user nova-compute[72201]:   <name>instance-00000030</name>
Aug 01 15:58:30 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 15:58:30 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 15:58:30 user nova-compute[72201]:   <metadata>
Aug 01 15:58:30 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 15:58:30 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 15:58:30 user nova-compute[72201]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1633399254</nova:name>
Aug 01 15:58:30 user nova-compute[72201]:       <nova:creationTime>2023-08-01 15:58:28</nova:creationTime>
Aug 01 15:58:30 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 15:58:30 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 15:58:30 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 15:58:30 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 15:58:30 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 15:58:30 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 15:58:30 user nova-compute[72201]:       </nova:flavor>
Aug 01 15:58:30 user nova-compute[72201]:       <nova:owner>
Aug 01 15:58:30 user nova-compute[72201]:         <nova:user uuid="222a94fd4bed425a8d80ba777c2361f0">tempest-TestVolumeBootPattern-1110722165-project-member</nova:user>
Aug 01 15:58:30 user nova-compute[72201]:         <nova:project uuid="3a49e4769bf348be8fedc8b70f65cea2">tempest-TestVolumeBootPattern-1110722165</nova:project>
Aug 01 15:58:30 user nova-compute[72201]:       </nova:owner>
Aug 01 15:58:30 user nova-compute[72201]:       <nova:root type="image" uuid="ead1a8c1-dd97-43e4-a72d-4aeb83fceb19"/>
Aug 01 15:58:30 user nova-compute[72201]:       <nova:ports>
Aug 01 15:58:30 user nova-compute[72201]:         <nova:port uuid="68a7758d-b89a-4c88-8bf3-aa9399af43a4">
Aug 01 15:58:30 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 15:58:30 user nova-compute[72201]:         </nova:port>
Aug 01 15:58:30 user nova-compute[72201]:       </nova:ports>
Aug 01 15:58:30 user nova-compute[72201]:     </nova:instance>
Aug 01 15:58:30 user nova-compute[72201]:   </metadata>
Aug 01 15:58:30 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 15:58:30 user nova-compute[72201]:     <system>
Aug 01 15:58:30 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 15:58:30 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 15:58:30 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 15:58:30 user nova-compute[72201]:       <entry name="serial">7c351954-c05f-4bd9-a8c9-3cfdfe1844be</entry>
Aug 01 15:58:30 user nova-compute[72201]:       <entry name="uuid">7c351954-c05f-4bd9-a8c9-3cfdfe1844be</entry>
Aug 01 15:58:30 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 15:58:30 user nova-compute[72201]:     </system>
Aug 01 15:58:30 user nova-compute[72201]:   </sysinfo>
Aug 01 15:58:30 user nova-compute[72201]:   <os>
Aug 01 15:58:30 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 15:58:30 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 15:58:30 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 15:58:30 user nova-compute[72201]:   </os>
Aug 01 15:58:30 user nova-compute[72201]:   <features>
Aug 01 15:58:30 user nova-compute[72201]:     <acpi/>
Aug 01 15:58:30 user nova-compute[72201]:     <apic/>
Aug 01 15:58:30 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 15:58:30 user nova-compute[72201]:   </features>
Aug 01 15:58:30 user nova-compute[72201]:   <clock offset="utc">
Aug 01 15:58:30 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 15:58:30 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 15:58:30 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 15:58:30 user nova-compute[72201]:   </clock>
Aug 01 15:58:30 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 15:58:30 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 15:58:30 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 15:58:30 user nova-compute[72201]:   </cpu>
Aug 01 15:58:30 user nova-compute[72201]:   <devices>
Aug 01 15:58:30 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 15:58:30 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 15:58:30 user nova-compute[72201]:       <source dev="/dev/sdc"/>
Aug 01 15:58:30 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 15:58:30 user nova-compute[72201]:       <serial>b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34</serial>
Aug 01 15:58:30 user nova-compute[72201]:     </disk>
Aug 01 15:58:30 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 15:58:30 user nova-compute[72201]:       <mac address="fa:16:3e:62:85:24"/>
Aug 01 15:58:30 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:58:30 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 15:58:30 user nova-compute[72201]:       <target dev="tap68a7758d-b8"/>
Aug 01 15:58:30 user nova-compute[72201]:     </interface>
Aug 01 15:58:30 user nova-compute[72201]:     <serial type="pty">
Aug 01 15:58:30 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/7c351954-c05f-4bd9-a8c9-3cfdfe1844be/console.log" append="off"/>
Aug 01 15:58:30 user nova-compute[72201]:     </serial>
Aug 01 15:58:30 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 15:58:30 user nova-compute[72201]:     <video>
Aug 01 15:58:30 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 15:58:30 user nova-compute[72201]:     </video>
Aug 01 15:58:30 user nova-compute[72201]:     <rng model="virtio">
Aug 01 15:58:30 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 15:58:30 user nova-compute[72201]:     </rng>
Aug 01 15:58:30 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 15:58:30 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 15:58:30 user nova-compute[72201]:       <stats period="10"/>
Aug 01 15:58:30 user nova-compute[72201]:     </memballoon>
Aug 01 15:58:30 user nova-compute[72201]:   </devices>
Aug 01 15:58:30 user nova-compute[72201]: </domain>
Aug 01 15:58:30 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1633399254',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1633399254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1633399254',id=48,image_ref='ead1a8c1-dd97-43e4-a72d-4aeb83fceb19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgSTD05UGU34TyRl1FdjRTNzGdxfloliwTyAHB6nchhlSLOmXiDXy5S0NLQqoiJ00ISn0PG5bpGaRDXgw2pIii/IssbdPiSTZp5wuaFhHo92/zjxY5rVdz+OJ1p4Iw00w==',key_name='tempest-keypair-373068770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a49e4769bf348be8fedc8b70f65cea2',ramdisk_id='',reservation_id='r-7sq99ik2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1110722165',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1110722165-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1110722165',owner_user_name='tempest-TestVolumeBootPattern-1110722165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T15:58:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='222a94fd4bed425a8d80ba777c2361f0',uuid=7c351954-c05f-4bd9-a8c9-3cfdfe1844be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "address": "fa:16:3e:62:85:24", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a7758d-b8", "ovs_interfaceid": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converting VIF {"id": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "address": "fa:16:3e:62:85:24", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a7758d-b8", "ovs_interfaceid": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:85:24,bridge_name='br-int',has_traffic_filtering=True,id=68a7758d-b89a-4c88-8bf3-aa9399af43a4,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a7758d-b8') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG os_vif [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:85:24,bridge_name='br-int',has_traffic_filtering=True,id=68a7758d-b89a-4c88-8bf3-aa9399af43a4,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a7758d-b8') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68a7758d-b8, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68a7758d-b8, col_values=(('external_ids', {'iface-id': '68a7758d-b89a-4c88-8bf3-aa9399af43a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:85:24', 'vm-uuid': '7c351954-c05f-4bd9-a8c9-3cfdfe1844be'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:30 user nova-compute[72201]: INFO os_vif [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:85:24,bridge_name='br-int',has_traffic_filtering=True,id=68a7758d-b89a-4c88-8bf3-aa9399af43a4,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a7758d-b8')
Aug 01 15:58:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 15:58:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] No VIF found with MAC fa:16:3e:62:85:24, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 15:58:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-d07ff523-f5d3-4f72-90f3-21650f8fc428 req-865189d6-46e8-454a-9b5a-c9fcc4de6155 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Received event network-vif-plugged-68a7758d-b89a-4c88-8bf3-aa9399af43a4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:58:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d07ff523-f5d3-4f72-90f3-21650f8fc428 req-865189d6-46e8-454a-9b5a-c9fcc4de6155 service nova] Acquiring lock "7c351954-c05f-4bd9-a8c9-3cfdfe1844be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:58:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d07ff523-f5d3-4f72-90f3-21650f8fc428 req-865189d6-46e8-454a-9b5a-c9fcc4de6155 service nova] Lock "7c351954-c05f-4bd9-a8c9-3cfdfe1844be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:58:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d07ff523-f5d3-4f72-90f3-21650f8fc428 req-865189d6-46e8-454a-9b5a-c9fcc4de6155 service nova] Lock "7c351954-c05f-4bd9-a8c9-3cfdfe1844be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:58:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-d07ff523-f5d3-4f72-90f3-21650f8fc428 req-865189d6-46e8-454a-9b5a-c9fcc4de6155 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] No waiting events found dispatching network-vif-plugged-68a7758d-b89a-4c88-8bf3-aa9399af43a4 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:58:31 user nova-compute[72201]: WARNING nova.compute.manager [req-d07ff523-f5d3-4f72-90f3-21650f8fc428 req-865189d6-46e8-454a-9b5a-c9fcc4de6155 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Received unexpected event network-vif-plugged-68a7758d-b89a-4c88-8bf3-aa9399af43a4 for instance with vm_state building and task_state spawning.
Aug 01 15:58:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:32 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:58:32 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:58:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-26f5b55c-8ade-4f95-8756-7ab7319b1556" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:58:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-26f5b55c-8ade-4f95-8756-7ab7319b1556" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:58:32 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:58:32 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Updating instance_info_cache with network_info: [{"id": "30c6582f-7060-4694-99a3-1eff3a514631", "address": "fa:16:3e:0c:e3:80", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30c6582f-70", "ovs_interfaceid": "30c6582f-7060-4694-99a3-1eff3a514631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:58:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-26f5b55c-8ade-4f95-8756-7ab7319b1556" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:58:32 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:58:32 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690905513.6347034, 7c351954-c05f-4bd9-a8c9-3cfdfe1844be => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:58:33 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] VM Resumed (Lifecycle Event)
Aug 01 15:58:33 user nova-compute[72201]: DEBUG nova.compute.manager [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG nova.compute.manager [req-ccbee2ce-8ba8-4816-85fd-a8eb14334e5b req-d6014cc7-2a5b-4ec2-917e-eba18f4c927a service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Received event network-vif-plugged-68a7758d-b89a-4c88-8bf3-aa9399af43a4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ccbee2ce-8ba8-4816-85fd-a8eb14334e5b req-d6014cc7-2a5b-4ec2-917e-eba18f4c927a service nova] Acquiring lock "7c351954-c05f-4bd9-a8c9-3cfdfe1844be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ccbee2ce-8ba8-4816-85fd-a8eb14334e5b req-d6014cc7-2a5b-4ec2-917e-eba18f4c927a service nova] Lock "7c351954-c05f-4bd9-a8c9-3cfdfe1844be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ccbee2ce-8ba8-4816-85fd-a8eb14334e5b req-d6014cc7-2a5b-4ec2-917e-eba18f4c927a service nova] Lock "7c351954-c05f-4bd9-a8c9-3cfdfe1844be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG nova.compute.manager [req-ccbee2ce-8ba8-4816-85fd-a8eb14334e5b req-d6014cc7-2a5b-4ec2-917e-eba18f4c927a service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] No waiting events found dispatching network-vif-plugged-68a7758d-b89a-4c88-8bf3-aa9399af43a4 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 15:58:33 user nova-compute[72201]: WARNING nova.compute.manager [req-ccbee2ce-8ba8-4816-85fd-a8eb14334e5b req-d6014cc7-2a5b-4ec2-917e-eba18f4c927a service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Received unexpected event network-vif-plugged-68a7758d-b89a-4c88-8bf3-aa9399af43a4 for instance with vm_state building and task_state spawning.
Aug 01 15:58:33 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Instance spawned successfully.
Aug 01 15:58:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 15:58:33 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:58:33 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:58:33 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8460MB free_disk=25.20151138305664GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 15:58:33 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:58:34 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:58:34 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690905513.6358638, 7c351954-c05f-4bd9-a8c9-3cfdfe1844be => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 15:58:34 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] VM Started (Lifecycle Event)
Aug 01 15:58:34 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:58:34 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 15:58:34 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 26f5b55c-8ade-4f95-8756-7ab7319b1556 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:58:34 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:58:34 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 7c351954-c05f-4bd9-a8c9-3cfdfe1844be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:58:34 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:58:34 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:58:34 user nova-compute[72201]: INFO nova.compute.manager [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Took 5.28 seconds to spawn the instance on the hypervisor.
Aug 01 15:58:34 user nova-compute[72201]: DEBUG nova.compute.manager [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 15:58:34 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 15:58:34 user nova-compute[72201]: INFO nova.compute.manager [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Took 18.90 seconds to build instance.
Aug 01 15:58:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-bc88dbca-feb9-46fd-8892-cf941cfe26c4 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "7c351954-c05f-4bd9-a8c9-3cfdfe1844be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.026s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:58:34 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:58:34 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:58:34 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:58:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:58:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:36 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:58:36 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:58:37 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:58:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:41 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:58:42 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:58:42 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:58:45 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:58:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:58:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:58:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:58:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:58:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:58:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:59:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:59:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:59:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:59:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:59:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:59:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:59:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:59:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:59:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:59:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:59:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:59:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:59:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:59:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:59:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:59:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:59:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:59:29 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:59:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:59:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 15:59:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 15:59:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:59:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 15:59:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:59:34 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:59:34 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 15:59:34 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 15:59:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-26f5b55c-8ade-4f95-8756-7ab7319b1556" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:59:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-26f5b55c-8ade-4f95-8756-7ab7319b1556" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:59:34 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 15:59:34 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid 26f5b55c-8ade-4f95-8756-7ab7319b1556 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:59:34 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Updating instance_info_cache with network_info: [{"id": "30c6582f-7060-4694-99a3-1eff3a514631", "address": "fa:16:3e:0c:e3:80", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30c6582f-70", "ovs_interfaceid": "30c6582f-7060-4694-99a3-1eff3a514631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:59:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-26f5b55c-8ade-4f95-8756-7ab7319b1556" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:59:34 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 15:59:34 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:59:35 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:59:35 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:59:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:59:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:59:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:59:35 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 15:59:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:59:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:59:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:59:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:59:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:59:35 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:59:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 15:59:35 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:59:35 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 15:59:35 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8493MB free_disk=25.19124984741211GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 15:59:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:59:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:59:36 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 26f5b55c-8ade-4f95-8756-7ab7319b1556 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:59:36 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:59:36 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 7c351954-c05f-4bd9-a8c9-3cfdfe1844be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 15:59:36 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 15:59:36 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 15:59:36 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 15:59:36 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 15:59:36 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 15:59:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:59:38 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:59:38 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:59:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:59:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:59:41 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:59:44 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 15:59:44 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 15:59:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:59:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-f1a45576-d25d-47f1-bcdb-62b433ca9c1f req-c70c432a-3071-4738-9271-0a68210e2eb9 service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Received event network-changed-d73227e3-b63d-4772-939e-d51a5d0f944f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 15:59:50 user nova-compute[72201]: DEBUG nova.compute.manager [req-f1a45576-d25d-47f1-bcdb-62b433ca9c1f req-c70c432a-3071-4738-9271-0a68210e2eb9 service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Refreshing instance network info cache due to event network-changed-d73227e3-b63d-4772-939e-d51a5d0f944f. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 15:59:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f1a45576-d25d-47f1-bcdb-62b433ca9c1f req-c70c432a-3071-4738-9271-0a68210e2eb9 service nova] Acquiring lock "refresh_cache-a5a2d1de-1be6-4310-95c9-a0e360fcfba2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 15:59:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f1a45576-d25d-47f1-bcdb-62b433ca9c1f req-c70c432a-3071-4738-9271-0a68210e2eb9 service nova] Acquired lock "refresh_cache-a5a2d1de-1be6-4310-95c9-a0e360fcfba2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 15:59:50 user nova-compute[72201]: DEBUG nova.network.neutron [req-f1a45576-d25d-47f1-bcdb-62b433ca9c1f req-c70c432a-3071-4738-9271-0a68210e2eb9 service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Refreshing network info cache for port d73227e3-b63d-4772-939e-d51a5d0f944f {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 15:59:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:59:50 user nova-compute[72201]: DEBUG nova.network.neutron [req-f1a45576-d25d-47f1-bcdb-62b433ca9c1f req-c70c432a-3071-4738-9271-0a68210e2eb9 service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Updated VIF entry in instance network info cache for port d73227e3-b63d-4772-939e-d51a5d0f944f. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 15:59:50 user nova-compute[72201]: DEBUG nova.network.neutron [req-f1a45576-d25d-47f1-bcdb-62b433ca9c1f req-c70c432a-3071-4738-9271-0a68210e2eb9 service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Updating instance_info_cache with network_info: [{"id": "d73227e3-b63d-4772-939e-d51a5d0f944f", "address": "fa:16:3e:ae:26:84", "network": {"id": "e663c2b6-49c0-4ca9-af67-1b58650f9111", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443771328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17edafa90e946e5b9092443da878bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73227e3-b6", "ovs_interfaceid": "d73227e3-b63d-4772-939e-d51a5d0f944f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 15:59:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f1a45576-d25d-47f1-bcdb-62b433ca9c1f req-c70c432a-3071-4738-9271-0a68210e2eb9 service nova] Releasing lock "refresh_cache-a5a2d1de-1be6-4310-95c9-a0e360fcfba2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 15:59:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:59:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:59:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:59:54 user nova-compute[72201]: DEBUG nova.objects.instance [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lazy-loading 'flavor' on Instance uuid a5a2d1de-1be6-4310-95c9-a0e360fcfba2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 15:59:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 15:59:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 15:59:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 15:59:54 user nova-compute[72201]: INFO nova.compute.manager [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Attaching volume d7ff04a9-3fc0-429b-aad7-bea65c9aa242 to /dev/vdb
Aug 01 15:59:54 user nova-compute[72201]: DEBUG os_brick.utils [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 15:59:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:59:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:59:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed131b1f-c589-4bd6-aa1a-37bd53bb9ede]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:59:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:59:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:59:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad8064e-44c1-4585-8d4b-6911199c5c2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:59:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:59:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 15:59:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d139fa22-ec81-43f2-999b-55749997370a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:59:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0f6fb7-01f6-48dc-8260-036f61f80f95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:59:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:59:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:59:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 15:59:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 15:59:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 15:59:55 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 15:59:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d2ef12-edab-4ab0-a159-83df84c12c07]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 15:59:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 15:59:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 15:59:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 15:59:55 user nova-compute[72201]: DEBUG os_brick.utils [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 15:59:55 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Updating existing volume attachment record: 1f7c0431-2f68-49bb-b93b-78f2efc41bff {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 15:59:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 15:59:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:00:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdIKCMvg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:00:02 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:00:02 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:00:02 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a16ad6d-2185-4fba-ad4c-12f7db9f1c72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:00:02 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67ea1f4-55bb-43dd-abcd-4f03c55d3a0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242] added
Aug 01 16:00:02 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7a01b7-fcb8-4c4d-a06c-4a852de79017]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c105b50-9d3d-42c6-918f-84149b5741fe]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdIKCMvg {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdIKCMvg" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e897f2-bee5-461e-8acd-7762192d00f8]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fdIKCMvg'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35fc05c-424e-418b-b5f3-5fb28b9d273b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3cec76-a340-4d8a-a98c-64a41b350e00]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)
Aug 01 16:00:02 user nova-compute[72201]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 (non-flash)
Aug 01 16:00:02 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)
Aug 01 16:00:02 user nova-compute[72201]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 (non-flash)
Aug 01 16:00:02 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec0387c-d730-400d-b385-dd1d640152dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242, portal: 172.16.0.220,3260]
Aug 01 16:00:02 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242, portal: 172.16.0.220,3260] successful.
Aug 01 16:00:02 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6873bc-f3e6-46bd-97b0-c00287b3e417]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ddc86f-09a2-4e4c-a618-9fc639fafa6a]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)
Aug 01 16:00:02 user nova-compute[72201]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 (non-flash)
Aug 01 16:00:02 user nova-compute[72201]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 (non-flash)
Aug 01 16:00:02 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)
Aug 01 16:00:02 user nova-compute[72201]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 (non-flash)
Aug 01 16:00:02 user nova-compute[72201]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 (non-flash)
Aug 01 16:00:02 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8190ec1-9f69-430f-8070-1af60e01914e]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:00:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdIKCMvg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:00:03 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:00:03 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23065373535313636', 'path': '/dev/sdd'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:00:03 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065373535313636', 'path': '/dev/sdd'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:00:03 user nova-compute[72201]: DEBUG nova.objects.instance [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lazy-loading 'flavor' on Instance uuid a5a2d1de-1be6-4310-95c9-a0e360fcfba2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:00:03 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 16:00:03 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:00:03 user nova-compute[72201]:   <source dev="/dev/sdd"/>
Aug 01 16:00:03 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:00:03 user nova-compute[72201]:   <serial>d7ff04a9-3fc0-429b-aad7-bea65c9aa242</serial>
Aug 01 16:00:03 user nova-compute[72201]: </disk>
Aug 01 16:00:03 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 16:00:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:00:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:00:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] No VIF found with MAC fa:16:3e:ae:26:84, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:00:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-cf8d96bb-2acd-48a3-a75e-0c8f18b1bce1 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.494s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:00:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:00:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-275e9c31-ecca-4a0f-bd3b-283b56005b36 req-57d59a92-2e7f-4e91-a6f0-0ff103c9c717 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Received event network-changed-68a7758d-b89a-4c88-8bf3-aa9399af43a4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:00:06 user nova-compute[72201]: DEBUG nova.compute.manager [req-275e9c31-ecca-4a0f-bd3b-283b56005b36 req-57d59a92-2e7f-4e91-a6f0-0ff103c9c717 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Refreshing instance network info cache due to event network-changed-68a7758d-b89a-4c88-8bf3-aa9399af43a4. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:00:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-275e9c31-ecca-4a0f-bd3b-283b56005b36 req-57d59a92-2e7f-4e91-a6f0-0ff103c9c717 service nova] Acquiring lock "refresh_cache-7c351954-c05f-4bd9-a8c9-3cfdfe1844be" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:00:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-275e9c31-ecca-4a0f-bd3b-283b56005b36 req-57d59a92-2e7f-4e91-a6f0-0ff103c9c717 service nova] Acquired lock "refresh_cache-7c351954-c05f-4bd9-a8c9-3cfdfe1844be" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:00:06 user nova-compute[72201]: DEBUG nova.network.neutron [req-275e9c31-ecca-4a0f-bd3b-283b56005b36 req-57d59a92-2e7f-4e91-a6f0-0ff103c9c717 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Refreshing network info cache for port 68a7758d-b89a-4c88-8bf3-aa9399af43a4 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:00:06 user nova-compute[72201]: DEBUG nova.network.neutron [req-275e9c31-ecca-4a0f-bd3b-283b56005b36 req-57d59a92-2e7f-4e91-a6f0-0ff103c9c717 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Updated VIF entry in instance network info cache for port 68a7758d-b89a-4c88-8bf3-aa9399af43a4. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:00:06 user nova-compute[72201]: DEBUG nova.network.neutron [req-275e9c31-ecca-4a0f-bd3b-283b56005b36 req-57d59a92-2e7f-4e91-a6f0-0ff103c9c717 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Updating instance_info_cache with network_info: [{"id": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "address": "fa:16:3e:62:85:24", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a7758d-b8", "ovs_interfaceid": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:00:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-275e9c31-ecca-4a0f-bd3b-283b56005b36 req-57d59a92-2e7f-4e91-a6f0-0ff103c9c717 service nova] Releasing lock "refresh_cache-7c351954-c05f-4bd9-a8c9-3cfdfe1844be" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:00:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "7c351954-c05f-4bd9-a8c9-3cfdfe1844be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:00:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "7c351954-c05f-4bd9-a8c9-3cfdfe1844be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:00:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "7c351954-c05f-4bd9-a8c9-3cfdfe1844be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:00:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "7c351954-c05f-4bd9-a8c9-3cfdfe1844be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:00:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "7c351954-c05f-4bd9-a8c9-3cfdfe1844be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:00:07 user nova-compute[72201]: INFO nova.compute.manager [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Terminating instance
Aug 01 16:00:07 user nova-compute[72201]: DEBUG nova.compute.manager [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 16:00:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:00:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG nova.compute.manager [req-f29ea2d0-1958-4053-897b-9d54d4512504 req-37e71787-c4c9-4592-a01d-291abdba3457 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Received event network-vif-unplugged-68a7758d-b89a-4c88-8bf3-aa9399af43a4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f29ea2d0-1958-4053-897b-9d54d4512504 req-37e71787-c4c9-4592-a01d-291abdba3457 service nova] Acquiring lock "7c351954-c05f-4bd9-a8c9-3cfdfe1844be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f29ea2d0-1958-4053-897b-9d54d4512504 req-37e71787-c4c9-4592-a01d-291abdba3457 service nova] Lock "7c351954-c05f-4bd9-a8c9-3cfdfe1844be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f29ea2d0-1958-4053-897b-9d54d4512504 req-37e71787-c4c9-4592-a01d-291abdba3457 service nova] Lock "7c351954-c05f-4bd9-a8c9-3cfdfe1844be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG nova.compute.manager [req-f29ea2d0-1958-4053-897b-9d54d4512504 req-37e71787-c4c9-4592-a01d-291abdba3457 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] No waiting events found dispatching network-vif-unplugged-68a7758d-b89a-4c88-8bf3-aa9399af43a4 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG nova.compute.manager [req-f29ea2d0-1958-4053-897b-9d54d4512504 req-37e71787-c4c9-4592-a01d-291abdba3457 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Received event network-vif-unplugged-68a7758d-b89a-4c88-8bf3-aa9399af43a4 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:00:08 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Instance destroyed successfully.
Aug 01 16:00:08 user nova-compute[72201]: DEBUG nova.objects.instance [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lazy-loading 'resources' on Instance uuid 7c351954-c05f-4bd9-a8c9-3cfdfe1844be {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1633399254',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1633399254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1633399254',id=48,image_ref='ead1a8c1-dd97-43e4-a72d-4aeb83fceb19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgSTD05UGU34TyRl1FdjRTNzGdxfloliwTyAHB6nchhlSLOmXiDXy5S0NLQqoiJ00ISn0PG5bpGaRDXgw2pIii/IssbdPiSTZp5wuaFhHo92/zjxY5rVdz+OJ1p4Iw00w==',key_name='tempest-keypair-373068770',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:58:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a49e4769bf348be8fedc8b70f65cea2',ramdisk_id='',reservation_id='r-7sq99ik2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1110722165',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1110722165-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1110722165',owner_user_name='tempest-TestVolumeBootPattern-1110722165-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:58:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='222a94fd4bed425a8d80ba777c2361f0',uuid=7c351954-c05f-4bd9-a8c9-3cfdfe1844be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "address": "fa:16:3e:62:85:24", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a7758d-b8", "ovs_interfaceid": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converting VIF {"id": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "address": "fa:16:3e:62:85:24", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a7758d-b8", "ovs_interfaceid": "68a7758d-b89a-4c88-8bf3-aa9399af43a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:85:24,bridge_name='br-int',has_traffic_filtering=True,id=68a7758d-b89a-4c88-8bf3-aa9399af43a4,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a7758d-b8') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG os_vif [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:85:24,bridge_name='br-int',has_traffic_filtering=True,id=68a7758d-b89a-4c88-8bf3-aa9399af43a4,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a7758d-b8') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68a7758d-b8, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:00:08 user nova-compute[72201]: INFO os_vif [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:85:24,bridge_name='br-int',has_traffic_filtering=True,id=68a7758d-b89a-4c88-8bf3-aa9399af43a4,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a7758d-b8')
Aug 01 16:00:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFHgpAOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:00:08 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:00:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e43a266-0e12-4b40-a30b-f598f2734c1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[23adba0d-b326-48c3-83d9-0955ae0d24dc]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)
Aug 01 16:00:08 user nova-compute[72201]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 (non-flash)
Aug 01 16:00:08 user nova-compute[72201]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 (non-flash)
Aug 01 16:00:08 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)
Aug 01 16:00:08 user nova-compute[72201]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 (non-flash)
Aug 01 16:00:08 user nova-compute[72201]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 (non-flash)
Aug 01 16:00:08 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc52c654dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34'): ({'sdc'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Removing single pathed devices sdc {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d1cbe7-2c6d-4903-84ee-054842f5509d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[583c991d-a35f-447b-96d1-60b28f9b592e]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Flushing IO for device /dev/sdc {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb148ce-cad6-443d-b46e-eb8be5cf25b7]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1cc014-0957-4b2a-a16c-08449708d719]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_c729edd4', '/dev/disk/by-id/scsi-23134383462373737', '/dev/disk/by-id/scsi-1SCST_BIOc729edd4-1484b7776c695fc5') {{(pid=83290) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dee3d7-b129-4cde-a7d9-ced3a432411a]: (4, None) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2044f5-aa85-444a-8c24-4018e2db6204]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[03475c89-3576-4375-bcac-b1d3f6a5608a]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34, portal: 172.16.0.220,3260]
Aug 01 16:00:08 user nova-compute[72201]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34, portal: 172.16.0.220,3260] successful.
Aug 01 16:00:08 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a98cf0-eb72-4676-854d-a40fb5891e1a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] <== disconnect_volume: return (288ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:00:08 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Deleting instance files /opt/stack/data/nova/instances/7c351954-c05f-4bd9-a8c9-3cfdfe1844be_del
Aug 01 16:00:08 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Deletion of /opt/stack/data/nova/instances/7c351954-c05f-4bd9-a8c9-3cfdfe1844be_del complete
Aug 01 16:00:08 user nova-compute[72201]: INFO nova.compute.manager [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 01 16:00:08 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 16:00:08 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 16:00:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:00:09 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:00:09 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Took 1.04 seconds to deallocate network for instance.
Aug 01 16:00:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-27420a4b-1af0-4754-bf4b-d3ac3e9d8ebb req-b25a0707-a2de-422b-9ecf-d2ce2ad60b28 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Received event network-vif-deleted-68a7758d-b89a-4c88-8bf3-aa9399af43a4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:00:09 user nova-compute[72201]: INFO nova.compute.manager [req-27420a4b-1af0-4754-bf4b-d3ac3e9d8ebb req-b25a0707-a2de-422b-9ecf-d2ce2ad60b28 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Neutron deleted interface 68a7758d-b89a-4c88-8bf3-aa9399af43a4; detaching it from the instance and deleting it from the info cache
Aug 01 16:00:09 user nova-compute[72201]: DEBUG nova.network.neutron [req-27420a4b-1af0-4754-bf4b-d3ac3e9d8ebb req-b25a0707-a2de-422b-9ecf-d2ce2ad60b28 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:00:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-27420a4b-1af0-4754-bf4b-d3ac3e9d8ebb req-b25a0707-a2de-422b-9ecf-d2ce2ad60b28 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Detach interface failed, port_id=68a7758d-b89a-4c88-8bf3-aa9399af43a4, reason: Instance 7c351954-c05f-4bd9-a8c9-3cfdfe1844be could not be found. {{(pid=72201) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 16:00:10 user nova-compute[72201]: DEBUG nova.compute.manager [req-10791c52-a75c-4b37-bb60-05f6974c3a91 req-948ccebc-8a60-40e6-9b37-d75a1f21b590 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Received event network-vif-plugged-68a7758d-b89a-4c88-8bf3-aa9399af43a4 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:00:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-10791c52-a75c-4b37-bb60-05f6974c3a91 req-948ccebc-8a60-40e6-9b37-d75a1f21b590 service nova] Acquiring lock "7c351954-c05f-4bd9-a8c9-3cfdfe1844be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:00:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-10791c52-a75c-4b37-bb60-05f6974c3a91 req-948ccebc-8a60-40e6-9b37-d75a1f21b590 service nova] Lock "7c351954-c05f-4bd9-a8c9-3cfdfe1844be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:00:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-10791c52-a75c-4b37-bb60-05f6974c3a91 req-948ccebc-8a60-40e6-9b37-d75a1f21b590 service nova] Lock "7c351954-c05f-4bd9-a8c9-3cfdfe1844be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:00:10 user nova-compute[72201]: DEBUG nova.compute.manager [req-10791c52-a75c-4b37-bb60-05f6974c3a91 req-948ccebc-8a60-40e6-9b37-d75a1f21b590 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] No waiting events found dispatching network-vif-plugged-68a7758d-b89a-4c88-8bf3-aa9399af43a4 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:00:10 user nova-compute[72201]: WARNING nova.compute.manager [req-10791c52-a75c-4b37-bb60-05f6974c3a91 req-948ccebc-8a60-40e6-9b37-d75a1f21b590 service nova] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Received unexpected event network-vif-plugged-68a7758d-b89a-4c88-8bf3-aa9399af43a4 for instance with vm_state active and task_state deleting.
Aug 01 16:00:10 user nova-compute[72201]: INFO nova.compute.manager [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Took 0.72 seconds to detach 1 volumes for instance.
Aug 01 16:00:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Deleting volume: b0a8d2a4-f3f4-4dbb-9226-30f66b2a4c34 {{(pid=72201) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 16:00:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:00:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:00:10 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:00:10 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:00:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:00:10 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Deleted allocations for instance 7c351954-c05f-4bd9-a8c9-3cfdfe1844be
Aug 01 16:00:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-667e310f-7c74-4ad9-9a5a-2f5c1090e237 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "7c351954-c05f-4bd9-a8c9-3cfdfe1844be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.302s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:00:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:00:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:00:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:00:23 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690905608.4464633, 7c351954-c05f-4bd9-a8c9-3cfdfe1844be => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:00:23 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] VM Stopped (Lifecycle Event)
Aug 01 16:00:23 user nova-compute[72201]: DEBUG nova.compute.manager [None req-73e96dfb-df3e-4081-ae8a-c8dcd8d07275 None None] [instance: 7c351954-c05f-4bd9-a8c9-3cfdfe1844be] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:00:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:00:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:00:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:00:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:00:24 user nova-compute[72201]: INFO nova.compute.manager [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Detaching volume d7ff04a9-3fc0-429b-aad7-bea65c9aa242
Aug 01 16:00:24 user nova-compute[72201]: INFO nova.virt.block_device [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Attempting to driver detach volume d7ff04a9-3fc0-429b-aad7-bea65c9aa242 from mountpoint /dev/vdb
Aug 01 16:00:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Attempting to detach device vdb from instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 16:00:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:00:24 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:00:24 user nova-compute[72201]:   <source dev="/dev/sdd"/>
Aug 01 16:00:24 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:00:24 user nova-compute[72201]:   <serial>d7ff04a9-3fc0-429b-aad7-bea65c9aa242</serial>
Aug 01 16:00:24 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:00:24 user nova-compute[72201]: </disk>
Aug 01 16:00:24 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:00:24 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Successfully detached device vdb from instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 from the persistent domain config.
Aug 01 16:00:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 16:00:24 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:00:24 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:00:24 user nova-compute[72201]:   <source dev="/dev/sdd"/>
Aug 01 16:00:24 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:00:24 user nova-compute[72201]:   <serial>d7ff04a9-3fc0-429b-aad7-bea65c9aa242</serial>
Aug 01 16:00:24 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:00:24 user nova-compute[72201]: </disk>
Aug 01 16:00:24 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690905625.4102464, a5a2d1de-1be6-4310-95c9-a0e360fcfba2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 16:00:25 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Successfully detached device vdb from instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 from the live domain config.
Aug 01 16:00:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdIKCMvg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:00:25 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:00:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91b99f6-1fd8-4702-a422-8e852a134fd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e70fddf-2492-437e-acc3-593c66591fa6]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)
Aug 01 16:00:25 user nova-compute[72201]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 (non-flash)
Aug 01 16:00:25 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)
Aug 01 16:00:25 user nova-compute[72201]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 (non-flash)
Aug 01 16:00:25 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc549da7d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242'): ({'sdd'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Removing single pathed devices sdd {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec2c214-a790-4406-8585-1cb92bb0b4e5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c3b05d-ebcb-48f2-aa72-e1dd69a00eb9]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Flushing IO for device /dev/sdd {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b0cc48-2cf7-4123-936d-e7c60eddffc5]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[009f811a-63d9-4759-84eb-a09005c4c062]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] SCSI volumes sdd have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[576e8500-db2e-45ee-b78c-bccb031a409c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1aee9c-1996-4d86-a220-76fd93a2a285]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242, portal: 172.16.0.220,3260]
Aug 01 16:00:25 user nova-compute[72201]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242, portal: 172.16.0.220,3260] successful.
Aug 01 16:00:25 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ff04a9-3fc0-429b-aad7-bea65c9aa242 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[297e7936-f6a2-4ac2-abb6-ce402b99fdf9]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] <== disconnect_volume: return (277ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:00:25 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:00:26 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lazy-loading 'flavor' on Instance uuid a5a2d1de-1be6-4310-95c9-a0e360fcfba2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:00:26 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ed273533-086d-4f1f-b81f-634bf3b05b69 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.597s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:00:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:00:30 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:00:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:00:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:00:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:00:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:00:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:00:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:00:35 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:00:35 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:00:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-a5a2d1de-1be6-4310-95c9-a0e360fcfba2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:00:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-a5a2d1de-1be6-4310-95c9-a0e360fcfba2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:00:35 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:00:35 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Updating instance_info_cache with network_info: [{"id": "d73227e3-b63d-4772-939e-d51a5d0f944f", "address": "fa:16:3e:ae:26:84", "network": {"id": "e663c2b6-49c0-4ca9-af67-1b58650f9111", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443771328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17edafa90e946e5b9092443da878bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73227e3-b6", "ovs_interfaceid": "d73227e3-b63d-4772-939e-d51a5d0f944f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:00:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-a5a2d1de-1be6-4310-95c9-a0e360fcfba2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:00:35 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:00:35 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:00:36 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:00:36 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:00:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:00:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:00:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:00:36 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:00:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:00:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:00:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:00:37 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:00:37 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:00:37 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8591MB free_disk=25.18865966796875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:00:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:00:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:00:37 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 26f5b55c-8ade-4f95-8756-7ab7319b1556 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:00:37 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:00:37 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:00:37 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:00:37 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:00:37 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:00:37 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:00:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:00:38 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:00:38 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:00:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:00:43 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:00:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:00:45 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:00:45 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:00:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:00:50 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:00:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:00:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:00:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:00:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:00:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:00:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:00:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:01:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "26f5b55c-8ade-4f95-8756-7ab7319b1556" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:01:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "26f5b55c-8ade-4f95-8756-7ab7319b1556" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:01:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "26f5b55c-8ade-4f95-8756-7ab7319b1556-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:01:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "26f5b55c-8ade-4f95-8756-7ab7319b1556-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:01:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "26f5b55c-8ade-4f95-8756-7ab7319b1556-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:01:01 user nova-compute[72201]: INFO nova.compute.manager [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Terminating instance
Aug 01 16:01:01 user nova-compute[72201]: DEBUG nova.compute.manager [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 16:01:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:01:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:01:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:01:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:01:01 user nova-compute[72201]: DEBUG nova.compute.manager [req-2d1429e1-51e1-4ff6-a59f-7ff849ea0b1b req-4a2f1309-9200-4a9a-9a09-2003b07aeb3d service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Received event network-vif-unplugged-30c6582f-7060-4694-99a3-1eff3a514631 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:01:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2d1429e1-51e1-4ff6-a59f-7ff849ea0b1b req-4a2f1309-9200-4a9a-9a09-2003b07aeb3d service nova] Acquiring lock "26f5b55c-8ade-4f95-8756-7ab7319b1556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:01:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2d1429e1-51e1-4ff6-a59f-7ff849ea0b1b req-4a2f1309-9200-4a9a-9a09-2003b07aeb3d service nova] Lock "26f5b55c-8ade-4f95-8756-7ab7319b1556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:01:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-2d1429e1-51e1-4ff6-a59f-7ff849ea0b1b req-4a2f1309-9200-4a9a-9a09-2003b07aeb3d service nova] Lock "26f5b55c-8ade-4f95-8756-7ab7319b1556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:01:01 user nova-compute[72201]: DEBUG nova.compute.manager [req-2d1429e1-51e1-4ff6-a59f-7ff849ea0b1b req-4a2f1309-9200-4a9a-9a09-2003b07aeb3d service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] No waiting events found dispatching network-vif-unplugged-30c6582f-7060-4694-99a3-1eff3a514631 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:01:01 user nova-compute[72201]: DEBUG nova.compute.manager [req-2d1429e1-51e1-4ff6-a59f-7ff849ea0b1b req-4a2f1309-9200-4a9a-9a09-2003b07aeb3d service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Received event network-vif-unplugged-30c6582f-7060-4694-99a3-1eff3a514631 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:01:02 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Instance destroyed successfully.
Aug 01 16:01:02 user nova-compute[72201]: DEBUG nova.objects.instance [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lazy-loading 'resources' on Instance uuid 26f5b55c-8ade-4f95-8756-7ab7319b1556 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:56:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1442669474',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1442669474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1442669474',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5EnuOcORFo96jw5/MK7ttlJ7vEf4302OMI5gbRgxh0lYEWIClYym9S7w7Pij6zkiKPj/zZvqtIVFGscSN1r1aaFh177hoJ37Ncu72z/V8lPD95lJUBkyshWXkTveD98A==',key_name='tempest-keypair-1157667379',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:56:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a49e4769bf348be8fedc8b70f65cea2',ramdisk_id='',reservation_id='r-j6h0u70q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1110722165',owner_user_name='tempest-TestVolumeBootPattern-1110722165-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:56:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='222a94fd4bed425a8d80ba777c2361f0',uuid=26f5b55c-8ade-4f95-8756-7ab7319b1556,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30c6582f-7060-4694-99a3-1eff3a514631", "address": "fa:16:3e:0c:e3:80", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30c6582f-70", "ovs_interfaceid": "30c6582f-7060-4694-99a3-1eff3a514631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converting VIF {"id": "30c6582f-7060-4694-99a3-1eff3a514631", "address": "fa:16:3e:0c:e3:80", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30c6582f-70", "ovs_interfaceid": "30c6582f-7060-4694-99a3-1eff3a514631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:e3:80,bridge_name='br-int',has_traffic_filtering=True,id=30c6582f-7060-4694-99a3-1eff3a514631,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30c6582f-70') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG os_vif [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:e3:80,bridge_name='br-int',has_traffic_filtering=True,id=30c6582f-7060-4694-99a3-1eff3a514631,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30c6582f-70') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30c6582f-70, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:01:02 user nova-compute[72201]: INFO os_vif [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:e3:80,bridge_name='br-int',has_traffic_filtering=True,id=30c6582f-7060-4694-99a3-1eff3a514631,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30c6582f-70')
Aug 01 16:01:02 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrwkQsuT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:01:02 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:01:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[477f438d-ae1c-4a59-b72c-e19c3a3e6935]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f000358f-a110-4ed4-bedd-50b6b6cdcbdc]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)
Aug 01 16:01:02 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f (non-flash)
Aug 01 16:01:02 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc52c657250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f'): ({'sdb'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Removing single pathed devices sdb {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d56ea35-6c99-413c-97de-ee53eda9036a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa7ec4b-078d-402f-8ed3-90b9f6484c04]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Flushing IO for device /dev/sdb {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2822cab0-7b79-42e1-b7c9-db04d431d73b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.069s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e442380-df2e-4213-a4ee-0379dc22e86c]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a6dc28-617e-4978-876a-afd40ada7e91]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71c28b9-3c8e-4aa3-9faf-57d7bdf0f4eb]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f, portal: 172.16.0.220,3260]
Aug 01 16:01:02 user nova-compute[72201]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f, portal: 172.16.0.220,3260] successful.
Aug 01 16:01:02 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2572a4c8-01fa-4997-88f8-91d90f79843f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22eb119-10fd-4b16-b074-dce7775c995b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] <== disconnect_volume: return (330ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:01:02 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Deleting instance files /opt/stack/data/nova/instances/26f5b55c-8ade-4f95-8756-7ab7319b1556_del
Aug 01 16:01:02 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Deletion of /opt/stack/data/nova/instances/26f5b55c-8ade-4f95-8756-7ab7319b1556_del complete
Aug 01 16:01:02 user nova-compute[72201]: INFO nova.compute.manager [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 01 16:01:02 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 16:01:02 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 16:01:03 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:01:03 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Took 0.92 seconds to deallocate network for instance.
Aug 01 16:01:03 user nova-compute[72201]: DEBUG nova.compute.manager [req-09822b02-41d4-47ed-ad0a-5e556a286fbb req-b4b2740c-dffc-4dfb-a1ac-a1185bab6b17 service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Received event network-vif-deleted-30c6582f-7060-4694-99a3-1eff3a514631 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:01:03 user nova-compute[72201]: INFO nova.compute.manager [req-09822b02-41d4-47ed-ad0a-5e556a286fbb req-b4b2740c-dffc-4dfb-a1ac-a1185bab6b17 service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Neutron deleted interface 30c6582f-7060-4694-99a3-1eff3a514631; detaching it from the instance and deleting it from the info cache
Aug 01 16:01:03 user nova-compute[72201]: DEBUG nova.network.neutron [req-09822b02-41d4-47ed-ad0a-5e556a286fbb req-b4b2740c-dffc-4dfb-a1ac-a1185bab6b17 service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:01:03 user nova-compute[72201]: DEBUG nova.compute.manager [req-09822b02-41d4-47ed-ad0a-5e556a286fbb req-b4b2740c-dffc-4dfb-a1ac-a1185bab6b17 service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Detach interface failed, port_id=30c6582f-7060-4694-99a3-1eff3a514631, reason: Instance 26f5b55c-8ade-4f95-8756-7ab7319b1556 could not be found. {{(pid=72201) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 16:01:03 user nova-compute[72201]: DEBUG nova.compute.manager [req-ae7a627c-73a0-4043-a814-6f645ef7f078 req-01ca0135-abf6-4214-bc9b-aada81c0918b service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Received event network-vif-plugged-30c6582f-7060-4694-99a3-1eff3a514631 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:01:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ae7a627c-73a0-4043-a814-6f645ef7f078 req-01ca0135-abf6-4214-bc9b-aada81c0918b service nova] Acquiring lock "26f5b55c-8ade-4f95-8756-7ab7319b1556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:01:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ae7a627c-73a0-4043-a814-6f645ef7f078 req-01ca0135-abf6-4214-bc9b-aada81c0918b service nova] Lock "26f5b55c-8ade-4f95-8756-7ab7319b1556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:01:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-ae7a627c-73a0-4043-a814-6f645ef7f078 req-01ca0135-abf6-4214-bc9b-aada81c0918b service nova] Lock "26f5b55c-8ade-4f95-8756-7ab7319b1556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:01:03 user nova-compute[72201]: DEBUG nova.compute.manager [req-ae7a627c-73a0-4043-a814-6f645ef7f078 req-01ca0135-abf6-4214-bc9b-aada81c0918b service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] No waiting events found dispatching network-vif-plugged-30c6582f-7060-4694-99a3-1eff3a514631 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:01:03 user nova-compute[72201]: WARNING nova.compute.manager [req-ae7a627c-73a0-4043-a814-6f645ef7f078 req-01ca0135-abf6-4214-bc9b-aada81c0918b service nova] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Received unexpected event network-vif-plugged-30c6582f-7060-4694-99a3-1eff3a514631 for instance with vm_state active and task_state deleting.
Aug 01 16:01:04 user nova-compute[72201]: INFO nova.compute.manager [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Took 0.76 seconds to detach 1 volumes for instance.
Aug 01 16:01:04 user nova-compute[72201]: DEBUG nova.compute.manager [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Deleting volume: 2572a4c8-01fa-4997-88f8-91d90f79843f {{(pid=72201) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 16:01:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:01:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:01:04 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:01:04 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:01:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:01:04 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Deleted allocations for instance 26f5b55c-8ade-4f95-8756-7ab7319b1556
Aug 01 16:01:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-731c4730-ef31-420e-a60d-38eb6b0ea93d tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "26f5b55c-8ade-4f95-8756-7ab7319b1556" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.282s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:01:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:01:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:01:17 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690905662.0554945, 26f5b55c-8ade-4f95-8756-7ab7319b1556 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:01:17 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] VM Stopped (Lifecycle Event)
Aug 01 16:01:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-9bab2af9-db26-46c0-bf72-11e2f64043c6 None None] [instance: 26f5b55c-8ade-4f95-8756-7ab7319b1556] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:01:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:01:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:01:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:01:18 user nova-compute[72201]: DEBUG nova.objects.instance [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lazy-loading 'flavor' on Instance uuid a5a2d1de-1be6-4310-95c9-a0e360fcfba2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:01:18 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:01:19 user nova-compute[72201]: INFO nova.compute.manager [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Attaching volume 0642db25-df93-4fa9-b7bc-7c1d81784c02 to /dev/vdb
Aug 01 16:01:19 user nova-compute[72201]: DEBUG os_brick.utils [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06f86da-0059-430f-bb76-5b4ddec68a7f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[94400418-6c84-44f2-98e7-ce9e55089672]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4184fbc7-dae6-491b-90d7-7685faf14539]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e343962e-8ba9-4e61-b15d-9f5f1f98a5e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:01:19 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:01:19 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c67c648-d3a0-46f0-afd7-d70b0af483d0]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG os_brick.utils [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Updating existing volume attachment record: aa3e2545-fa86-42e5-a610-8d07c68bec34 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:01:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:01:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cZeDqyYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:01:26 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:01:26 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:01:26 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f326eda0-b269-43f6-b1c1-f43bb8c35abd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:01:26 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a99b70a-3e45-4ca8-a4df-819c2e47320f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02] added
Aug 01 16:01:26 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0f68b0-80dc-45dd-83c1-3ea0f6319679]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a862765-6b9d-4964-a27d-a362baae667b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cZeDqyYS {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cZeDqyYS" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[654295cc-ac88-422d-bd7c-338f31f9041a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cZeDqyYS'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80dd59f-1ee1-40e2-a497-f79b2034c649]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0b0d8e-3aef-4b35-ad6c-9c26c15004fa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 16:01:26 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 16:01:26 user nova-compute[72201]:  {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:01:26 user nova-compute[72201]: WARNING os_brick.initiator.connectors.iscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 16:01:26 user nova-compute[72201]: 
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd394b9d-c7d5-42c2-91ac-bb4b5dc87554]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02, portal: 172.16.0.220,3260]
Aug 01 16:01:26 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02, portal: 172.16.0.220,3260] successful.
Aug 01 16:01:26 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f490d170-ed6e-4d2a-a252-90f48dd1aabb]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e13bf0e-1b24-49fa-a5e6-fbfaccc76a49]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 (non-flash)
Aug 01 16:01:26 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 (non-flash)
Aug 01 16:01:26 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[85844795-9c1a-45cf-a268-278d5032509b]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:01:26 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cZeDqyYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:01:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:01:27 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:01:27 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23664393766636531', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:01:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664393766636531', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:01:27 user nova-compute[72201]: DEBUG nova.objects.instance [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lazy-loading 'flavor' on Instance uuid a5a2d1de-1be6-4310-95c9-a0e360fcfba2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:01:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 16:01:27 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:01:27 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 16:01:27 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:01:27 user nova-compute[72201]:   <serial>0642db25-df93-4fa9-b7bc-7c1d81784c02</serial>
Aug 01 16:01:27 user nova-compute[72201]: </disk>
Aug 01 16:01:27 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 16:01:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:01:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:01:27 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] No VIF found with MAC fa:16:3e:ae:26:84, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:01:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-97ff3038-2f92-4710-9714-9a47b67b0e54 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.924s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:01:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:01:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:01:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:01:30 user nova-compute[72201]: INFO nova.compute.manager [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Detaching volume 0642db25-df93-4fa9-b7bc-7c1d81784c02
Aug 01 16:01:30 user nova-compute[72201]: INFO nova.virt.block_device [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Attempting to driver detach volume 0642db25-df93-4fa9-b7bc-7c1d81784c02 from mountpoint /dev/vdb
Aug 01 16:01:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Attempting to detach device vdb from instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 16:01:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:01:30 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:01:30 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 16:01:30 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:01:30 user nova-compute[72201]:   <serial>0642db25-df93-4fa9-b7bc-7c1d81784c02</serial>
Aug 01 16:01:30 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:01:30 user nova-compute[72201]: </disk>
Aug 01 16:01:30 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:01:30 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Successfully detached device vdb from instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 from the persistent domain config.
Aug 01 16:01:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 16:01:30 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:01:30 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:01:30 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 16:01:30 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:01:30 user nova-compute[72201]:   <serial>0642db25-df93-4fa9-b7bc-7c1d81784c02</serial>
Aug 01 16:01:30 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:01:30 user nova-compute[72201]: </disk>
Aug 01 16:01:30 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690905691.0203907, a5a2d1de-1be6-4310-95c9-a0e360fcfba2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 16:01:31 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Successfully detached device vdb from instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 from the live domain config.
Aug 01 16:01:31 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cZeDqyYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:01:31 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:01:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33ed55f-e416-46f6-9396-4462edd9b2bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4274125e-b87f-4093-bde7-209f65534d93]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 (non-flash)
Aug 01 16:01:31 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 (non-flash)
Aug 01 16:01:31 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc549d51360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02'): ({'sdb'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Removing single pathed devices sdb {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72201) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33f916c-325b-4a10-8ec0-131ac156c1db]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbffae2-6dea-47b7-af81-5536f4125288]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Flushing IO for device /dev/sdb {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[68704993-7cbf-4e8e-bc50-1aad88e5d819]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec928fe-51a1-4b69-8f20-56f9c737cac8]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8e77f7-50e0-4bea-93f4-cc7246e8b72f]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9104c8-821c-4069-8dea-8e31778c044e]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02, portal: 172.16.0.220,3260]
Aug 01 16:01:31 user nova-compute[72201]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02, portal: 172.16.0.220,3260] successful.
Aug 01 16:01:31 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0642db25-df93-4fa9-b7bc-7c1d81784c02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[894282fe-706b-42c4-8c93-94e1e3df4b95]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] <== disconnect_volume: return (274ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:01:31 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:01:32 user nova-compute[72201]: DEBUG nova.objects.instance [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lazy-loading 'flavor' on Instance uuid a5a2d1de-1be6-4310-95c9-a0e360fcfba2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:01:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-55d891c8-ec10-4020-ab80-126b8683898c tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.590s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:01:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:01:32 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:01:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:01:35 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:01:36 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:01:36 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:01:36 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Didn't find any instances for network info cache update. {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 16:01:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:01:37 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:01:38 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:01:38 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:01:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:01:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:01:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:01:38 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:01:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:01:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:01:38 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:01:38 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:01:38 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8677MB free_disk=25.187374114990234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:01:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:01:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:01:39 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:01:39 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:01:39 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:01:39 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing inventories for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 16:01:39 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating ProviderTree inventory for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 16:01:39 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating inventory in ProviderTree for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 16:01:39 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing aggregate associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, aggregates: None {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 16:01:39 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing trait associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 16:01:39 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:01:39 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:01:39 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:01:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.459s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:01:41 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:01:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:01:42 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:01:45 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:01:46 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:01:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:01:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:01:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:01:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:01:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:02:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "25a23aef-6c09-47be-be76-6a3aae90e327" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:02:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "25a23aef-6c09-47be-be76-6a3aae90e327" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:02:03 user nova-compute[72201]: INFO nova.compute.claims [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Claim successful on node user
Aug 01 16:02:03 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] There are 0 instances to clean {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.208s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG nova.network.neutron [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:02:03 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:02:03 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:02:03 user nova-compute[72201]: INFO nova.virt.block_device [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Booting with volume 2b1f1cbf-6178-45b0-a9c7-19d163daba2f at /dev/vda
Aug 01 16:02:03 user nova-compute[72201]: DEBUG nova.policy [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '222a94fd4bed425a8d80ba777c2361f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a49e4769bf348be8fedc8b70f65cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG os_brick.utils [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4865bf-8a9c-4be0-a336-476b0a26a212]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9bcc19-036c-4f64-836f-fb99d6765589]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[11230eaf-b21f-4093-a021-a4fbd8792471]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d9924e-f06d-4dc6-be65-cf5357a0d688]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:02:03 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:02:03 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[373cc5b6-9b15-4d28-b406-c95d38e268b3]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG os_brick.utils [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:02:03 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Updating existing volume attachment record: 7e49a7e6-aa87-4dcb-a8f4-d86db4c38706 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:02:04 user nova-compute[72201]: DEBUG nova.network.neutron [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Successfully created port: 0794181e-04f5-4dd2-bc16-55f263612c1f {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:02:05 user nova-compute[72201]: DEBUG nova.network.neutron [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Successfully updated port: 0794181e-04f5-4dd2-bc16-55f263612c1f {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:02:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "refresh_cache-25a23aef-6c09-47be-be76-6a3aae90e327" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:02:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquired lock "refresh_cache-25a23aef-6c09-47be-be76-6a3aae90e327" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:02:05 user nova-compute[72201]: DEBUG nova.network.neutron [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:02:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-68980cd5-4643-4665-8661-fd7b0b34ee8c req-f279c1c8-6769-4c43-833f-7c168a175ef4 service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Received event network-changed-0794181e-04f5-4dd2-bc16-55f263612c1f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:02:05 user nova-compute[72201]: DEBUG nova.compute.manager [req-68980cd5-4643-4665-8661-fd7b0b34ee8c req-f279c1c8-6769-4c43-833f-7c168a175ef4 service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Refreshing instance network info cache due to event network-changed-0794181e-04f5-4dd2-bc16-55f263612c1f. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:02:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-68980cd5-4643-4665-8661-fd7b0b34ee8c req-f279c1c8-6769-4c43-833f-7c168a175ef4 service nova] Acquiring lock "refresh_cache-25a23aef-6c09-47be-be76-6a3aae90e327" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:02:05 user nova-compute[72201]: DEBUG nova.network.neutron [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:02:05 user nova-compute[72201]: DEBUG nova.network.neutron [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Updating instance_info_cache with network_info: [{"id": "0794181e-04f5-4dd2-bc16-55f263612c1f", "address": "fa:16:3e:4c:3c:b4", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0794181e-04", "ovs_interfaceid": "0794181e-04f5-4dd2-bc16-55f263612c1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:02:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Releasing lock "refresh_cache-25a23aef-6c09-47be-be76-6a3aae90e327" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:02:05 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Instance network_info: |[{"id": "0794181e-04f5-4dd2-bc16-55f263612c1f", "address": "fa:16:3e:4c:3c:b4", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0794181e-04", "ovs_interfaceid": "0794181e-04f5-4dd2-bc16-55f263612c1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:02:05 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-68980cd5-4643-4665-8661-fd7b0b34ee8c req-f279c1c8-6769-4c43-833f-7c168a175ef4 service nova] Acquired lock "refresh_cache-25a23aef-6c09-47be-be76-6a3aae90e327" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:02:05 user nova-compute[72201]: DEBUG nova.network.neutron [req-68980cd5-4643-4665-8661-fd7b0b34ee8c req-f279c1c8-6769-4c43-833f-7c168a175ef4 service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Refreshing network info cache for port 0794181e-04f5-4dd2-bc16-55f263612c1f {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:02:06 user nova-compute[72201]: DEBUG nova.network.neutron [req-68980cd5-4643-4665-8661-fd7b0b34ee8c req-f279c1c8-6769-4c43-833f-7c168a175ef4 service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Updated VIF entry in instance network info cache for port 0794181e-04f5-4dd2-bc16-55f263612c1f. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:02:06 user nova-compute[72201]: DEBUG nova.network.neutron [req-68980cd5-4643-4665-8661-fd7b0b34ee8c req-f279c1c8-6769-4c43-833f-7c168a175ef4 service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Updating instance_info_cache with network_info: [{"id": "0794181e-04f5-4dd2-bc16-55f263612c1f", "address": "fa:16:3e:4c:3c:b4", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0794181e-04", "ovs_interfaceid": "0794181e-04f5-4dd2-bc16-55f263612c1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:02:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-68980cd5-4643-4665-8661-fd7b0b34ee8c req-f279c1c8-6769-4c43-833f-7c168a175ef4 service nova] Releasing lock "refresh_cache-25a23aef-6c09-47be-be76-6a3aae90e327" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:02:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:02:10 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Creating image(s)
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Did not create local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Ensure instance console log exists: /opt/stack/data/nova/instances/25a23aef-6c09-47be-be76-6a3aae90e327/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Start _get_guest_xml network_info=[{"id": "0794181e-04f5-4dd2-bc16-55f263612c1f", "address": "fa:16:3e:4c:3c:b4", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0794181e-04", "ovs_interfaceid": "0794181e-04f5-4dd2-bc16-55f263612c1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWGzqwcv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '25a23aef-6c09-47be-be76-6a3aae90e327', 'attached_at': '', 'detached_at': '', 'volume_id': '2b1f1cbf-6178-45b0-a9c7-19d163daba2f', 'serial': '2b1f1cbf-6178-45b0-a9c7-19d163daba2f'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '7e49a7e6-aa87-4dcb-a8f4-d86db4c38706', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:02:10 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:02:10 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWGzqwcv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:02:10 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:02:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:02:10 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:02:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:02:10 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:02:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ec4c16-ea6e-4a6a-9f4b-68444c1a64fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:02:10 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d06f374-14f2-49ac-81f1-b5df97e1d9ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f] added
Aug 01 16:02:10 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a308810d-6fa0-4d80-97f8-cfa0bae79d6d]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:02:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc11d5e0-bcad-44fc-8b63-d0b56b000451]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWGzqwcv {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWGzqwcv" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd36741b-5108-4e66-8256-b95c5ba535cf]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rWGzqwcv'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c830ec6e-b8e5-483d-97a7-caed9a800baa]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77ef49d-ac73-42cd-bad9-7383cb0e9694]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 16:02:11 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 16:02:11 user nova-compute[72201]:  {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:02:11 user nova-compute[72201]: WARNING os_brick.initiator.connectors.iscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 16:02:11 user nova-compute[72201]: 
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --login" returned: 0 in 0.041s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8bf7bd-af27-4aa1-94aa-c344b7df42bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f, portal: 172.16.0.220,3260]
Aug 01 16:02:11 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f, portal: 172.16.0.220,3260] successful.
Aug 01 16:02:11 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79cb900-1d15-4153-9359-61aaf909c59d]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e9fdb0-842c-4315-b866-3e08f4b0861a]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:02:11 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:02:11 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.231s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c32821e-1bde-4436-898e-1a8aa1a87b0a]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:02:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWGzqwcv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.263s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] <== connect_volume: return (1265ms) {'type': 'block', 'scsi_wwn': '23465653063653937', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465653063653937', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:02:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-189530672',display_name='tempest-TestVolumeBootPattern-server-189530672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-189530672',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRfjK9mfMZECkiNZS+WvmmHxqcLD3Bp/k3VJTkM9GOR5ve6M3pZuKsANEYec+jLTwfqzqMZWoeJ6cNgc2ItQC8bULCPj1V4+xbFRpB7985q2k/9hGKp8rI4LhVLHyjBRw==',key_name='tempest-TestVolumeBootPattern-1356630349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a49e4769bf348be8fedc8b70f65cea2',ramdisk_id='',reservation_id='r-9dbs1rdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1110722165',owner_user_name='tempest-TestVolumeBootPattern-1110722165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:02:03Z,user_data=None,user_id='222a94fd4bed425a8d80ba777c2361f0',uuid=25a23aef-6c09-47be-be76-6a3aae90e327,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0794181e-04f5-4dd2-bc16-55f263612c1f", "address": "fa:16:3e:4c:3c:b4", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0794181e-04", "ovs_interfaceid": "0794181e-04f5-4dd2-bc16-55f263612c1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converting VIF {"id": "0794181e-04f5-4dd2-bc16-55f263612c1f", "address": "fa:16:3e:4c:3c:b4", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0794181e-04", "ovs_interfaceid": "0794181e-04f5-4dd2-bc16-55f263612c1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:3c:b4,bridge_name='br-int',has_traffic_filtering=True,id=0794181e-04f5-4dd2-bc16-55f263612c1f,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0794181e-04') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG nova.objects.instance [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lazy-loading 'pci_devices' on Instance uuid 25a23aef-6c09-47be-be76-6a3aae90e327 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:02:12 user nova-compute[72201]:   <uuid>25a23aef-6c09-47be-be76-6a3aae90e327</uuid>
Aug 01 16:02:12 user nova-compute[72201]:   <name>instance-00000031</name>
Aug 01 16:02:12 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 16:02:12 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 16:02:12 user nova-compute[72201]:   <metadata>
Aug 01 16:02:12 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:02:12 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 16:02:12 user nova-compute[72201]:       <nova:name>tempest-TestVolumeBootPattern-server-189530672</nova:name>
Aug 01 16:02:12 user nova-compute[72201]:       <nova:creationTime>2023-08-01 16:02:10</nova:creationTime>
Aug 01 16:02:12 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 16:02:12 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 16:02:12 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 16:02:12 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 16:02:12 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:02:12 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:02:12 user nova-compute[72201]:       </nova:flavor>
Aug 01 16:02:12 user nova-compute[72201]:       <nova:owner>
Aug 01 16:02:12 user nova-compute[72201]:         <nova:user uuid="222a94fd4bed425a8d80ba777c2361f0">tempest-TestVolumeBootPattern-1110722165-project-member</nova:user>
Aug 01 16:02:12 user nova-compute[72201]:         <nova:project uuid="3a49e4769bf348be8fedc8b70f65cea2">tempest-TestVolumeBootPattern-1110722165</nova:project>
Aug 01 16:02:12 user nova-compute[72201]:       </nova:owner>
Aug 01 16:02:12 user nova-compute[72201]:       <nova:ports>
Aug 01 16:02:12 user nova-compute[72201]:         <nova:port uuid="0794181e-04f5-4dd2-bc16-55f263612c1f">
Aug 01 16:02:12 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 16:02:12 user nova-compute[72201]:         </nova:port>
Aug 01 16:02:12 user nova-compute[72201]:       </nova:ports>
Aug 01 16:02:12 user nova-compute[72201]:     </nova:instance>
Aug 01 16:02:12 user nova-compute[72201]:   </metadata>
Aug 01 16:02:12 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 16:02:12 user nova-compute[72201]:     <system>
Aug 01 16:02:12 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:02:12 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:02:12 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 16:02:12 user nova-compute[72201]:       <entry name="serial">25a23aef-6c09-47be-be76-6a3aae90e327</entry>
Aug 01 16:02:12 user nova-compute[72201]:       <entry name="uuid">25a23aef-6c09-47be-be76-6a3aae90e327</entry>
Aug 01 16:02:12 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:02:12 user nova-compute[72201]:     </system>
Aug 01 16:02:12 user nova-compute[72201]:   </sysinfo>
Aug 01 16:02:12 user nova-compute[72201]:   <os>
Aug 01 16:02:12 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:02:12 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 16:02:12 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 16:02:12 user nova-compute[72201]:   </os>
Aug 01 16:02:12 user nova-compute[72201]:   <features>
Aug 01 16:02:12 user nova-compute[72201]:     <acpi/>
Aug 01 16:02:12 user nova-compute[72201]:     <apic/>
Aug 01 16:02:12 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 16:02:12 user nova-compute[72201]:   </features>
Aug 01 16:02:12 user nova-compute[72201]:   <clock offset="utc">
Aug 01 16:02:12 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:02:12 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:02:12 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 16:02:12 user nova-compute[72201]:   </clock>
Aug 01 16:02:12 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 16:02:12 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 16:02:12 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:02:12 user nova-compute[72201]:   </cpu>
Aug 01 16:02:12 user nova-compute[72201]:   <devices>
Aug 01 16:02:12 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 16:02:12 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:02:12 user nova-compute[72201]:       <source dev="/dev/sdb"/>
Aug 01 16:02:12 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 16:02:12 user nova-compute[72201]:       <serial>2b1f1cbf-6178-45b0-a9c7-19d163daba2f</serial>
Aug 01 16:02:12 user nova-compute[72201]:     </disk>
Aug 01 16:02:12 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 16:02:12 user nova-compute[72201]:       <mac address="fa:16:3e:4c:3c:b4"/>
Aug 01 16:02:12 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 16:02:12 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 16:02:12 user nova-compute[72201]:       <target dev="tap0794181e-04"/>
Aug 01 16:02:12 user nova-compute[72201]:     </interface>
Aug 01 16:02:12 user nova-compute[72201]:     <serial type="pty">
Aug 01 16:02:12 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/25a23aef-6c09-47be-be76-6a3aae90e327/console.log" append="off"/>
Aug 01 16:02:12 user nova-compute[72201]:     </serial>
Aug 01 16:02:12 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:02:12 user nova-compute[72201]:     <video>
Aug 01 16:02:12 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 16:02:12 user nova-compute[72201]:     </video>
Aug 01 16:02:12 user nova-compute[72201]:     <rng model="virtio">
Aug 01 16:02:12 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:02:12 user nova-compute[72201]:     </rng>
Aug 01 16:02:12 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:02:12 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 16:02:12 user nova-compute[72201]:       <stats period="10"/>
Aug 01 16:02:12 user nova-compute[72201]:     </memballoon>
Aug 01 16:02:12 user nova-compute[72201]:   </devices>
Aug 01 16:02:12 user nova-compute[72201]: </domain>
Aug 01 16:02:12 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:02:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-189530672',display_name='tempest-TestVolumeBootPattern-server-189530672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-189530672',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRfjK9mfMZECkiNZS+WvmmHxqcLD3Bp/k3VJTkM9GOR5ve6M3pZuKsANEYec+jLTwfqzqMZWoeJ6cNgc2ItQC8bULCPj1V4+xbFRpB7985q2k/9hGKp8rI4LhVLHyjBRw==',key_name='tempest-TestVolumeBootPattern-1356630349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a49e4769bf348be8fedc8b70f65cea2',ramdisk_id='',reservation_id='r-9dbs1rdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1110722165',owner_user_name='tempest-TestVolumeBootPattern-1110722165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:02:03Z,user_data=None,user_id='222a94fd4bed425a8d80ba777c2361f0',uuid=25a23aef-6c09-47be-be76-6a3aae90e327,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0794181e-04f5-4dd2-bc16-55f263612c1f", "address": "fa:16:3e:4c:3c:b4", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0794181e-04", "ovs_interfaceid": "0794181e-04f5-4dd2-bc16-55f263612c1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converting VIF {"id": "0794181e-04f5-4dd2-bc16-55f263612c1f", "address": "fa:16:3e:4c:3c:b4", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0794181e-04", "ovs_interfaceid": "0794181e-04f5-4dd2-bc16-55f263612c1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:3c:b4,bridge_name='br-int',has_traffic_filtering=True,id=0794181e-04f5-4dd2-bc16-55f263612c1f,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0794181e-04') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG os_vif [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:3c:b4,bridge_name='br-int',has_traffic_filtering=True,id=0794181e-04f5-4dd2-bc16-55f263612c1f,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0794181e-04') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0794181e-04, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0794181e-04, col_values=(('external_ids', {'iface-id': '0794181e-04f5-4dd2-bc16-55f263612c1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:3c:b4', 'vm-uuid': '25a23aef-6c09-47be-be76-6a3aae90e327'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:12 user nova-compute[72201]: INFO os_vif [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:3c:b4,bridge_name='br-int',has_traffic_filtering=True,id=0794181e-04f5-4dd2-bc16-55f263612c1f,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0794181e-04')
Aug 01 16:02:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:02:12 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] No VIF found with MAC fa:16:3e:4c:3c:b4, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:02:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:13 user nova-compute[72201]: DEBUG nova.compute.manager [req-364a1a49-ead7-48ef-9725-a296dc46baa8 req-ac86dc1b-13da-4f64-8d41-f6734282ea9d service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Received event network-vif-plugged-0794181e-04f5-4dd2-bc16-55f263612c1f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:02:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-364a1a49-ead7-48ef-9725-a296dc46baa8 req-ac86dc1b-13da-4f64-8d41-f6734282ea9d service nova] Acquiring lock "25a23aef-6c09-47be-be76-6a3aae90e327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:02:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-364a1a49-ead7-48ef-9725-a296dc46baa8 req-ac86dc1b-13da-4f64-8d41-f6734282ea9d service nova] Lock "25a23aef-6c09-47be-be76-6a3aae90e327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:02:13 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-364a1a49-ead7-48ef-9725-a296dc46baa8 req-ac86dc1b-13da-4f64-8d41-f6734282ea9d service nova] Lock "25a23aef-6c09-47be-be76-6a3aae90e327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:02:13 user nova-compute[72201]: DEBUG nova.compute.manager [req-364a1a49-ead7-48ef-9725-a296dc46baa8 req-ac86dc1b-13da-4f64-8d41-f6734282ea9d service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] No waiting events found dispatching network-vif-plugged-0794181e-04f5-4dd2-bc16-55f263612c1f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:02:13 user nova-compute[72201]: WARNING nova.compute.manager [req-364a1a49-ead7-48ef-9725-a296dc46baa8 req-ac86dc1b-13da-4f64-8d41-f6734282ea9d service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Received unexpected event network-vif-plugged-0794181e-04f5-4dd2-bc16-55f263612c1f for instance with vm_state building and task_state spawning.
Aug 01 16:02:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:15 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690905735.6794288, 25a23aef-6c09-47be-be76-6a3aae90e327 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:02:15 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] VM Resumed (Lifecycle Event)
Aug 01 16:02:15 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:02:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:02:15 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Instance spawned successfully.
Aug 01 16:02:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:02:15 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:02:15 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:02:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:02:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:02:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:02:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:02:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:02:15 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:02:15 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:02:15 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690905735.6829948, 25a23aef-6c09-47be-be76-6a3aae90e327 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:02:15 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] VM Started (Lifecycle Event)
Aug 01 16:02:15 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:02:15 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:02:15 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:02:15 user nova-compute[72201]: DEBUG nova.compute.manager [req-505a9bc3-2f40-4639-a01b-d3c20867ddf0 req-496f3dde-fd1c-4296-ae27-f606bad35585 service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Received event network-vif-plugged-0794181e-04f5-4dd2-bc16-55f263612c1f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:02:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-505a9bc3-2f40-4639-a01b-d3c20867ddf0 req-496f3dde-fd1c-4296-ae27-f606bad35585 service nova] Acquiring lock "25a23aef-6c09-47be-be76-6a3aae90e327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:02:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-505a9bc3-2f40-4639-a01b-d3c20867ddf0 req-496f3dde-fd1c-4296-ae27-f606bad35585 service nova] Lock "25a23aef-6c09-47be-be76-6a3aae90e327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:02:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-505a9bc3-2f40-4639-a01b-d3c20867ddf0 req-496f3dde-fd1c-4296-ae27-f606bad35585 service nova] Lock "25a23aef-6c09-47be-be76-6a3aae90e327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:02:15 user nova-compute[72201]: DEBUG nova.compute.manager [req-505a9bc3-2f40-4639-a01b-d3c20867ddf0 req-496f3dde-fd1c-4296-ae27-f606bad35585 service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] No waiting events found dispatching network-vif-plugged-0794181e-04f5-4dd2-bc16-55f263612c1f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:02:15 user nova-compute[72201]: WARNING nova.compute.manager [req-505a9bc3-2f40-4639-a01b-d3c20867ddf0 req-496f3dde-fd1c-4296-ae27-f606bad35585 service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Received unexpected event network-vif-plugged-0794181e-04f5-4dd2-bc16-55f263612c1f for instance with vm_state building and task_state spawning.
Aug 01 16:02:15 user nova-compute[72201]: INFO nova.compute.manager [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Took 4.95 seconds to spawn the instance on the hypervisor.
Aug 01 16:02:15 user nova-compute[72201]: DEBUG nova.compute.manager [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:02:15 user nova-compute[72201]: INFO nova.compute.manager [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Took 12.77 seconds to build instance.
Aug 01 16:02:15 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-0f36edc5-44dd-4c1c-958f-a3bda85a9ec0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "25a23aef-6c09-47be-be76-6a3aae90e327" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.907s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:02:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:02:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:02:24 user nova-compute[72201]: DEBUG nova.objects.instance [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lazy-loading 'flavor' on Instance uuid a5a2d1de-1be6-4310-95c9-a0e360fcfba2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:02:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:02:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:02:24 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:02:24 user nova-compute[72201]: INFO nova.compute.manager [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Attaching volume 915a93ee-9af9-4b43-8103-32171ba36b1c to /dev/vdb
Aug 01 16:02:24 user nova-compute[72201]: DEBUG os_brick.utils [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:02:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:24 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ed9688-402d-4a2b-8722-351bfbd32a01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:24 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55e8089-9410-434e-89f4-58ea453a5f6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:24 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fae5d73-d144-434d-8387-890c5ae12ea5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:24 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[502fb8d9-105b-46d8-8903-adfa713ea1c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:02:24 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:02:24 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:25 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:02:25 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:02:25 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3992202b-59be-49b9-9bb4-7f5e77530b2f]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:02:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:02:25 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:02:25 user nova-compute[72201]: DEBUG os_brick.utils [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:02:25 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Updating existing volume attachment record: f315640e-aa75-4236-8758-8e061cc8fe28 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:02:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEcrOCZU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:02:32 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:02:32 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:02:32 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9c7f45-3ece-49c0-8556-44880019b88e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:02:32 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5660d268-631e-401f-bcef-18a38f2792ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c] added
Aug 01 16:02:32 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3273c6-7761-4e89-8a10-8a110e7189ee]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdf7352-f9bb-4a6e-9744-fc6599849b6a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sEcrOCZU {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sEcrOCZU" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d719f39-a163-4a9c-9fbc-8abf584ea725]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sEcrOCZU'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7821e56c-d1bc-4c28-afa8-a0f3c6927c0c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6e2cb7-88b4-423a-8179-f6a349720246]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:02:32 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:02:32 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed9caa0-fad0-4bb8-ba96-a5d4088254bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c, portal: 172.16.0.220,3260]
Aug 01 16:02:32 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c, portal: 172.16.0.220,3260] successful.
Aug 01 16:02:32 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7946ec9b-ce79-4347-bcdb-c3e87482e470]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[da775846-c07c-40b4-b5da-0d34844ebda0]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:02:32 user nova-compute[72201]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c (non-flash)
Aug 01 16:02:32 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:02:32 user nova-compute[72201]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c (non-flash)
Aug 01 16:02:32 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c64e900-42f2-4a64-ad4b-b14ac2b71fac]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:32 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: None {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:02:33 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:02:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEcrOCZU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:02:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:02:33 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26532343932653364', 'path': '/dev/sdc'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:02:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532343932653364', 'path': '/dev/sdc'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:02:33 user nova-compute[72201]: DEBUG nova.objects.instance [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lazy-loading 'flavor' on Instance uuid a5a2d1de-1be6-4310-95c9-a0e360fcfba2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:02:33 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 16:02:33 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:02:33 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 16:02:33 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:02:33 user nova-compute[72201]:   <serial>915a93ee-9af9-4b43-8103-32171ba36b1c</serial>
Aug 01 16:02:33 user nova-compute[72201]: </disk>
Aug 01 16:02:33 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 16:02:34 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:02:34 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:02:34 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] No VIF found with MAC fa:16:3e:ae:26:84, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:02:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-9574ee58-4028-4da9-b757-a33938f6d203 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.547s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:02:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:02:36 user nova-compute[72201]: INFO nova.compute.manager [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Detaching volume 915a93ee-9af9-4b43-8103-32171ba36b1c
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 16:02:36 user nova-compute[72201]: INFO nova.virt.block_device [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Attempting to driver detach volume 915a93ee-9af9-4b43-8103-32171ba36b1c from mountpoint /dev/vdb
Aug 01 16:02:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Attempting to detach device vdb from instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:02:36 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:02:36 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 16:02:36 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:02:36 user nova-compute[72201]:   <serial>915a93ee-9af9-4b43-8103-32171ba36b1c</serial>
Aug 01 16:02:36 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:02:36 user nova-compute[72201]: </disk>
Aug 01 16:02:36 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:02:36 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Successfully detached device vdb from instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 from the persistent domain config.
Aug 01 16:02:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:02:36 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:02:36 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 16:02:36 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:02:36 user nova-compute[72201]:   <serial>915a93ee-9af9-4b43-8103-32171ba36b1c</serial>
Aug 01 16:02:36 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:02:36 user nova-compute[72201]: </disk>
Aug 01 16:02:36 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-a5a2d1de-1be6-4310-95c9-a0e360fcfba2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-a5a2d1de-1be6-4310-95c9-a0e360fcfba2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid a5a2d1de-1be6-4310-95c9-a0e360fcfba2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690905756.6066718, a5a2d1de-1be6-4310-95c9-a0e360fcfba2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 16:02:36 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Successfully detached device vdb from instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 from the live domain config.
Aug 01 16:02:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEcrOCZU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:02:36 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:02:36 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af81136-53c4-4c14-b089-a7792a87541a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aef911b-72a7-405b-a508-4d20203f7ca8]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:02:36 user nova-compute[72201]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c (non-flash)
Aug 01 16:02:36 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:02:36 user nova-compute[72201]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c (non-flash)
Aug 01 16:02:36 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc52c6be9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c'): ({'sdc'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Removing single pathed devices sdc {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Updating instance_info_cache with network_info: [{"id": "d73227e3-b63d-4772-939e-d51a5d0f944f", "address": "fa:16:3e:ae:26:84", "network": {"id": "e663c2b6-49c0-4ca9-af67-1b58650f9111", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443771328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17edafa90e946e5b9092443da878bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73227e3-b6", "ovs_interfaceid": "d73227e3-b63d-4772-939e-d51a5d0f944f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a01279-42a4-44cf-b00f-763775c4fa3d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-a5a2d1de-1be6-4310-95c9-a0e360fcfba2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c6eea7-5e65-47f1-afe1-fabf1da6d580]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Flushing IO for device /dev/sdc {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e54e0a-c415-4357-82a2-6c3bbf50ec55]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad2d8b0-9a84-4c6b-8263-708e16c6be1b]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe8f7d4-763b-4a5a-b5db-6a5a11b3574b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4c3d1e-bd95-4346-9555-89216ae2db40]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c, portal: 172.16.0.220,3260]
Aug 01 16:02:36 user nova-compute[72201]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c, portal: 172.16.0.220,3260] successful.
Aug 01 16:02:36 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915a93ee-9af9-4b43-8103-32171ba36b1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbd9101-63bc-4d53-8723-6e1184c7e0f4]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] <== disconnect_volume: return (278ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:02:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:02:37 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:02:37 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:02:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:37 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lazy-loading 'flavor' on Instance uuid a5a2d1de-1be6-4310-95c9-a0e360fcfba2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:02:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f404ea70-b0fa-4801-ad50-9d52e71a4437 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.555s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:02:38 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:02:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:02:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:02:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:02:38 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:02:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:02:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:02:38 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:02:38 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:02:38 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:02:38 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8480MB free_disk=25.18465805053711GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:02:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:02:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:02:38 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:02:38 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 25a23aef-6c09-47be-be76-6a3aae90e327 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:02:38 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:02:38 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:02:39 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:02:39 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:02:39 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:02:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:02:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:40 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:02:42 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:02:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:46 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:02:46 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:02:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:02:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:52 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:02:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:02:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:02:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:02:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:02:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:02:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:02:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:02:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:02:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:02:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:02:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:03:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:03:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:03:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:03:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:03:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:03:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:03:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:03:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:03:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:03:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:03:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:03:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:03:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:03:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:03:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:03:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:03:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:03:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:03:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:03:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:03:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG nova.objects.instance [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lazy-loading 'flavor' on Instance uuid a5a2d1de-1be6-4310-95c9-a0e360fcfba2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:03:30 user nova-compute[72201]: INFO nova.compute.manager [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Attaching volume d8c2b65d-718f-491f-ae0e-4e371d03d722 to /dev/vdb
Aug 01 16:03:30 user nova-compute[72201]: DEBUG os_brick.utils [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[33143b0a-46a7-47bb-89cb-32b8c0660e35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8097ae-c71d-4214-9672-ad3078f9201c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[336dca40-4c67-4cfd-ad59-a4f811382e3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[439a16e7-0087-4b04-8e00-f30497defc78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:03:30 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:03:30 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[659e9630-7aad-4f31-be26-0ac9c2d4ea50]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG os_brick.utils [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:03:30 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Updating existing volume attachment record: 5b917d47-200a-4e13-bfaa-5052a0d3dcea {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:03:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:03:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:03:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:03:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:03:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:33 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:03:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-25a23aef-6c09-47be-be76-6a3aae90e327" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-25a23aef-6c09-47be-be76-6a3aae90e327" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Updating instance_info_cache with network_info: [{"id": "0794181e-04f5-4dd2-bc16-55f263612c1f", "address": "fa:16:3e:4c:3c:b4", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0794181e-04", "ovs_interfaceid": "0794181e-04f5-4dd2-bc16-55f263612c1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-25a23aef-6c09-47be-be76-6a3aae90e327" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDgRAYBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:03:37 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:03:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:03:37 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:03:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:03:37 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:03:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[92904286-63af-4b60-a5d1-966af8c988b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:03:37 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9c0471-48cc-44d2-8525-c2d50692b15b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722] added
Aug 01 16:03:37 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5917a1-5944-4968-99e2-b159d2231f94]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb8a542-b61b-4adc-91a2-8141c5b35e6d]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lDgRAYBd {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lDgRAYBd" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a5bee3-0f0d-49e3-b256-4671023332d8]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lDgRAYBd'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:03:37 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3555ffed-4f82-4a30-8e51-5be7bf7a2e83]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c215daa-6b4b-4692-ad93-6d96824d9241]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:03:38 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:03:38 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[da361855-87d0-4847-b7c4-785c1ee367d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722, portal: 172.16.0.220,3260]
Aug 01 16:03:38 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722, portal: 172.16.0.220,3260] successful.
Aug 01 16:03:38 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2fa40a-954a-4390-8098-ef193e787b42]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[da80bf41-be0d-4e2c-9da1-7dd08d2aae39]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:03:38 user nova-compute[72201]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 (non-flash)
Aug 01 16:03:38 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:03:38 user nova-compute[72201]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 (non-flash)
Aug 01 16:03:38 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b44b91b-5dcb-41af-b9d9-c35f4ddc01ae]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:03:38 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDgRAYBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:03:39 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:03:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:03:39 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23434383630336136', 'path': '/dev/sdc'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:03:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434383630336136', 'path': '/dev/sdc'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:03:39 user nova-compute[72201]: DEBUG nova.objects.instance [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lazy-loading 'flavor' on Instance uuid a5a2d1de-1be6-4310-95c9-a0e360fcfba2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:03:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 16:03:39 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:03:39 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 16:03:39 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:03:39 user nova-compute[72201]:   <serial>d8c2b65d-718f-491f-ae0e-4e371d03d722</serial>
Aug 01 16:03:39 user nova-compute[72201]: </disk>
Aug 01 16:03:39 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 16:03:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:03:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:03:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] No VIF found with MAC fa:16:3e:ae:26:84, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:03:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-e87cf800-e231-484a-b1fb-6a828dcbc866 tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.161s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:03:40 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:03:40 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:03:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:03:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:03:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:03:40 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:03:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:03:40 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:03:40 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:03:40 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:03:40 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8575MB free_disk=25.183746337890625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:03:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:03:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:03:41 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:03:41 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance 25a23aef-6c09-47be-be76-6a3aae90e327 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:03:41 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:03:41 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:03:41 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:03:41 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:03:41 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:03:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:03:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:03:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:03:41 user nova-compute[72201]: INFO nova.compute.manager [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Detaching volume d8c2b65d-718f-491f-ae0e-4e371d03d722
Aug 01 16:03:41 user nova-compute[72201]: INFO nova.virt.block_device [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Attempting to driver detach volume d8c2b65d-718f-491f-ae0e-4e371d03d722 from mountpoint /dev/vdb
Aug 01 16:03:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Attempting to detach device vdb from instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 16:03:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:03:41 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:03:41 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 16:03:41 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:03:41 user nova-compute[72201]:   <serial>d8c2b65d-718f-491f-ae0e-4e371d03d722</serial>
Aug 01 16:03:41 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:03:41 user nova-compute[72201]: </disk>
Aug 01 16:03:41 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:03:41 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Successfully detached device vdb from instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 from the persistent domain config.
Aug 01 16:03:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 16:03:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:03:41 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:03:41 user nova-compute[72201]:   <source dev="/dev/sdc"/>
Aug 01 16:03:41 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:03:41 user nova-compute[72201]:   <serial>d8c2b65d-718f-491f-ae0e-4e371d03d722</serial>
Aug 01 16:03:41 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:03:41 user nova-compute[72201]: </disk>
Aug 01 16:03:41 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690905822.360901, a5a2d1de-1be6-4310-95c9-a0e360fcfba2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 16:03:42 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Successfully detached device vdb from instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 from the live domain config.
Aug 01 16:03:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDgRAYBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:03:42 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:03:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3ccc7b-f6de-42da-99f2-9117159e698c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d19a3a-8d5b-416a-9a14-b11b94833a5e]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:03:42 user nova-compute[72201]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 (non-flash)
Aug 01 16:03:42 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:03:42 user nova-compute[72201]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 (non-flash)
Aug 01 16:03:42 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc5444ebb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722'): ({'sdc'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Removing single pathed devices sdc {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4001c1b3-758c-4ebf-bb4c-c506c9579ca7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cece348-4809-4dcc-b7f3-52136699330b]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Flushing IO for device /dev/sdc {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e2aa2e-2c3d-4296-9fa5-39fcf956b48b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd5ee97-1016-4380-af7c-b39bf530c7e0]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1397a122-8bc4-4fa8-a101-1b6946580f1c]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce03636-dbb7-4355-bbd9-a38dea973a13]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722, portal: 172.16.0.220,3260]
Aug 01 16:03:42 user nova-compute[72201]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722, portal: 172.16.0.220,3260] successful.
Aug 01 16:03:42 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c2b65d-718f-491f-ae0e-4e371d03d722 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed85c7d-59ed-4931-8e36-047eaadef411]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] <== disconnect_volume: return (271ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:03:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:03:43 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:03:43 user nova-compute[72201]: DEBUG nova.objects.instance [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lazy-loading 'flavor' on Instance uuid a5a2d1de-1be6-4310-95c9-a0e360fcfba2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:03:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8575ef32-2747-4ebb-8e69-a0cbdcf2aefe tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.619s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:03:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:46 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:03:47 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:03:47 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:03:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:03:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:03:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:03:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:03:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:55 user nova-compute[72201]: DEBUG nova.compute.manager [req-c2bb8c08-2bb3-4e14-b983-e7e14ef0d0ca req-065b60d7-e589-4f94-b939-631435790798 service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Received event network-changed-0794181e-04f5-4dd2-bc16-55f263612c1f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:03:55 user nova-compute[72201]: DEBUG nova.compute.manager [req-c2bb8c08-2bb3-4e14-b983-e7e14ef0d0ca req-065b60d7-e589-4f94-b939-631435790798 service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Refreshing instance network info cache due to event network-changed-0794181e-04f5-4dd2-bc16-55f263612c1f. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:03:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c2bb8c08-2bb3-4e14-b983-e7e14ef0d0ca req-065b60d7-e589-4f94-b939-631435790798 service nova] Acquiring lock "refresh_cache-25a23aef-6c09-47be-be76-6a3aae90e327" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:03:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c2bb8c08-2bb3-4e14-b983-e7e14ef0d0ca req-065b60d7-e589-4f94-b939-631435790798 service nova] Acquired lock "refresh_cache-25a23aef-6c09-47be-be76-6a3aae90e327" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:03:55 user nova-compute[72201]: DEBUG nova.network.neutron [req-c2bb8c08-2bb3-4e14-b983-e7e14ef0d0ca req-065b60d7-e589-4f94-b939-631435790798 service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Refreshing network info cache for port 0794181e-04f5-4dd2-bc16-55f263612c1f {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:03:55 user nova-compute[72201]: DEBUG nova.network.neutron [req-c2bb8c08-2bb3-4e14-b983-e7e14ef0d0ca req-065b60d7-e589-4f94-b939-631435790798 service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Updated VIF entry in instance network info cache for port 0794181e-04f5-4dd2-bc16-55f263612c1f. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:03:55 user nova-compute[72201]: DEBUG nova.network.neutron [req-c2bb8c08-2bb3-4e14-b983-e7e14ef0d0ca req-065b60d7-e589-4f94-b939-631435790798 service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Updating instance_info_cache with network_info: [{"id": "0794181e-04f5-4dd2-bc16-55f263612c1f", "address": "fa:16:3e:4c:3c:b4", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0794181e-04", "ovs_interfaceid": "0794181e-04f5-4dd2-bc16-55f263612c1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:03:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c2bb8c08-2bb3-4e14-b983-e7e14ef0d0ca req-065b60d7-e589-4f94-b939-631435790798 service nova] Releasing lock "refresh_cache-25a23aef-6c09-47be-be76-6a3aae90e327" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:03:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "25a23aef-6c09-47be-be76-6a3aae90e327" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:03:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "25a23aef-6c09-47be-be76-6a3aae90e327" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:03:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "25a23aef-6c09-47be-be76-6a3aae90e327-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:03:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "25a23aef-6c09-47be-be76-6a3aae90e327-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:03:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "25a23aef-6c09-47be-be76-6a3aae90e327-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:03:56 user nova-compute[72201]: INFO nova.compute.manager [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Terminating instance
Aug 01 16:03:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 16:03:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-25636504-9f19-4a98-a441-a80b638d4244 req-8d6c4b46-83d5-4502-9760-4d723e3f3d02 service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Received event network-vif-unplugged-0794181e-04f5-4dd2-bc16-55f263612c1f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:03:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-25636504-9f19-4a98-a441-a80b638d4244 req-8d6c4b46-83d5-4502-9760-4d723e3f3d02 service nova] Acquiring lock "25a23aef-6c09-47be-be76-6a3aae90e327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:03:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-25636504-9f19-4a98-a441-a80b638d4244 req-8d6c4b46-83d5-4502-9760-4d723e3f3d02 service nova] Lock "25a23aef-6c09-47be-be76-6a3aae90e327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:03:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-25636504-9f19-4a98-a441-a80b638d4244 req-8d6c4b46-83d5-4502-9760-4d723e3f3d02 service nova] Lock "25a23aef-6c09-47be-be76-6a3aae90e327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:03:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-25636504-9f19-4a98-a441-a80b638d4244 req-8d6c4b46-83d5-4502-9760-4d723e3f3d02 service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] No waiting events found dispatching network-vif-unplugged-0794181e-04f5-4dd2-bc16-55f263612c1f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:03:56 user nova-compute[72201]: DEBUG nova.compute.manager [req-25636504-9f19-4a98-a441-a80b638d4244 req-8d6c4b46-83d5-4502-9760-4d723e3f3d02 service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Received event network-vif-unplugged-0794181e-04f5-4dd2-bc16-55f263612c1f for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:57 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Instance destroyed successfully.
Aug 01 16:03:57 user nova-compute[72201]: DEBUG nova.objects.instance [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lazy-loading 'resources' on Instance uuid 25a23aef-6c09-47be-be76-6a3aae90e327 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:02:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-189530672',display_name='tempest-TestVolumeBootPattern-server-189530672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-189530672',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRfjK9mfMZECkiNZS+WvmmHxqcLD3Bp/k3VJTkM9GOR5ve6M3pZuKsANEYec+jLTwfqzqMZWoeJ6cNgc2ItQC8bULCPj1V4+xbFRpB7985q2k/9hGKp8rI4LhVLHyjBRw==',key_name='tempest-TestVolumeBootPattern-1356630349',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:02:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a49e4769bf348be8fedc8b70f65cea2',ramdisk_id='',reservation_id='r-9dbs1rdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1110722165',owner_user_name='tempest-TestVolumeBootPattern-1110722165-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:02:16Z,user_data=None,user_id='222a94fd4bed425a8d80ba777c2361f0',uuid=25a23aef-6c09-47be-be76-6a3aae90e327,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0794181e-04f5-4dd2-bc16-55f263612c1f", "address": "fa:16:3e:4c:3c:b4", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0794181e-04", "ovs_interfaceid": "0794181e-04f5-4dd2-bc16-55f263612c1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converting VIF {"id": "0794181e-04f5-4dd2-bc16-55f263612c1f", "address": "fa:16:3e:4c:3c:b4", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0794181e-04", "ovs_interfaceid": "0794181e-04f5-4dd2-bc16-55f263612c1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:3c:b4,bridge_name='br-int',has_traffic_filtering=True,id=0794181e-04f5-4dd2-bc16-55f263612c1f,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0794181e-04') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG os_vif [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:3c:b4,bridge_name='br-int',has_traffic_filtering=True,id=0794181e-04f5-4dd2-bc16-55f263612c1f,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0794181e-04') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0794181e-04, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:03:57 user nova-compute[72201]: INFO os_vif [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:3c:b4,bridge_name='br-int',has_traffic_filtering=True,id=0794181e-04f5-4dd2-bc16-55f263612c1f,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0794181e-04')
Aug 01 16:03:57 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWGzqwcv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:03:57 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:03:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1345015b-1dec-492a-9ff5-cd90a0e85495]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9752cefb-5832-4da7-9586-8ba4d0d2e5de]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:03:57 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:03:57 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc52c67c4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f'): ({'sdb'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Removing single pathed devices sdb {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1956611b-ee8e-45a3-b0c4-008f97b763b2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[395a3921-eb36-4731-8fb5-056e6da3a042]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Flushing IO for device /dev/sdb {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[be848eab-1039-45de-891f-f253d726dc39]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.064s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5286ec-c7d6-43aa-8939-c3f5e6ee7e5a]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23465653063653937', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_545cf140', '/dev/disk/by-id/scsi-1SCST_BIO545cf140-4ee0ce97c5d3e807') {{(pid=83290) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b8f60e-5eed-4cc8-94e5-6b4deb51eb00]: (4, None) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd200bd-5a58-4084-8828-6232bd8bf063]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[349860d1-b8d2-4712-a569-1c30c52ef5bd]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f, portal: 172.16.0.220,3260]
Aug 01 16:03:57 user nova-compute[72201]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f, portal: 172.16.0.220,3260] successful.
Aug 01 16:03:57 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec7abc6-fb48-4423-bcae-165c3d477fd3]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] <== disconnect_volume: return (282ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:03:57 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Deleting instance files /opt/stack/data/nova/instances/25a23aef-6c09-47be-be76-6a3aae90e327_del
Aug 01 16:03:57 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Deletion of /opt/stack/data/nova/instances/25a23aef-6c09-47be-be76-6a3aae90e327_del complete
Aug 01 16:03:57 user nova-compute[72201]: INFO nova.compute.manager [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 01 16:03:57 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 16:03:57 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 16:03:58 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:03:58 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Took 0.76 seconds to deallocate network for instance.
Aug 01 16:03:58 user nova-compute[72201]: DEBUG nova.compute.manager [req-5d79b5c1-4b67-4ac2-9931-edcd40767072 req-aac2448e-1872-4ed2-b403-2f01bdc32eae service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Received event network-vif-deleted-0794181e-04f5-4dd2-bc16-55f263612c1f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:03:58 user nova-compute[72201]: DEBUG nova.compute.manager [req-0d8ad9ca-e916-44dc-bbed-3070361378a7 req-a6bc9001-7fa2-46d9-bce4-fc97782d3bb0 service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Received event network-vif-plugged-0794181e-04f5-4dd2-bc16-55f263612c1f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:03:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0d8ad9ca-e916-44dc-bbed-3070361378a7 req-a6bc9001-7fa2-46d9-bce4-fc97782d3bb0 service nova] Acquiring lock "25a23aef-6c09-47be-be76-6a3aae90e327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:03:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0d8ad9ca-e916-44dc-bbed-3070361378a7 req-a6bc9001-7fa2-46d9-bce4-fc97782d3bb0 service nova] Lock "25a23aef-6c09-47be-be76-6a3aae90e327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:03:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-0d8ad9ca-e916-44dc-bbed-3070361378a7 req-a6bc9001-7fa2-46d9-bce4-fc97782d3bb0 service nova] Lock "25a23aef-6c09-47be-be76-6a3aae90e327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:03:58 user nova-compute[72201]: DEBUG nova.compute.manager [req-0d8ad9ca-e916-44dc-bbed-3070361378a7 req-a6bc9001-7fa2-46d9-bce4-fc97782d3bb0 service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] No waiting events found dispatching network-vif-plugged-0794181e-04f5-4dd2-bc16-55f263612c1f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:03:58 user nova-compute[72201]: WARNING nova.compute.manager [req-0d8ad9ca-e916-44dc-bbed-3070361378a7 req-a6bc9001-7fa2-46d9-bce4-fc97782d3bb0 service nova] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Received unexpected event network-vif-plugged-0794181e-04f5-4dd2-bc16-55f263612c1f for instance with vm_state active and task_state deleting.
Aug 01 16:03:59 user nova-compute[72201]: INFO nova.compute.manager [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Took 0.90 seconds to detach 1 volumes for instance.
Aug 01 16:03:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:03:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:03:59 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:03:59 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:03:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:03:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:03:59 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Deleted allocations for instance 25a23aef-6c09-47be-be76-6a3aae90e327
Aug 01 16:03:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-d46795b3-7c45-46f7-bfd2-b4dadd6b61b0 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "25a23aef-6c09-47be-be76-6a3aae90e327" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.119s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:04:02 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:04:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:04:12 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690905837.3435338, 25a23aef-6c09-47be-be76-6a3aae90e327 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:04:12 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] VM Stopped (Lifecycle Event)
Aug 01 16:04:12 user nova-compute[72201]: DEBUG nova.compute.manager [None req-427c3306-bd7f-4aee-8b58-1be72a336ef8 None None] [instance: 25a23aef-6c09-47be-be76-6a3aae90e327] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:04:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:04:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:04:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:04:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:04:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:04:12 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:04:17 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:04:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:04:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:04:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:04:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:04:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:04:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:04:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:04:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:04:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:04:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:04:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:04:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:04:32 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:04:33 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:04:37 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:04:37 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:04:37 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 16:04:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-a5a2d1de-1be6-4310-95c9-a0e360fcfba2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:04:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-a5a2d1de-1be6-4310-95c9-a0e360fcfba2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:04:37 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:04:37 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid a5a2d1de-1be6-4310-95c9-a0e360fcfba2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:04:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:04:37 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Updating instance_info_cache with network_info: [{"id": "d73227e3-b63d-4772-939e-d51a5d0f944f", "address": "fa:16:3e:ae:26:84", "network": {"id": "e663c2b6-49c0-4ca9-af67-1b58650f9111", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443771328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17edafa90e946e5b9092443da878bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73227e3-b6", "ovs_interfaceid": "d73227e3-b63d-4772-939e-d51a5d0f944f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:04:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-a5a2d1de-1be6-4310-95c9-a0e360fcfba2" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:04:37 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:04:39 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:04:40 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:04:40 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:04:40 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:04:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:04:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:04:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:04:40 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:04:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:04:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:04:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:04:40 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:04:40 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:04:40 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:04:40 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8700MB free_disk=25.182579040527344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:04:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:04:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:04:40 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:04:40 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:04:40 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:04:41 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:04:41 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:04:41 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:04:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:04:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:04:45 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:04:47 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:04:47 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:04:48 user nova-compute[72201]: INFO nova.compute.claims [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Claim successful on node user
Aug 01 16:04:48 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.214s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG nova.network.neutron [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:04:48 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:04:48 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:04:48 user nova-compute[72201]: INFO nova.virt.block_device [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Booting with volume 2b1f1cbf-6178-45b0-a9c7-19d163daba2f at /dev/vda
Aug 01 16:04:48 user nova-compute[72201]: DEBUG nova.policy [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '222a94fd4bed425a8d80ba777c2361f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a49e4769bf348be8fedc8b70f65cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG os_brick.utils [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4232e26c-a62a-4307-ac73-d9435d7d4176]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c320f7a0-5288-4167-874b-31ea13c28486]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[912a2fb6-7a06-48dc-8cff-d217b8b431ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2f576b-d3a0-431a-875f-6edb866c70dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:04:48 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:04:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[51588536-9798-4c42-ac72-516d4844630f]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG os_brick.utils [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:04:48 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Updating existing volume attachment record: 4d87e413-4b98-40ec-a770-20ddfb4879b7 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:04:49 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:04:49 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:04:50 user nova-compute[72201]: DEBUG nova.network.neutron [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Successfully created port: 8dc44f2d-5980-4878-b3da-9a01f8d82b71 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:04:50 user nova-compute[72201]: DEBUG nova.network.neutron [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Successfully updated port: 8dc44f2d-5980-4878-b3da-9a01f8d82b71 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:04:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:04:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquired lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:04:50 user nova-compute[72201]: DEBUG nova.network.neutron [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:04:51 user nova-compute[72201]: DEBUG nova.compute.manager [req-1b0dc005-20fd-4ed7-987a-16fd69755bd0 req-d260d847-001f-49fa-90a2-4d4891757dd0 service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Received event network-changed-8dc44f2d-5980-4878-b3da-9a01f8d82b71 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:04:51 user nova-compute[72201]: DEBUG nova.compute.manager [req-1b0dc005-20fd-4ed7-987a-16fd69755bd0 req-d260d847-001f-49fa-90a2-4d4891757dd0 service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Refreshing instance network info cache due to event network-changed-8dc44f2d-5980-4878-b3da-9a01f8d82b71. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:04:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1b0dc005-20fd-4ed7-987a-16fd69755bd0 req-d260d847-001f-49fa-90a2-4d4891757dd0 service nova] Acquiring lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:04:51 user nova-compute[72201]: DEBUG nova.network.neutron [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:04:51 user nova-compute[72201]: DEBUG nova.network.neutron [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Updating instance_info_cache with network_info: [{"id": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "address": "fa:16:3e:4d:95:77", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dc44f2d-59", "ovs_interfaceid": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:04:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Releasing lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:04:51 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Instance network_info: |[{"id": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "address": "fa:16:3e:4d:95:77", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dc44f2d-59", "ovs_interfaceid": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:04:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1b0dc005-20fd-4ed7-987a-16fd69755bd0 req-d260d847-001f-49fa-90a2-4d4891757dd0 service nova] Acquired lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:04:51 user nova-compute[72201]: DEBUG nova.network.neutron [req-1b0dc005-20fd-4ed7-987a-16fd69755bd0 req-d260d847-001f-49fa-90a2-4d4891757dd0 service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Refreshing network info cache for port 8dc44f2d-5980-4878-b3da-9a01f8d82b71 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:04:51 user nova-compute[72201]: DEBUG nova.network.neutron [req-1b0dc005-20fd-4ed7-987a-16fd69755bd0 req-d260d847-001f-49fa-90a2-4d4891757dd0 service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Updated VIF entry in instance network info cache for port 8dc44f2d-5980-4878-b3da-9a01f8d82b71. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:04:51 user nova-compute[72201]: DEBUG nova.network.neutron [req-1b0dc005-20fd-4ed7-987a-16fd69755bd0 req-d260d847-001f-49fa-90a2-4d4891757dd0 service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Updating instance_info_cache with network_info: [{"id": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "address": "fa:16:3e:4d:95:77", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dc44f2d-59", "ovs_interfaceid": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:04:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1b0dc005-20fd-4ed7-987a-16fd69755bd0 req-d260d847-001f-49fa-90a2-4d4891757dd0 service nova] Releasing lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:04:52 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:04:55 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:04:56 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Creating image(s)
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Did not create local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Ensure instance console log exists: /opt/stack/data/nova/instances/baead5f8-a15c-4fe7-94ce-8221fdbbb7da/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Start _get_guest_xml network_info=[{"id": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "address": "fa:16:3e:4d:95:77", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dc44f2d-59", "ovs_interfaceid": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWGzqwcv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'baead5f8-a15c-4fe7-94ce-8221fdbbb7da', 'attached_at': '', 'detached_at': '', 'volume_id': '2b1f1cbf-6178-45b0-a9c7-19d163daba2f', 'serial': '2b1f1cbf-6178-45b0-a9c7-19d163daba2f'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '4d87e413-4b98-40ec-a770-20ddfb4879b7', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:04:56 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:04:56 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWGzqwcv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:04:56 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:04:56 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:04:56 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a3157b-53f7-466e-939e-57a8de96cea3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:04:56 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[599d311f-5ece-4bf4-811c-dd1c53a59bb1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f] added
Aug 01 16:04:56 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[76767e44-c5c2-444e-982d-f99dcdfb4289]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c71c6e-510a-47b7-b32f-4c6da9859a7a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWGzqwcv {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWGzqwcv" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[006738e8-c2d1-4e90-a457-b34829d25c14]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rWGzqwcv'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[950a4c66-452b-4ca5-ac0f-4695735ef479]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcacb59-4d54-45fd-a4d0-ff1325e0b29f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 16:04:56 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 16:04:56 user nova-compute[72201]:  {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:04:56 user nova-compute[72201]: WARNING os_brick.initiator.connectors.iscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 16:04:56 user nova-compute[72201]: 
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89e5cf4-7049-4dd0-b8bf-4f4eb2d7fa43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f, portal: 172.16.0.220,3260]
Aug 01 16:04:56 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f, portal: 172.16.0.220,3260] successful.
Aug 01 16:04:56 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7207ba-2668-4d56-a3ce-6c9d7595fde6]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bddd9d9-765d-4f20-b072-6ee8e3f56893]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:04:56 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:04:56 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[84759b45-632a-4fb6-96de-fd3904104242]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:04:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWGzqwcv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23465653063653937', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465653063653937', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1612178196',display_name='tempest-TestVolumeBootPattern-server-1612178196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1612178196',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRfjK9mfMZECkiNZS+WvmmHxqcLD3Bp/k3VJTkM9GOR5ve6M3pZuKsANEYec+jLTwfqzqMZWoeJ6cNgc2ItQC8bULCPj1V4+xbFRpB7985q2k/9hGKp8rI4LhVLHyjBRw==',key_name='tempest-TestVolumeBootPattern-1356630349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a49e4769bf348be8fedc8b70f65cea2',ramdisk_id='',reservation_id='r-23ui0r3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1110722165',owner_user_name='tempest-TestVolumeBootPattern-1110722165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:04:49Z,user_data=None,user_id='222a94fd4bed425a8d80ba777c2361f0',uuid=baead5f8-a15c-4fe7-94ce-8221fdbbb7da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "address": "fa:16:3e:4d:95:77", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dc44f2d-59", "ovs_interfaceid": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converting VIF {"id": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "address": "fa:16:3e:4d:95:77", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dc44f2d-59", "ovs_interfaceid": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:95:77,bridge_name='br-int',has_traffic_filtering=True,id=8dc44f2d-5980-4878-b3da-9a01f8d82b71,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dc44f2d-59') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG nova.objects.instance [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lazy-loading 'pci_devices' on Instance uuid baead5f8-a15c-4fe7-94ce-8221fdbbb7da {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:04:57 user nova-compute[72201]:   <uuid>baead5f8-a15c-4fe7-94ce-8221fdbbb7da</uuid>
Aug 01 16:04:57 user nova-compute[72201]:   <name>instance-00000032</name>
Aug 01 16:04:57 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 16:04:57 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 16:04:57 user nova-compute[72201]:   <metadata>
Aug 01 16:04:57 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:04:57 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 16:04:57 user nova-compute[72201]:       <nova:name>tempest-TestVolumeBootPattern-server-1612178196</nova:name>
Aug 01 16:04:57 user nova-compute[72201]:       <nova:creationTime>2023-08-01 16:04:56</nova:creationTime>
Aug 01 16:04:57 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 16:04:57 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 16:04:57 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 16:04:57 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 16:04:57 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:04:57 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:04:57 user nova-compute[72201]:       </nova:flavor>
Aug 01 16:04:57 user nova-compute[72201]:       <nova:owner>
Aug 01 16:04:57 user nova-compute[72201]:         <nova:user uuid="222a94fd4bed425a8d80ba777c2361f0">tempest-TestVolumeBootPattern-1110722165-project-member</nova:user>
Aug 01 16:04:57 user nova-compute[72201]:         <nova:project uuid="3a49e4769bf348be8fedc8b70f65cea2">tempest-TestVolumeBootPattern-1110722165</nova:project>
Aug 01 16:04:57 user nova-compute[72201]:       </nova:owner>
Aug 01 16:04:57 user nova-compute[72201]:       <nova:ports>
Aug 01 16:04:57 user nova-compute[72201]:         <nova:port uuid="8dc44f2d-5980-4878-b3da-9a01f8d82b71">
Aug 01 16:04:57 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 16:04:57 user nova-compute[72201]:         </nova:port>
Aug 01 16:04:57 user nova-compute[72201]:       </nova:ports>
Aug 01 16:04:57 user nova-compute[72201]:     </nova:instance>
Aug 01 16:04:57 user nova-compute[72201]:   </metadata>
Aug 01 16:04:57 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 16:04:57 user nova-compute[72201]:     <system>
Aug 01 16:04:57 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:04:57 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:04:57 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 16:04:57 user nova-compute[72201]:       <entry name="serial">baead5f8-a15c-4fe7-94ce-8221fdbbb7da</entry>
Aug 01 16:04:57 user nova-compute[72201]:       <entry name="uuid">baead5f8-a15c-4fe7-94ce-8221fdbbb7da</entry>
Aug 01 16:04:57 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:04:57 user nova-compute[72201]:     </system>
Aug 01 16:04:57 user nova-compute[72201]:   </sysinfo>
Aug 01 16:04:57 user nova-compute[72201]:   <os>
Aug 01 16:04:57 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:04:57 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 16:04:57 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 16:04:57 user nova-compute[72201]:   </os>
Aug 01 16:04:57 user nova-compute[72201]:   <features>
Aug 01 16:04:57 user nova-compute[72201]:     <acpi/>
Aug 01 16:04:57 user nova-compute[72201]:     <apic/>
Aug 01 16:04:57 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 16:04:57 user nova-compute[72201]:   </features>
Aug 01 16:04:57 user nova-compute[72201]:   <clock offset="utc">
Aug 01 16:04:57 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:04:57 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:04:57 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 16:04:57 user nova-compute[72201]:   </clock>
Aug 01 16:04:57 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 16:04:57 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 16:04:57 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:04:57 user nova-compute[72201]:   </cpu>
Aug 01 16:04:57 user nova-compute[72201]:   <devices>
Aug 01 16:04:57 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 16:04:57 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:04:57 user nova-compute[72201]:       <source dev="/dev/sdb"/>
Aug 01 16:04:57 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 16:04:57 user nova-compute[72201]:       <serial>2b1f1cbf-6178-45b0-a9c7-19d163daba2f</serial>
Aug 01 16:04:57 user nova-compute[72201]:     </disk>
Aug 01 16:04:57 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 16:04:57 user nova-compute[72201]:       <mac address="fa:16:3e:4d:95:77"/>
Aug 01 16:04:57 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 16:04:57 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 16:04:57 user nova-compute[72201]:       <target dev="tap8dc44f2d-59"/>
Aug 01 16:04:57 user nova-compute[72201]:     </interface>
Aug 01 16:04:57 user nova-compute[72201]:     <serial type="pty">
Aug 01 16:04:57 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/baead5f8-a15c-4fe7-94ce-8221fdbbb7da/console.log" append="off"/>
Aug 01 16:04:57 user nova-compute[72201]:     </serial>
Aug 01 16:04:57 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:04:57 user nova-compute[72201]:     <video>
Aug 01 16:04:57 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 16:04:57 user nova-compute[72201]:     </video>
Aug 01 16:04:57 user nova-compute[72201]:     <rng model="virtio">
Aug 01 16:04:57 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:04:57 user nova-compute[72201]:     </rng>
Aug 01 16:04:57 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:04:57 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 16:04:57 user nova-compute[72201]:       <stats period="10"/>
Aug 01 16:04:57 user nova-compute[72201]:     </memballoon>
Aug 01 16:04:57 user nova-compute[72201]:   </devices>
Aug 01 16:04:57 user nova-compute[72201]: </domain>
Aug 01 16:04:57 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1612178196',display_name='tempest-TestVolumeBootPattern-server-1612178196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1612178196',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRfjK9mfMZECkiNZS+WvmmHxqcLD3Bp/k3VJTkM9GOR5ve6M3pZuKsANEYec+jLTwfqzqMZWoeJ6cNgc2ItQC8bULCPj1V4+xbFRpB7985q2k/9hGKp8rI4LhVLHyjBRw==',key_name='tempest-TestVolumeBootPattern-1356630349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a49e4769bf348be8fedc8b70f65cea2',ramdisk_id='',reservation_id='r-23ui0r3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1110722165',owner_user_name='tempest-TestVolumeBootPattern-1110722165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:04:49Z,user_data=None,user_id='222a94fd4bed425a8d80ba777c2361f0',uuid=baead5f8-a15c-4fe7-94ce-8221fdbbb7da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "address": "fa:16:3e:4d:95:77", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dc44f2d-59", "ovs_interfaceid": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converting VIF {"id": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "address": "fa:16:3e:4d:95:77", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dc44f2d-59", "ovs_interfaceid": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:95:77,bridge_name='br-int',has_traffic_filtering=True,id=8dc44f2d-5980-4878-b3da-9a01f8d82b71,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dc44f2d-59') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG os_vif [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:95:77,bridge_name='br-int',has_traffic_filtering=True,id=8dc44f2d-5980-4878-b3da-9a01f8d82b71,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dc44f2d-59') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8dc44f2d-59, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8dc44f2d-59, col_values=(('external_ids', {'iface-id': '8dc44f2d-5980-4878-b3da-9a01f8d82b71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:95:77', 'vm-uuid': 'baead5f8-a15c-4fe7-94ce-8221fdbbb7da'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:04:57 user nova-compute[72201]: INFO os_vif [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:95:77,bridge_name='br-int',has_traffic_filtering=True,id=8dc44f2d-5980-4878-b3da-9a01f8d82b71,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dc44f2d-59')
Aug 01 16:04:57 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:04:57 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] No VIF found with MAC fa:16:3e:4d:95:77, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:04:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:04:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:04:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:04:59 user nova-compute[72201]: DEBUG nova.compute.manager [req-5669d820-ffd3-46cf-9447-4b150d5344fd req-4f28f5b8-716f-46be-b5a0-55b0562646c5 service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Received event network-vif-plugged-8dc44f2d-5980-4878-b3da-9a01f8d82b71 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:04:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5669d820-ffd3-46cf-9447-4b150d5344fd req-4f28f5b8-716f-46be-b5a0-55b0562646c5 service nova] Acquiring lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:04:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5669d820-ffd3-46cf-9447-4b150d5344fd req-4f28f5b8-716f-46be-b5a0-55b0562646c5 service nova] Lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:04:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5669d820-ffd3-46cf-9447-4b150d5344fd req-4f28f5b8-716f-46be-b5a0-55b0562646c5 service nova] Lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:04:59 user nova-compute[72201]: DEBUG nova.compute.manager [req-5669d820-ffd3-46cf-9447-4b150d5344fd req-4f28f5b8-716f-46be-b5a0-55b0562646c5 service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] No waiting events found dispatching network-vif-plugged-8dc44f2d-5980-4878-b3da-9a01f8d82b71 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:04:59 user nova-compute[72201]: WARNING nova.compute.manager [req-5669d820-ffd3-46cf-9447-4b150d5344fd req-4f28f5b8-716f-46be-b5a0-55b0562646c5 service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Received unexpected event network-vif-plugged-8dc44f2d-5980-4878-b3da-9a01f8d82b71 for instance with vm_state building and task_state spawning.
Aug 01 16:04:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:04:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:04:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:05:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:05:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:05:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:05:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:05:00 user nova-compute[72201]: INFO nova.compute.manager [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Terminating instance
Aug 01 16:05:00 user nova-compute[72201]: DEBUG nova.compute.manager [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 16:05:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:00 user nova-compute[72201]: DEBUG nova.compute.manager [req-c355bbd3-609b-4552-86b2-025142ab40d7 req-a881f5be-230c-4df6-afb3-925de9118bcb service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Received event network-vif-unplugged-d73227e3-b63d-4772-939e-d51a5d0f944f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:05:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c355bbd3-609b-4552-86b2-025142ab40d7 req-a881f5be-230c-4df6-afb3-925de9118bcb service nova] Acquiring lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:05:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c355bbd3-609b-4552-86b2-025142ab40d7 req-a881f5be-230c-4df6-afb3-925de9118bcb service nova] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:05:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c355bbd3-609b-4552-86b2-025142ab40d7 req-a881f5be-230c-4df6-afb3-925de9118bcb service nova] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:05:00 user nova-compute[72201]: DEBUG nova.compute.manager [req-c355bbd3-609b-4552-86b2-025142ab40d7 req-a881f5be-230c-4df6-afb3-925de9118bcb service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] No waiting events found dispatching network-vif-unplugged-d73227e3-b63d-4772-939e-d51a5d0f944f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:05:00 user nova-compute[72201]: DEBUG nova.compute.manager [req-c355bbd3-609b-4552-86b2-025142ab40d7 req-a881f5be-230c-4df6-afb3-925de9118bcb service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Received event network-vif-unplugged-d73227e3-b63d-4772-939e-d51a5d0f944f for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690905900.9995387, baead5f8-a15c-4fe7-94ce-8221fdbbb7da => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:05:01 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] VM Resumed (Lifecycle Event)
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:05:01 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Instance spawned successfully.
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:05:01 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690905901.0055337, baead5f8-a15c-4fe7-94ce-8221fdbbb7da => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:05:01 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] VM Started (Lifecycle Event)
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:05:01 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.compute.manager [req-5c79629d-1e47-4c1d-a3c4-a656b52e805d req-c67f56a9-7509-4e1b-a439-eaa490b7d5c6 service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Received event network-vif-plugged-8dc44f2d-5980-4878-b3da-9a01f8d82b71 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5c79629d-1e47-4c1d-a3c4-a656b52e805d req-c67f56a9-7509-4e1b-a439-eaa490b7d5c6 service nova] Acquiring lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5c79629d-1e47-4c1d-a3c4-a656b52e805d req-c67f56a9-7509-4e1b-a439-eaa490b7d5c6 service nova] Lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-5c79629d-1e47-4c1d-a3c4-a656b52e805d req-c67f56a9-7509-4e1b-a439-eaa490b7d5c6 service nova] Lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.compute.manager [req-5c79629d-1e47-4c1d-a3c4-a656b52e805d req-c67f56a9-7509-4e1b-a439-eaa490b7d5c6 service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] No waiting events found dispatching network-vif-plugged-8dc44f2d-5980-4878-b3da-9a01f8d82b71 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:05:01 user nova-compute[72201]: WARNING nova.compute.manager [req-5c79629d-1e47-4c1d-a3c4-a656b52e805d req-c67f56a9-7509-4e1b-a439-eaa490b7d5c6 service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Received unexpected event network-vif-plugged-8dc44f2d-5980-4878-b3da-9a01f8d82b71 for instance with vm_state building and task_state spawning.
Aug 01 16:05:01 user nova-compute[72201]: INFO nova.compute.manager [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Took 5.19 seconds to spawn the instance on the hypervisor.
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:01 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Instance destroyed successfully.
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.objects.instance [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lazy-loading 'resources' on Instance uuid a5a2d1de-1be6-4310-95c9-a0e360fcfba2 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:05:01 user nova-compute[72201]: INFO nova.compute.manager [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Took 13.12 seconds to build instance.
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T15:57:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-821328104',display_name='tempest-SnapshotDataIntegrityTests-server-821328104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-821328104',id=47,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+8Qozkm/YjCA81dj3PJn4XhGrFjytKfQXcKRObZkg7ms2s7cZgDN/cqUMTJbvdY55Mo6pQ0DfkAHlMiyJFwTpZXuV78tHk/9r9eGBO8QmJKZ68unukquAcVgVS3BbD/g==',key_name='tempest-keypair-130889552',keypairs=<?>,launch_index=0,launched_at=2023-08-01T15:58:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c17edafa90e946e5b9092443da878bad',ramdisk_id='',reservation_id='r-hm4wvukf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1452624855',owner_user_name='tempest-SnapshotDataIntegrityTests-1452624855-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T15:58:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3962bf288b14e539ca16127713178e6',uuid=a5a2d1de-1be6-4310-95c9-a0e360fcfba2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d73227e3-b63d-4772-939e-d51a5d0f944f", "address": "fa:16:3e:ae:26:84", "network": {"id": "e663c2b6-49c0-4ca9-af67-1b58650f9111", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443771328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17edafa90e946e5b9092443da878bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73227e3-b6", "ovs_interfaceid": "d73227e3-b63d-4772-939e-d51a5d0f944f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Converting VIF {"id": "d73227e3-b63d-4772-939e-d51a5d0f944f", "address": "fa:16:3e:ae:26:84", "network": {"id": "e663c2b6-49c0-4ca9-af67-1b58650f9111", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-443771328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17edafa90e946e5b9092443da878bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd73227e3-b6", "ovs_interfaceid": "d73227e3-b63d-4772-939e-d51a5d0f944f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:26:84,bridge_name='br-int',has_traffic_filtering=True,id=d73227e3-b63d-4772-939e-d51a5d0f944f,network=Network(e663c2b6-49c0-4ca9-af67-1b58650f9111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd73227e3-b6') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG os_vif [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:26:84,bridge_name='br-int',has_traffic_filtering=True,id=d73227e3-b63d-4772-939e-d51a5d0f944f,network=Network(e663c2b6-49c0-4ca9-af67-1b58650f9111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd73227e3-b6') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd73227e3-b6, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:01 user nova-compute[72201]: INFO os_vif [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:26:84,bridge_name='br-int',has_traffic_filtering=True,id=d73227e3-b63d-4772-939e-d51a5d0f944f,network=Network(e663c2b6-49c0-4ca9-af67-1b58650f9111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd73227e3-b6')
Aug 01 16:05:01 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Deleting instance files /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2_del
Aug 01 16:05:01 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Deletion of /opt/stack/data/nova/instances/a5a2d1de-1be6-4310-95c9-a0e360fcfba2_del complete
Aug 01 16:05:01 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4579bb8c-0920-498b-b4bb-4f9dab16f42f tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.269s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:05:01 user nova-compute[72201]: INFO nova.compute.manager [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 01 16:05:01 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 16:05:01 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 16:05:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-d77cd4d2-cc44-4a79-91c4-fc5adf0fc1b1 req-e43ec9ec-4fb9-465f-9477-e5c1d64efd28 service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Received event network-vif-plugged-d73227e3-b63d-4772-939e-d51a5d0f944f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:05:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d77cd4d2-cc44-4a79-91c4-fc5adf0fc1b1 req-e43ec9ec-4fb9-465f-9477-e5c1d64efd28 service nova] Acquiring lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:05:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d77cd4d2-cc44-4a79-91c4-fc5adf0fc1b1 req-e43ec9ec-4fb9-465f-9477-e5c1d64efd28 service nova] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:05:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-d77cd4d2-cc44-4a79-91c4-fc5adf0fc1b1 req-e43ec9ec-4fb9-465f-9477-e5c1d64efd28 service nova] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:05:02 user nova-compute[72201]: DEBUG nova.compute.manager [req-d77cd4d2-cc44-4a79-91c4-fc5adf0fc1b1 req-e43ec9ec-4fb9-465f-9477-e5c1d64efd28 service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] No waiting events found dispatching network-vif-plugged-d73227e3-b63d-4772-939e-d51a5d0f944f {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:05:02 user nova-compute[72201]: WARNING nova.compute.manager [req-d77cd4d2-cc44-4a79-91c4-fc5adf0fc1b1 req-e43ec9ec-4fb9-465f-9477-e5c1d64efd28 service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Received unexpected event network-vif-plugged-d73227e3-b63d-4772-939e-d51a5d0f944f for instance with vm_state active and task_state deleting.
Aug 01 16:05:03 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:05:03 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Took 1.66 seconds to deallocate network for instance.
Aug 01 16:05:03 user nova-compute[72201]: DEBUG nova.compute.manager [req-3e4fa48b-adf4-482d-84d3-4d806ea59283 req-ec328746-a254-4611-b0d2-f17983b1caf2 service nova] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Received event network-vif-deleted-d73227e3-b63d-4772-939e-d51a5d0f944f {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:05:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:05:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:05:03 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:05:03 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:05:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:05:03 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Deleted allocations for instance a5a2d1de-1be6-4310-95c9-a0e360fcfba2
Aug 01 16:05:03 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-5a56ac03-9d83-4376-b93d-04c487ec0b1a tempest-SnapshotDataIntegrityTests-1452624855 tempest-SnapshotDataIntegrityTests-1452624855-project-member] Lock "a5a2d1de-1be6-4310-95c9-a0e360fcfba2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.166s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:05:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:05:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:05:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:05:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:05:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:16 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690905901.3834643, a5a2d1de-1be6-4310-95c9-a0e360fcfba2 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:05:16 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] VM Stopped (Lifecycle Event)
Aug 01 16:05:16 user nova-compute[72201]: DEBUG nova.compute.manager [None req-7374e506-991b-4ad7-8176-81c9c2879fb5 None None] [instance: a5a2d1de-1be6-4310-95c9-a0e360fcfba2] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:05:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:35 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:05:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:37 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:05:37 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:05:37 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 16:05:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:05:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:05:37 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:05:37 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid baead5f8-a15c-4fe7-94ce-8221fdbbb7da {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:05:37 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Updating instance_info_cache with network_info: [{"id": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "address": "fa:16:3e:4d:95:77", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dc44f2d-59", "ovs_interfaceid": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:05:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:05:37 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:05:40 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:05:41 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:05:41 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:05:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:05:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:05:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:05:41 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:05:41 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:05:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:41 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:05:41 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:05:41 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8690MB free_disk=25.200759887695312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:05:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:05:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:05:41 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance baead5f8-a15c-4fe7-94ce-8221fdbbb7da actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:05:41 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:05:41 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:05:41 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:05:41 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:05:41 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:05:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:05:42 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:05:46 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:05:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:05:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:05:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:05:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:05:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:49 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:05:51 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:05:51 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:05:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:05:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:05:57 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:06:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:06:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:06:11 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:06:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:06:21 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:06:26 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:06:31 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:06:31 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72201) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 16:06:31 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:06:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:06:37 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:06:38 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:06:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:06:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 16:06:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:06:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:06:38 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:06:38 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid baead5f8-a15c-4fe7-94ce-8221fdbbb7da {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:06:38 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Updating instance_info_cache with network_info: [{"id": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "address": "fa:16:3e:4d:95:77", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dc44f2d-59", "ovs_interfaceid": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:06:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:06:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:06:40 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:06:40 user nova-compute[72201]: DEBUG nova.compute.manager [req-fe60c3f0-9c64-46d9-9070-bf5503aa50e3 req-79a8f6c1-f5fd-42bd-813e-41de397af2ba service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Received event network-changed-8dc44f2d-5980-4878-b3da-9a01f8d82b71 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:06:40 user nova-compute[72201]: DEBUG nova.compute.manager [req-fe60c3f0-9c64-46d9-9070-bf5503aa50e3 req-79a8f6c1-f5fd-42bd-813e-41de397af2ba service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Refreshing instance network info cache due to event network-changed-8dc44f2d-5980-4878-b3da-9a01f8d82b71. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:06:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-fe60c3f0-9c64-46d9-9070-bf5503aa50e3 req-79a8f6c1-f5fd-42bd-813e-41de397af2ba service nova] Acquiring lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:06:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-fe60c3f0-9c64-46d9-9070-bf5503aa50e3 req-79a8f6c1-f5fd-42bd-813e-41de397af2ba service nova] Acquired lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:06:40 user nova-compute[72201]: DEBUG nova.network.neutron [req-fe60c3f0-9c64-46d9-9070-bf5503aa50e3 req-79a8f6c1-f5fd-42bd-813e-41de397af2ba service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Refreshing network info cache for port 8dc44f2d-5980-4878-b3da-9a01f8d82b71 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:06:41 user nova-compute[72201]: DEBUG nova.network.neutron [req-fe60c3f0-9c64-46d9-9070-bf5503aa50e3 req-79a8f6c1-f5fd-42bd-813e-41de397af2ba service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Updated VIF entry in instance network info cache for port 8dc44f2d-5980-4878-b3da-9a01f8d82b71. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:06:41 user nova-compute[72201]: DEBUG nova.network.neutron [req-fe60c3f0-9c64-46d9-9070-bf5503aa50e3 req-79a8f6c1-f5fd-42bd-813e-41de397af2ba service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Updating instance_info_cache with network_info: [{"id": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "address": "fa:16:3e:4d:95:77", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dc44f2d-59", "ovs_interfaceid": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:06:41 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-fe60c3f0-9c64-46d9-9070-bf5503aa50e3 req-79a8f6c1-f5fd-42bd-813e-41de397af2ba service nova] Releasing lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:06:41 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:06:42 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:06:42 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:06:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:06:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:06:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:06:42 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:06:42 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:06:42 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:06:42 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:06:42 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8743MB free_disk=25.19925308227539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:06:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:06:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:06:42 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance baead5f8-a15c-4fe7-94ce-8221fdbbb7da actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:06:42 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:06:42 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:06:42 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing inventories for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 16:06:42 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating ProviderTree inventory for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 16:06:42 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating inventory in ProviderTree for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 16:06:43 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing aggregate associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, aggregates: None {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 16:06:43 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing trait associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 16:06:43 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:06:43 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:06:43 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:06:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:06:44 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:06:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:06:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:06:47 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:06:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:06:50 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG nova.compute.manager [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:06:51 user nova-compute[72201]: INFO nova.compute.claims [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Claim successful on node user
Aug 01 16:06:51 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG nova.compute.manager [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG nova.compute.manager [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG nova.network.neutron [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:06:51 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:06:51 user nova-compute[72201]: DEBUG nova.compute.manager [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:06:51 user nova-compute[72201]: INFO nova.virt.block_device [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Booting with volume 0e4ca799-105c-47c1-8095-5fa8e7484c65 at /dev/vda
Aug 01 16:06:51 user nova-compute[72201]: DEBUG nova.policy [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '222a94fd4bed425a8d80ba777c2361f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a49e4769bf348be8fedc8b70f65cea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG os_brick.utils [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bec70b-7730-48e4-b0cf-d712dfc2067e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[78af54f3-d099-4143-a377-d44451a7521e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[652ea003-778f-42a0-9b9d-23369421f961]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4c8c6c-bd1d-418c-937c-2929be883bc9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:06:51 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:06:51 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ff48df-7b71-4147-b398-98b59f0733b1]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG os_brick.utils [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:06:51 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Updating existing volume attachment record: 89464fe6-6e9c-48d0-8832-2bc7526f5881 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:06:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:06:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:06:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:06:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:06:53 user nova-compute[72201]: DEBUG nova.network.neutron [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Successfully created port: b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:06:53 user nova-compute[72201]: DEBUG nova.network.neutron [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Successfully updated port: b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:06:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "refresh_cache-d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:06:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquired lock "refresh_cache-d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:06:53 user nova-compute[72201]: DEBUG nova.network.neutron [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:06:54 user nova-compute[72201]: DEBUG nova.network.neutron [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:06:54 user nova-compute[72201]: DEBUG nova.compute.manager [req-3631f3f6-a50d-42dc-bffc-5dfc4d6c53ce req-59611b52-31f6-474c-9989-4097bf9ff7ff service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Received event network-changed-b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:06:54 user nova-compute[72201]: DEBUG nova.compute.manager [req-3631f3f6-a50d-42dc-bffc-5dfc4d6c53ce req-59611b52-31f6-474c-9989-4097bf9ff7ff service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Refreshing instance network info cache due to event network-changed-b90410d0-79db-4c33-b630-718df520bb1d. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:06:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3631f3f6-a50d-42dc-bffc-5dfc4d6c53ce req-59611b52-31f6-474c-9989-4097bf9ff7ff service nova] Acquiring lock "refresh_cache-d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:06:54 user nova-compute[72201]: DEBUG nova.network.neutron [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Updating instance_info_cache with network_info: [{"id": "b90410d0-79db-4c33-b630-718df520bb1d", "address": "fa:16:3e:59:77:88", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb90410d0-79", "ovs_interfaceid": "b90410d0-79db-4c33-b630-718df520bb1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:06:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Releasing lock "refresh_cache-d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:06:54 user nova-compute[72201]: DEBUG nova.compute.manager [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Instance network_info: |[{"id": "b90410d0-79db-4c33-b630-718df520bb1d", "address": "fa:16:3e:59:77:88", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb90410d0-79", "ovs_interfaceid": "b90410d0-79db-4c33-b630-718df520bb1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:06:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3631f3f6-a50d-42dc-bffc-5dfc4d6c53ce req-59611b52-31f6-474c-9989-4097bf9ff7ff service nova] Acquired lock "refresh_cache-d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:06:54 user nova-compute[72201]: DEBUG nova.network.neutron [req-3631f3f6-a50d-42dc-bffc-5dfc4d6c53ce req-59611b52-31f6-474c-9989-4097bf9ff7ff service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Refreshing network info cache for port b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:06:54 user nova-compute[72201]: DEBUG nova.network.neutron [req-3631f3f6-a50d-42dc-bffc-5dfc4d6c53ce req-59611b52-31f6-474c-9989-4097bf9ff7ff service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Updated VIF entry in instance network info cache for port b90410d0-79db-4c33-b630-718df520bb1d. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:06:54 user nova-compute[72201]: DEBUG nova.network.neutron [req-3631f3f6-a50d-42dc-bffc-5dfc4d6c53ce req-59611b52-31f6-474c-9989-4097bf9ff7ff service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Updating instance_info_cache with network_info: [{"id": "b90410d0-79db-4c33-b630-718df520bb1d", "address": "fa:16:3e:59:77:88", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb90410d0-79", "ovs_interfaceid": "b90410d0-79db-4c33-b630-718df520bb1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:06:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-3631f3f6-a50d-42dc-bffc-5dfc4d6c53ce req-59611b52-31f6-474c-9989-4097bf9ff7ff service nova] Releasing lock "refresh_cache-d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:06:56 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:06:56 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:06:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:01 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.compute.manager [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:07:04 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Creating image(s)
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Did not create local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Ensure instance console log exists: /opt/stack/data/nova/instances/d1c31750-d5e4-4542-8b1c-dfb1ef3be16c/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Start _get_guest_xml network_info=[{"id": "b90410d0-79db-4c33-b630-718df520bb1d", "address": "fa:16:3e:59:77:88", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb90410d0-79", "ovs_interfaceid": "b90410d0-79db-4c33-b630-718df520bb1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CHDuIWQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd1c31750-d5e4-4542-8b1c-dfb1ef3be16c', 'attached_at': '', 'detached_at': '', 'volume_id': '0e4ca799-105c-47c1-8095-5fa8e7484c65', 'serial': '0e4ca799-105c-47c1-8095-5fa8e7484c65'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '89464fe6-6e9c-48d0-8832-2bc7526f5881', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:07:04 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:07:04 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CHDuIWQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:07:04 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:07:04 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:07:04 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5d7db0-3242-4732-b4e7-4487d1aff18b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:07:04 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[512acacf-0c17-4430-8ddd-389780f9d158]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65] added
Aug 01 16:07:04 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83ec4ab-2140-4e21-ab48-5dd54c9f67d5]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.112s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[df51ad9d-6b46-42db-8b28-1c556e0cc04d]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CHDuIWQO {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CHDuIWQO" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd04740-d546-4cb2-b483-7d4f845568d2]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CHDuIWQO'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c92591-c256-4bc0-843a-dbaba7f0b747]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[743b532d-6d24-4dd8-9c02-87e3b6b9a5b7]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:07:04 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:07:04 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a4df47-26dd-4d06-ac68-008415a23d1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65, portal: 172.16.0.220,3260]
Aug 01 16:07:04 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65, portal: 172.16.0.220,3260] successful.
Aug 01 16:07:04 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae7f8e8-d36b-46b9-9689-090c0de10221]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bc2cb7-5530-48a4-8cf7-172562596cc8]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:07:04 user nova-compute[72201]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 (non-flash)
Aug 01 16:07:04 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:07:04 user nova-compute[72201]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 (non-flash)
Aug 01 16:07:04 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] HCTL ('34', '-', '-', 0) found on session 62 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eae28c6-dde4-488d-ab01-0bcd19f6d144]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:07:04 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: None {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CHDuIWQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23966363531373066', 'path': '/dev/sdc'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966363531373066', 'path': '/dev/sdc'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2052575246',display_name='tempest-TestVolumeBootPattern-server-2052575246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2052575246',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRfjK9mfMZECkiNZS+WvmmHxqcLD3Bp/k3VJTkM9GOR5ve6M3pZuKsANEYec+jLTwfqzqMZWoeJ6cNgc2ItQC8bULCPj1V4+xbFRpB7985q2k/9hGKp8rI4LhVLHyjBRw==',key_name='tempest-TestVolumeBootPattern-1356630349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a49e4769bf348be8fedc8b70f65cea2',ramdisk_id='',reservation_id='r-9iob2i20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1110722165',owner_user_name='tempest-TestVolumeBootPattern-1110722165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:06:52Z,user_data=None,user_id='222a94fd4bed425a8d80ba777c2361f0',uuid=d1c31750-d5e4-4542-8b1c-dfb1ef3be16c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b90410d0-79db-4c33-b630-718df520bb1d", "address": "fa:16:3e:59:77:88", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb90410d0-79", "ovs_interfaceid": "b90410d0-79db-4c33-b630-718df520bb1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converting VIF {"id": "b90410d0-79db-4c33-b630-718df520bb1d", "address": "fa:16:3e:59:77:88", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb90410d0-79", "ovs_interfaceid": "b90410d0-79db-4c33-b630-718df520bb1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:77:88,bridge_name='br-int',has_traffic_filtering=True,id=b90410d0-79db-4c33-b630-718df520bb1d,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb90410d0-79') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG nova.objects.instance [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lazy-loading 'pci_devices' on Instance uuid d1c31750-d5e4-4542-8b1c-dfb1ef3be16c {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:07:05 user nova-compute[72201]:   <uuid>d1c31750-d5e4-4542-8b1c-dfb1ef3be16c</uuid>
Aug 01 16:07:05 user nova-compute[72201]:   <name>instance-00000033</name>
Aug 01 16:07:05 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 16:07:05 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 16:07:05 user nova-compute[72201]:   <metadata>
Aug 01 16:07:05 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:07:05 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 16:07:05 user nova-compute[72201]:       <nova:name>tempest-TestVolumeBootPattern-server-2052575246</nova:name>
Aug 01 16:07:05 user nova-compute[72201]:       <nova:creationTime>2023-08-01 16:07:04</nova:creationTime>
Aug 01 16:07:05 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 16:07:05 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 16:07:05 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 16:07:05 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 16:07:05 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:07:05 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:07:05 user nova-compute[72201]:       </nova:flavor>
Aug 01 16:07:05 user nova-compute[72201]:       <nova:owner>
Aug 01 16:07:05 user nova-compute[72201]:         <nova:user uuid="222a94fd4bed425a8d80ba777c2361f0">tempest-TestVolumeBootPattern-1110722165-project-member</nova:user>
Aug 01 16:07:05 user nova-compute[72201]:         <nova:project uuid="3a49e4769bf348be8fedc8b70f65cea2">tempest-TestVolumeBootPattern-1110722165</nova:project>
Aug 01 16:07:05 user nova-compute[72201]:       </nova:owner>
Aug 01 16:07:05 user nova-compute[72201]:       <nova:ports>
Aug 01 16:07:05 user nova-compute[72201]:         <nova:port uuid="b90410d0-79db-4c33-b630-718df520bb1d">
Aug 01 16:07:05 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 16:07:05 user nova-compute[72201]:         </nova:port>
Aug 01 16:07:05 user nova-compute[72201]:       </nova:ports>
Aug 01 16:07:05 user nova-compute[72201]:     </nova:instance>
Aug 01 16:07:05 user nova-compute[72201]:   </metadata>
Aug 01 16:07:05 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 16:07:05 user nova-compute[72201]:     <system>
Aug 01 16:07:05 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:07:05 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:07:05 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 16:07:05 user nova-compute[72201]:       <entry name="serial">d1c31750-d5e4-4542-8b1c-dfb1ef3be16c</entry>
Aug 01 16:07:05 user nova-compute[72201]:       <entry name="uuid">d1c31750-d5e4-4542-8b1c-dfb1ef3be16c</entry>
Aug 01 16:07:05 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:07:05 user nova-compute[72201]:     </system>
Aug 01 16:07:05 user nova-compute[72201]:   </sysinfo>
Aug 01 16:07:05 user nova-compute[72201]:   <os>
Aug 01 16:07:05 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:07:05 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 16:07:05 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 16:07:05 user nova-compute[72201]:   </os>
Aug 01 16:07:05 user nova-compute[72201]:   <features>
Aug 01 16:07:05 user nova-compute[72201]:     <acpi/>
Aug 01 16:07:05 user nova-compute[72201]:     <apic/>
Aug 01 16:07:05 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 16:07:05 user nova-compute[72201]:   </features>
Aug 01 16:07:05 user nova-compute[72201]:   <clock offset="utc">
Aug 01 16:07:05 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:07:05 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:07:05 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 16:07:05 user nova-compute[72201]:   </clock>
Aug 01 16:07:05 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 16:07:05 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 16:07:05 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:07:05 user nova-compute[72201]:   </cpu>
Aug 01 16:07:05 user nova-compute[72201]:   <devices>
Aug 01 16:07:05 user nova-compute[72201]:     <disk type="block" device="disk">
Aug 01 16:07:05 user nova-compute[72201]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:07:05 user nova-compute[72201]:       <source dev="/dev/sdc"/>
Aug 01 16:07:05 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 16:07:05 user nova-compute[72201]:       <serial>0e4ca799-105c-47c1-8095-5fa8e7484c65</serial>
Aug 01 16:07:05 user nova-compute[72201]:     </disk>
Aug 01 16:07:05 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 16:07:05 user nova-compute[72201]:       <mac address="fa:16:3e:59:77:88"/>
Aug 01 16:07:05 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 16:07:05 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 16:07:05 user nova-compute[72201]:       <target dev="tapb90410d0-79"/>
Aug 01 16:07:05 user nova-compute[72201]:     </interface>
Aug 01 16:07:05 user nova-compute[72201]:     <serial type="pty">
Aug 01 16:07:05 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/d1c31750-d5e4-4542-8b1c-dfb1ef3be16c/console.log" append="off"/>
Aug 01 16:07:05 user nova-compute[72201]:     </serial>
Aug 01 16:07:05 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:07:05 user nova-compute[72201]:     <video>
Aug 01 16:07:05 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 16:07:05 user nova-compute[72201]:     </video>
Aug 01 16:07:05 user nova-compute[72201]:     <rng model="virtio">
Aug 01 16:07:05 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:07:05 user nova-compute[72201]:     </rng>
Aug 01 16:07:05 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:07:05 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 16:07:05 user nova-compute[72201]:       <stats period="10"/>
Aug 01 16:07:05 user nova-compute[72201]:     </memballoon>
Aug 01 16:07:05 user nova-compute[72201]:   </devices>
Aug 01 16:07:05 user nova-compute[72201]: </domain>
Aug 01 16:07:05 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2052575246',display_name='tempest-TestVolumeBootPattern-server-2052575246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2052575246',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRfjK9mfMZECkiNZS+WvmmHxqcLD3Bp/k3VJTkM9GOR5ve6M3pZuKsANEYec+jLTwfqzqMZWoeJ6cNgc2ItQC8bULCPj1V4+xbFRpB7985q2k/9hGKp8rI4LhVLHyjBRw==',key_name='tempest-TestVolumeBootPattern-1356630349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a49e4769bf348be8fedc8b70f65cea2',ramdisk_id='',reservation_id='r-9iob2i20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1110722165',owner_user_name='tempest-TestVolumeBootPattern-1110722165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:06:52Z,user_data=None,user_id='222a94fd4bed425a8d80ba777c2361f0',uuid=d1c31750-d5e4-4542-8b1c-dfb1ef3be16c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b90410d0-79db-4c33-b630-718df520bb1d", "address": "fa:16:3e:59:77:88", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb90410d0-79", "ovs_interfaceid": "b90410d0-79db-4c33-b630-718df520bb1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converting VIF {"id": "b90410d0-79db-4c33-b630-718df520bb1d", "address": "fa:16:3e:59:77:88", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb90410d0-79", "ovs_interfaceid": "b90410d0-79db-4c33-b630-718df520bb1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:77:88,bridge_name='br-int',has_traffic_filtering=True,id=b90410d0-79db-4c33-b630-718df520bb1d,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb90410d0-79') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG os_vif [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:77:88,bridge_name='br-int',has_traffic_filtering=True,id=b90410d0-79db-4c33-b630-718df520bb1d,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb90410d0-79') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb90410d0-79, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb90410d0-79, col_values=(('external_ids', {'iface-id': 'b90410d0-79db-4c33-b630-718df520bb1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:77:88', 'vm-uuid': 'd1c31750-d5e4-4542-8b1c-dfb1ef3be16c'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:05 user nova-compute[72201]: INFO os_vif [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:77:88,bridge_name='br-int',has_traffic_filtering=True,id=b90410d0-79db-4c33-b630-718df520bb1d,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb90410d0-79')
Aug 01 16:07:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:07:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] No VIF found with MAC fa:16:3e:59:77:88, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:07:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:06 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-aaaa7446-a3d8-4d62-8382-8f9119a8b9b6 req-20d90b0a-05ef-446c-abda-bdb960f197c2 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Received event network-vif-plugged-b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:07:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-aaaa7446-a3d8-4d62-8382-8f9119a8b9b6 req-20d90b0a-05ef-446c-abda-bdb960f197c2 service nova] Acquiring lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:07:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-aaaa7446-a3d8-4d62-8382-8f9119a8b9b6 req-20d90b0a-05ef-446c-abda-bdb960f197c2 service nova] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:07:07 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-aaaa7446-a3d8-4d62-8382-8f9119a8b9b6 req-20d90b0a-05ef-446c-abda-bdb960f197c2 service nova] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:07:07 user nova-compute[72201]: DEBUG nova.compute.manager [req-aaaa7446-a3d8-4d62-8382-8f9119a8b9b6 req-20d90b0a-05ef-446c-abda-bdb960f197c2 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] No waiting events found dispatching network-vif-plugged-b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:07:07 user nova-compute[72201]: WARNING nova.compute.manager [req-aaaa7446-a3d8-4d62-8382-8f9119a8b9b6 req-20d90b0a-05ef-446c-abda-bdb960f197c2 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Received unexpected event network-vif-plugged-b90410d0-79db-4c33-b630-718df520bb1d for instance with vm_state building and task_state spawning.
Aug 01 16:07:07 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:09 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690906029.0157373, d1c31750-d5e4-4542-8b1c-dfb1ef3be16c => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:07:09 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] VM Resumed (Lifecycle Event)
Aug 01 16:07:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:07:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:07:09 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Instance spawned successfully.
Aug 01 16:07:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:07:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:07:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:07:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:07:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:07:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:07:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:07:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:07:09 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:07:09 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:07:09 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690906029.01977, d1c31750-d5e4-4542-8b1c-dfb1ef3be16c => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:07:09 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] VM Started (Lifecycle Event)
Aug 01 16:07:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:07:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:07:09 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:07:09 user nova-compute[72201]: INFO nova.compute.manager [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Took 4.97 seconds to spawn the instance on the hypervisor.
Aug 01 16:07:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:07:09 user nova-compute[72201]: INFO nova.compute.manager [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Took 17.91 seconds to build instance.
Aug 01 16:07:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-44be803d-dc48-4e1f-9003-be784ed894f6 req-34f4b689-9192-4e20-9a54-744769ae0482 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Received event network-vif-plugged-b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:07:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-44be803d-dc48-4e1f-9003-be784ed894f6 req-34f4b689-9192-4e20-9a54-744769ae0482 service nova] Acquiring lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:07:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-44be803d-dc48-4e1f-9003-be784ed894f6 req-34f4b689-9192-4e20-9a54-744769ae0482 service nova] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:07:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-44be803d-dc48-4e1f-9003-be784ed894f6 req-34f4b689-9192-4e20-9a54-744769ae0482 service nova] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:07:09 user nova-compute[72201]: DEBUG nova.compute.manager [req-44be803d-dc48-4e1f-9003-be784ed894f6 req-34f4b689-9192-4e20-9a54-744769ae0482 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] No waiting events found dispatching network-vif-plugged-b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:07:09 user nova-compute[72201]: WARNING nova.compute.manager [req-44be803d-dc48-4e1f-9003-be784ed894f6 req-34f4b689-9192-4e20-9a54-744769ae0482 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Received unexpected event network-vif-plugged-b90410d0-79db-4c33-b630-718df520bb1d for instance with vm_state active and task_state None.
Aug 01 16:07:09 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-caa39a51-e4cd-4f55-9d8b-ab67b9b2f005 tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:07:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:17 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:07:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 16:07:17 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] There are 0 instances to clean {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 16:07:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:34 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:07:34 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid baead5f8-a15c-4fe7-94ce-8221fdbbb7da {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 16:07:34 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid d1c31750-d5e4-4542-8b1c-dfb1ef3be16c {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 16:07:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:07:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:07:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:07:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:07:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:07:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:07:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:38 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:07:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:07:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 16:07:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:07:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:07:38 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:07:38 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid baead5f8-a15c-4fe7-94ce-8221fdbbb7da {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:07:38 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Updating instance_info_cache with network_info: [{"id": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "address": "fa:16:3e:4d:95:77", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dc44f2d-59", "ovs_interfaceid": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:07:38 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:07:38 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:07:39 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:07:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:42 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:07:43 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:07:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:07:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:07:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:07:43 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:07:43 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:07:43 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:07:43 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:07:43 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:07:43 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8627MB free_disk=25.197437286376953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:07:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:07:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:07:43 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance baead5f8-a15c-4fe7-94ce-8221fdbbb7da actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:07:43 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance d1c31750-d5e4-4542-8b1c-dfb1ef3be16c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:07:43 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:07:43 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:07:43 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:07:43 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:07:43 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:07:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:07:44 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:07:44 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:07:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:07:47 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:07:50 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:07:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:07:55 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:07:55 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:07:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:08:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:08:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:39 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:08:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:08:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:08:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:08:39 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:08:39 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Updating instance_info_cache with network_info: [{"id": "b90410d0-79db-4c33-b630-718df520bb1d", "address": "fa:16:3e:59:77:88", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb90410d0-79", "ovs_interfaceid": "b90410d0-79db-4c33-b630-718df520bb1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:08:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:08:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:08:39 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:08:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:08:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-e35cd4e5-4b60-4b97-850d-fe8d7d0bab29 req-f1e4b379-5d48-485a-a6d4-feb3de57f07e service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Received event network-changed-b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:08:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-e35cd4e5-4b60-4b97-850d-fe8d7d0bab29 req-f1e4b379-5d48-485a-a6d4-feb3de57f07e service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Refreshing instance network info cache due to event network-changed-b90410d0-79db-4c33-b630-718df520bb1d. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:08:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e35cd4e5-4b60-4b97-850d-fe8d7d0bab29 req-f1e4b379-5d48-485a-a6d4-feb3de57f07e service nova] Acquiring lock "refresh_cache-d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:08:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e35cd4e5-4b60-4b97-850d-fe8d7d0bab29 req-f1e4b379-5d48-485a-a6d4-feb3de57f07e service nova] Acquired lock "refresh_cache-d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:08:43 user nova-compute[72201]: DEBUG nova.network.neutron [req-e35cd4e5-4b60-4b97-850d-fe8d7d0bab29 req-f1e4b379-5d48-485a-a6d4-feb3de57f07e service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Refreshing network info cache for port b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:08:43 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:08:43 user nova-compute[72201]: DEBUG nova.network.neutron [req-e35cd4e5-4b60-4b97-850d-fe8d7d0bab29 req-f1e4b379-5d48-485a-a6d4-feb3de57f07e service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Updated VIF entry in instance network info cache for port b90410d0-79db-4c33-b630-718df520bb1d. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:08:43 user nova-compute[72201]: DEBUG nova.network.neutron [req-e35cd4e5-4b60-4b97-850d-fe8d7d0bab29 req-f1e4b379-5d48-485a-a6d4-feb3de57f07e service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Updating instance_info_cache with network_info: [{"id": "b90410d0-79db-4c33-b630-718df520bb1d", "address": "fa:16:3e:59:77:88", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb90410d0-79", "ovs_interfaceid": "b90410d0-79db-4c33-b630-718df520bb1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:08:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e35cd4e5-4b60-4b97-850d-fe8d7d0bab29 req-f1e4b379-5d48-485a-a6d4-feb3de57f07e service nova] Releasing lock "refresh_cache-d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-01c2c437-72af-4438-8b22-16b003514f39 req-2505bb54-0daa-41e7-9be3-c676d6d95c6a service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Received event network-changed-b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG nova.compute.manager [req-01c2c437-72af-4438-8b22-16b003514f39 req-2505bb54-0daa-41e7-9be3-c676d6d95c6a service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Refreshing instance network info cache due to event network-changed-b90410d0-79db-4c33-b630-718df520bb1d. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-01c2c437-72af-4438-8b22-16b003514f39 req-2505bb54-0daa-41e7-9be3-c676d6d95c6a service nova] Acquiring lock "refresh_cache-d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-01c2c437-72af-4438-8b22-16b003514f39 req-2505bb54-0daa-41e7-9be3-c676d6d95c6a service nova] Acquired lock "refresh_cache-d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG nova.network.neutron [req-01c2c437-72af-4438-8b22-16b003514f39 req-2505bb54-0daa-41e7-9be3-c676d6d95c6a service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Refreshing network info cache for port b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:44 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:08:44 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:08:44 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8683MB free_disk=25.196727752685547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:08:44 user nova-compute[72201]: INFO nova.compute.manager [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Terminating instance
Aug 01 16:08:44 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance baead5f8-a15c-4fe7-94ce-8221fdbbb7da actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance d1c31750-d5e4-4542-8b1c-dfb1ef3be16c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:08:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG nova.network.neutron [req-01c2c437-72af-4438-8b22-16b003514f39 req-2505bb54-0daa-41e7-9be3-c676d6d95c6a service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Updated VIF entry in instance network info cache for port b90410d0-79db-4c33-b630-718df520bb1d. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG nova.network.neutron [req-01c2c437-72af-4438-8b22-16b003514f39 req-2505bb54-0daa-41e7-9be3-c676d6d95c6a service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Updating instance_info_cache with network_info: [{"id": "b90410d0-79db-4c33-b630-718df520bb1d", "address": "fa:16:3e:59:77:88", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb90410d0-79", "ovs_interfaceid": "b90410d0-79db-4c33-b630-718df520bb1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-01c2c437-72af-4438-8b22-16b003514f39 req-2505bb54-0daa-41e7-9be3-c676d6d95c6a service nova] Releasing lock "refresh_cache-d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:45 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Instance destroyed successfully.
Aug 01 16:08:45 user nova-compute[72201]: DEBUG nova.objects.instance [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lazy-loading 'resources' on Instance uuid d1c31750-d5e4-4542-8b1c-dfb1ef3be16c {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2052575246',display_name='tempest-TestVolumeBootPattern-server-2052575246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2052575246',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRfjK9mfMZECkiNZS+WvmmHxqcLD3Bp/k3VJTkM9GOR5ve6M3pZuKsANEYec+jLTwfqzqMZWoeJ6cNgc2ItQC8bULCPj1V4+xbFRpB7985q2k/9hGKp8rI4LhVLHyjBRw==',key_name='tempest-TestVolumeBootPattern-1356630349',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:07:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a49e4769bf348be8fedc8b70f65cea2',ramdisk_id='',reservation_id='r-9iob2i20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1110722165',owner_user_name='tempest-TestVolumeBootPattern-1110722165-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:07:09Z,user_data=None,user_id='222a94fd4bed425a8d80ba777c2361f0',uuid=d1c31750-d5e4-4542-8b1c-dfb1ef3be16c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b90410d0-79db-4c33-b630-718df520bb1d", "address": "fa:16:3e:59:77:88", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb90410d0-79", "ovs_interfaceid": "b90410d0-79db-4c33-b630-718df520bb1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converting VIF {"id": "b90410d0-79db-4c33-b630-718df520bb1d", "address": "fa:16:3e:59:77:88", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb90410d0-79", "ovs_interfaceid": "b90410d0-79db-4c33-b630-718df520bb1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:77:88,bridge_name='br-int',has_traffic_filtering=True,id=b90410d0-79db-4c33-b630-718df520bb1d,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb90410d0-79') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG os_vif [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:77:88,bridge_name='br-int',has_traffic_filtering=True,id=b90410d0-79db-4c33-b630-718df520bb1d,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb90410d0-79') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb90410d0-79, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:45 user nova-compute[72201]: INFO os_vif [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:77:88,bridge_name='br-int',has_traffic_filtering=True,id=b90410d0-79db-4c33-b630-718df520bb1d,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb90410d0-79')
Aug 01 16:08:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CHDuIWQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:08:45 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:08:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3750eb31-101f-452c-892f-cc42378cd917]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5cec6f-0d60-4b22-865d-624ed6d7cceb]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:08:45 user nova-compute[72201]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 (non-flash)
Aug 01 16:08:45 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:08:45 user nova-compute[72201]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 (non-flash)
Aug 01 16:08:45 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc52c6dc430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65'): ({'sdc'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Removing single pathed devices sdc {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[916f18de-2e6a-494e-8f40-9413a3799186]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b275fe5-042b-4ae4-922e-ba5d3351506a]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Flushing IO for device /dev/sdc {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0a0cdb-64c3-433a-b6b7-7fe223ddf9de]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9e7a45-1453-4bfc-8de8-30c8a768cb22]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] SCSI volumes sdc have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23966363531373066', '/dev/disk/by-id/scsi-1SCST_BIO8811b9da-9f65170fa43bb76b', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8811b9da') {{(pid=83290) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e0ae51-a006-4134-aeef-39d5acb18891]: (4, None) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfb2afd-0af5-40fa-a9de-62105f1fb298]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbbbc85-062e-4c49-8819-164649b5fd2d]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65, portal: 172.16.0.220,3260]
Aug 01 16:08:45 user nova-compute[72201]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65, portal: 172.16.0.220,3260] successful.
Aug 01 16:08:45 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4ca799-105c-47c1-8095-5fa8e7484c65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edf20a4-f390-47ef-af44-5abf134e6d96]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] <== disconnect_volume: return (317ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:08:45 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Deleting instance files /opt/stack/data/nova/instances/d1c31750-d5e4-4542-8b1c-dfb1ef3be16c_del
Aug 01 16:08:45 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Deletion of /opt/stack/data/nova/instances/d1c31750-d5e4-4542-8b1c-dfb1ef3be16c_del complete
Aug 01 16:08:45 user nova-compute[72201]: INFO nova.compute.manager [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 01 16:08:45 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 16:08:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:46 user nova-compute[72201]: DEBUG nova.compute.manager [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Received event network-vif-unplugged-b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:08:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] Acquiring lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:08:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:08:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:08:46 user nova-compute[72201]: DEBUG nova.compute.manager [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] No waiting events found dispatching network-vif-unplugged-b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:08:46 user nova-compute[72201]: DEBUG nova.compute.manager [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Received event network-vif-unplugged-b90410d0-79db-4c33-b630-718df520bb1d for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:08:46 user nova-compute[72201]: DEBUG nova.compute.manager [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Received event network-vif-plugged-b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:08:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] Acquiring lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:08:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:08:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:08:46 user nova-compute[72201]: DEBUG nova.compute.manager [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] No waiting events found dispatching network-vif-plugged-b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:08:46 user nova-compute[72201]: WARNING nova.compute.manager [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Received unexpected event network-vif-plugged-b90410d0-79db-4c33-b630-718df520bb1d for instance with vm_state active and task_state deleting.
Aug 01 16:08:46 user nova-compute[72201]: DEBUG nova.compute.manager [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Received event network-vif-plugged-b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:08:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] Acquiring lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:08:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:08:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:08:46 user nova-compute[72201]: DEBUG nova.compute.manager [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] No waiting events found dispatching network-vif-plugged-b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:08:46 user nova-compute[72201]: WARNING nova.compute.manager [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Received unexpected event network-vif-plugged-b90410d0-79db-4c33-b630-718df520bb1d for instance with vm_state active and task_state deleting.
Aug 01 16:08:46 user nova-compute[72201]: DEBUG nova.compute.manager [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Received event network-vif-plugged-b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:08:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] Acquiring lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:08:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:08:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:08:46 user nova-compute[72201]: DEBUG nova.compute.manager [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] No waiting events found dispatching network-vif-plugged-b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:08:46 user nova-compute[72201]: WARNING nova.compute.manager [req-c61a3432-44aa-40a0-9cb8-eba49d1146aa req-ddd8f6f6-d6c7-4756-bc56-6b48ae3550f3 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Received unexpected event network-vif-plugged-b90410d0-79db-4c33-b630-718df520bb1d for instance with vm_state active and task_state deleting.
Aug 01 16:08:47 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:08:47 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Took 1.40 seconds to deallocate network for instance.
Aug 01 16:08:48 user nova-compute[72201]: INFO nova.compute.manager [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Took 0.73 seconds to detach 1 volumes for instance.
Aug 01 16:08:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:08:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:08:48 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:08:48 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:08:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:08:48 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Deleted allocations for instance d1c31750-d5e4-4542-8b1c-dfb1ef3be16c
Aug 01 16:08:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-4d372b94-d109-4690-8bfd-72e4a385bd0e tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.665s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:08:48 user nova-compute[72201]: DEBUG nova.compute.manager [req-97b79829-9f3c-42b5-a84b-bb4ff1ca2941 req-a2fab86d-1177-4a60-a59e-040a2d4bec61 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Received event network-vif-unplugged-b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:08:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-97b79829-9f3c-42b5-a84b-bb4ff1ca2941 req-a2fab86d-1177-4a60-a59e-040a2d4bec61 service nova] Acquiring lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:08:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-97b79829-9f3c-42b5-a84b-bb4ff1ca2941 req-a2fab86d-1177-4a60-a59e-040a2d4bec61 service nova] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:08:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-97b79829-9f3c-42b5-a84b-bb4ff1ca2941 req-a2fab86d-1177-4a60-a59e-040a2d4bec61 service nova] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:08:48 user nova-compute[72201]: DEBUG nova.compute.manager [req-97b79829-9f3c-42b5-a84b-bb4ff1ca2941 req-a2fab86d-1177-4a60-a59e-040a2d4bec61 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] No waiting events found dispatching network-vif-unplugged-b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:08:48 user nova-compute[72201]: WARNING nova.compute.manager [req-97b79829-9f3c-42b5-a84b-bb4ff1ca2941 req-a2fab86d-1177-4a60-a59e-040a2d4bec61 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Received unexpected event network-vif-unplugged-b90410d0-79db-4c33-b630-718df520bb1d for instance with vm_state deleted and task_state None.
Aug 01 16:08:48 user nova-compute[72201]: DEBUG nova.compute.manager [req-97b79829-9f3c-42b5-a84b-bb4ff1ca2941 req-a2fab86d-1177-4a60-a59e-040a2d4bec61 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Received event network-vif-plugged-b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:08:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-97b79829-9f3c-42b5-a84b-bb4ff1ca2941 req-a2fab86d-1177-4a60-a59e-040a2d4bec61 service nova] Acquiring lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:08:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-97b79829-9f3c-42b5-a84b-bb4ff1ca2941 req-a2fab86d-1177-4a60-a59e-040a2d4bec61 service nova] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:08:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-97b79829-9f3c-42b5-a84b-bb4ff1ca2941 req-a2fab86d-1177-4a60-a59e-040a2d4bec61 service nova] Lock "d1c31750-d5e4-4542-8b1c-dfb1ef3be16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:08:48 user nova-compute[72201]: DEBUG nova.compute.manager [req-97b79829-9f3c-42b5-a84b-bb4ff1ca2941 req-a2fab86d-1177-4a60-a59e-040a2d4bec61 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] No waiting events found dispatching network-vif-plugged-b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:08:48 user nova-compute[72201]: WARNING nova.compute.manager [req-97b79829-9f3c-42b5-a84b-bb4ff1ca2941 req-a2fab86d-1177-4a60-a59e-040a2d4bec61 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Received unexpected event network-vif-plugged-b90410d0-79db-4c33-b630-718df520bb1d for instance with vm_state deleted and task_state None.
Aug 01 16:08:48 user nova-compute[72201]: DEBUG nova.compute.manager [req-97b79829-9f3c-42b5-a84b-bb4ff1ca2941 req-a2fab86d-1177-4a60-a59e-040a2d4bec61 service nova] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Received event network-vif-deleted-b90410d0-79db-4c33-b630-718df520bb1d {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:08:49 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:08:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:08:51 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:08:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:08:57 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:08:57 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:08:59 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:09:00 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690906125.402848, d1c31750-d5e4-4542-8b1c-dfb1ef3be16c => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:09:00 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] VM Stopped (Lifecycle Event)
Aug 01 16:09:00 user nova-compute[72201]: DEBUG nova.compute.manager [None req-52a5461c-f649-48c4-88d8-d151e433a29c None None] [instance: d1c31750-d5e4-4542-8b1c-dfb1ef3be16c] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:09:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:09:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:09:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:09:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:09:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:09:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:09:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:09:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:09:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:09:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:09:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:09:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:09:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:09:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:09:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:09:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:09:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:09:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:09:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:09:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:09:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:09:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:09:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:09:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:09:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:09:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:09:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:09:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:09:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:09:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:09:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:09:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:09:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:09:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:09:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:09:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:09:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:09:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:09:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:40 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:09:40 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:09:40 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 16:09:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:09:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:09:40 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:09:40 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid baead5f8-a15c-4fe7-94ce-8221fdbbb7da {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:09:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:09:40 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Updating instance_info_cache with network_info: [{"id": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "address": "fa:16:3e:4d:95:77", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dc44f2d-59", "ovs_interfaceid": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:09:40 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:09:40 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:09:41 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:09:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:42 user nova-compute[72201]: DEBUG nova.compute.manager [req-1de5906c-be7a-4eb1-b5d8-7bdbc16636be req-3ed9c87d-cbce-400f-80fd-1a90ebe642ea service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Received event network-changed-8dc44f2d-5980-4878-b3da-9a01f8d82b71 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:09:42 user nova-compute[72201]: DEBUG nova.compute.manager [req-1de5906c-be7a-4eb1-b5d8-7bdbc16636be req-3ed9c87d-cbce-400f-80fd-1a90ebe642ea service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Refreshing instance network info cache due to event network-changed-8dc44f2d-5980-4878-b3da-9a01f8d82b71. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:09:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1de5906c-be7a-4eb1-b5d8-7bdbc16636be req-3ed9c87d-cbce-400f-80fd-1a90ebe642ea service nova] Acquiring lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:09:42 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1de5906c-be7a-4eb1-b5d8-7bdbc16636be req-3ed9c87d-cbce-400f-80fd-1a90ebe642ea service nova] Acquired lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:09:42 user nova-compute[72201]: DEBUG nova.network.neutron [req-1de5906c-be7a-4eb1-b5d8-7bdbc16636be req-3ed9c87d-cbce-400f-80fd-1a90ebe642ea service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Refreshing network info cache for port 8dc44f2d-5980-4878-b3da-9a01f8d82b71 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:09:43 user nova-compute[72201]: INFO nova.compute.manager [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Terminating instance
Aug 01 16:09:43 user nova-compute[72201]: DEBUG nova.compute.manager [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-f7db4756-2d68-4411-9991-bc812a217ed9 req-9a77a7cf-4d11-4bcd-a99e-a1fe3a716954 service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Received event network-vif-unplugged-8dc44f2d-5980-4878-b3da-9a01f8d82b71 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f7db4756-2d68-4411-9991-bc812a217ed9 req-9a77a7cf-4d11-4bcd-a99e-a1fe3a716954 service nova] Acquiring lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f7db4756-2d68-4411-9991-bc812a217ed9 req-9a77a7cf-4d11-4bcd-a99e-a1fe3a716954 service nova] Lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-f7db4756-2d68-4411-9991-bc812a217ed9 req-9a77a7cf-4d11-4bcd-a99e-a1fe3a716954 service nova] Lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-f7db4756-2d68-4411-9991-bc812a217ed9 req-9a77a7cf-4d11-4bcd-a99e-a1fe3a716954 service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] No waiting events found dispatching network-vif-unplugged-8dc44f2d-5980-4878-b3da-9a01f8d82b71 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG nova.compute.manager [req-f7db4756-2d68-4411-9991-bc812a217ed9 req-9a77a7cf-4d11-4bcd-a99e-a1fe3a716954 service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Received event network-vif-unplugged-8dc44f2d-5980-4878-b3da-9a01f8d82b71 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG nova.network.neutron [req-1de5906c-be7a-4eb1-b5d8-7bdbc16636be req-3ed9c87d-cbce-400f-80fd-1a90ebe642ea service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Updated VIF entry in instance network info cache for port 8dc44f2d-5980-4878-b3da-9a01f8d82b71. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG nova.network.neutron [req-1de5906c-be7a-4eb1-b5d8-7bdbc16636be req-3ed9c87d-cbce-400f-80fd-1a90ebe642ea service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Updating instance_info_cache with network_info: [{"id": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "address": "fa:16:3e:4d:95:77", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dc44f2d-59", "ovs_interfaceid": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-1de5906c-be7a-4eb1-b5d8-7bdbc16636be req-3ed9c87d-cbce-400f-80fd-1a90ebe642ea service nova] Releasing lock "refresh_cache-baead5f8-a15c-4fe7-94ce-8221fdbbb7da" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:43 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Instance destroyed successfully.
Aug 01 16:09:43 user nova-compute[72201]: DEBUG nova.objects.instance [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lazy-loading 'resources' on Instance uuid baead5f8-a15c-4fe7-94ce-8221fdbbb7da {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1612178196',display_name='tempest-TestVolumeBootPattern-server-1612178196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1612178196',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRfjK9mfMZECkiNZS+WvmmHxqcLD3Bp/k3VJTkM9GOR5ve6M3pZuKsANEYec+jLTwfqzqMZWoeJ6cNgc2ItQC8bULCPj1V4+xbFRpB7985q2k/9hGKp8rI4LhVLHyjBRw==',key_name='tempest-TestVolumeBootPattern-1356630349',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:05:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a49e4769bf348be8fedc8b70f65cea2',ramdisk_id='',reservation_id='r-23ui0r3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1110722165',owner_user_name='tempest-TestVolumeBootPattern-1110722165-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:05:01Z,user_data=None,user_id='222a94fd4bed425a8d80ba777c2361f0',uuid=baead5f8-a15c-4fe7-94ce-8221fdbbb7da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "address": "fa:16:3e:4d:95:77", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dc44f2d-59", "ovs_interfaceid": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converting VIF {"id": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "address": "fa:16:3e:4d:95:77", "network": {"id": "17526af7-bf2a-428c-9eef-1e1c7652067d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1981468581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a49e4769bf348be8fedc8b70f65cea2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dc44f2d-59", "ovs_interfaceid": "8dc44f2d-5980-4878-b3da-9a01f8d82b71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:95:77,bridge_name='br-int',has_traffic_filtering=True,id=8dc44f2d-5980-4878-b3da-9a01f8d82b71,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dc44f2d-59') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG os_vif [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:95:77,bridge_name='br-int',has_traffic_filtering=True,id=8dc44f2d-5980-4878-b3da-9a01f8d82b71,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dc44f2d-59') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8dc44f2d-59, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:09:43 user nova-compute[72201]: INFO os_vif [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:95:77,bridge_name='br-int',has_traffic_filtering=True,id=8dc44f2d-5980-4878-b3da-9a01f8d82b71,network=Network(17526af7-bf2a-428c-9eef-1e1c7652067d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dc44f2d-59')
Aug 01 16:09:43 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWGzqwcv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:09:43 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:09:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f93f0c-cd21-4b0e-9eb7-82ff8958140e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b84f4a-0652-490e-b7e4-b1351283d71c]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:09:43 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f (non-flash)
Aug 01 16:09:43 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc52c69cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f'): ({'sdb'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Removing single pathed devices sdb {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc4fb09-1d60-4286-8e73-44cdd5043448]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b06a6e-a4d8-4b37-b75c-e96ed2e6a647]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Flushing IO for device /dev/sdb {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[16061280-eee7-4534-b0fd-b8dcad991d8d]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:09:43 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb26048d-2c11-4f57-8175-e32879219330]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b88a455-60cc-47c7-a898-a54e80e9e7b7]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[266d20e6-b46d-4023-8c62-aa8df29e98b5]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f, portal: 172.16.0.220,3260]
Aug 01 16:09:44 user nova-compute[72201]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f, portal: 172.16.0.220,3260] successful.
Aug 01 16:09:44 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1f1cbf-6178-45b0-a9c7-19d163daba2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b870c4-d584-4cfe-b1d2-a085a2086843]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] <== disconnect_volume: return (325ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:09:44 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Deleting instance files /opt/stack/data/nova/instances/baead5f8-a15c-4fe7-94ce-8221fdbbb7da_del
Aug 01 16:09:44 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Deletion of /opt/stack/data/nova/instances/baead5f8-a15c-4fe7-94ce-8221fdbbb7da_del complete
Aug 01 16:09:44 user nova-compute[72201]: INFO nova.compute.manager [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 01 16:09:44 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:44 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:09:44 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Took 0.54 seconds to deallocate network for instance.
Aug 01 16:09:45 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-6e4022ce-9961-46a9-a9ba-d4f5b48b4dfd req-8b0b058b-349e-46b4-9203-d8c5bd2b06d6 service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Received event network-vif-plugged-8dc44f2d-5980-4878-b3da-9a01f8d82b71 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6e4022ce-9961-46a9-a9ba-d4f5b48b4dfd req-8b0b058b-349e-46b4-9203-d8c5bd2b06d6 service nova] Acquiring lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6e4022ce-9961-46a9-a9ba-d4f5b48b4dfd req-8b0b058b-349e-46b4-9203-d8c5bd2b06d6 service nova] Lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-6e4022ce-9961-46a9-a9ba-d4f5b48b4dfd req-8b0b058b-349e-46b4-9203-d8c5bd2b06d6 service nova] Lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-6e4022ce-9961-46a9-a9ba-d4f5b48b4dfd req-8b0b058b-349e-46b4-9203-d8c5bd2b06d6 service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] No waiting events found dispatching network-vif-plugged-8dc44f2d-5980-4878-b3da-9a01f8d82b71 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:09:45 user nova-compute[72201]: WARNING nova.compute.manager [req-6e4022ce-9961-46a9-a9ba-d4f5b48b4dfd req-8b0b058b-349e-46b4-9203-d8c5bd2b06d6 service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Received unexpected event network-vif-plugged-8dc44f2d-5980-4878-b3da-9a01f8d82b71 for instance with vm_state active and task_state deleting.
Aug 01 16:09:45 user nova-compute[72201]: DEBUG nova.compute.manager [req-6e4022ce-9961-46a9-a9ba-d4f5b48b4dfd req-8b0b058b-349e-46b4-9203-d8c5bd2b06d6 service nova] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Received event network-vif-deleted-8dc44f2d-5980-4878-b3da-9a01f8d82b71 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:09:45 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:09:45 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:09:45 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8833MB free_disk=25.19550323486328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:09:45 user nova-compute[72201]: INFO nova.compute.manager [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Took 0.77 seconds to detach 1 volumes for instance.
Aug 01 16:09:45 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance baead5f8-a15c-4fe7-94ce-8221fdbbb7da actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.082s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:09:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:09:45 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Deleted allocations for instance baead5f8-a15c-4fe7-94ce-8221fdbbb7da
Aug 01 16:09:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-482afcc4-7bc0-4fd1-855f-dd350888dbbb tempest-TestVolumeBootPattern-1110722165 tempest-TestVolumeBootPattern-1110722165-project-member] Lock "baead5f8-a15c-4fe7-94ce-8221fdbbb7da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.919s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:09:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:50 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:09:51 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:09:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:09:58 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690906183.8026285, baead5f8-a15c-4fe7-94ce-8221fdbbb7da => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:09:58 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] VM Stopped (Lifecycle Event)
Aug 01 16:09:58 user nova-compute[72201]: DEBUG nova.compute.manager [None req-a4a705cc-e665-4b07-8238-d9e515cfffc2 None None] [instance: baead5f8-a15c-4fe7-94ce-8221fdbbb7da] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:09:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:09:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:09:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:09:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:09:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:09:59 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:09:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:10:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:10:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:10:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:10:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:10:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:10:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:10:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:10:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:10:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:10:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:10:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:10:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:10:38 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:10:41 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:10:42 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:10:42 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:10:42 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 16:10:42 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Didn't find any instances for network info cache update. {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 16:10:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:10:42 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:10:43 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:10:44 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:10:45 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:10:45 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:10:45 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:10:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:10:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:10:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:10:45 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:10:45 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:10:45 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:10:45 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8885MB free_disk=25.194393157958984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:10:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:10:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:10:45 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:10:45 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:10:45 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:10:45 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:10:45 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:10:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:10:46 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:10:48 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:10:50 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:10:52 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:10:53 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:10:58 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:10:59 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:10:59 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:10:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:11:03 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:11:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:11:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:11:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:11:08 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:13 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:16 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:18 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:22 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:28 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:11:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:11:31 user nova-compute[72201]: DEBUG nova.compute.manager [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Starting instance... {{(pid=72201) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 16:11:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:11:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:11:31 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72201) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 16:11:31 user nova-compute[72201]: INFO nova.compute.claims [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Claim successful on node user
Aug 01 16:11:31 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:11:31 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:11:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:11:31 user nova-compute[72201]: DEBUG nova.compute.manager [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Start building networks asynchronously for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 16:11:31 user nova-compute[72201]: DEBUG nova.compute.manager [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Allocating IP information in the background. {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 16:11:31 user nova-compute[72201]: DEBUG nova.network.neutron [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] allocate_for_instance() {{(pid=72201) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 16:11:31 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 16:11:31 user nova-compute[72201]: DEBUG nova.compute.manager [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Start building block device mappings for instance. {{(pid=72201) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 16:11:31 user nova-compute[72201]: DEBUG nova.compute.manager [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Start spawning the instance on the hypervisor. {{(pid=72201) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 16:11:31 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Creating instance directory {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 16:11:31 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Creating image(s)
Aug 01 16:11:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:11:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "/opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:11:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "/opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:11:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:11:31 user nova-compute[72201]: DEBUG nova.policy [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5be08fc164fe49f4bb6b54a60c6c7c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df386c71461a4a88a9a435c04d9f0d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72201) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 16:11:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.171s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:11:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:11:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:11:31 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:11:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.161s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:11:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk 1073741824 {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:11:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba,backing_fmt=raw /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk 1073741824" returned: 0 in 0.070s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:11:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "0322c9d1b247c65744d49c1e219f99c4dc8898ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:11:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:11:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0322c9d1b247c65744d49c1e219f99c4dc8898ba --force-share --output=json" returned: 0 in 0.180s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:11:32 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk. size=1073741824 {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 16:11:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:11:32 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:11:32 user nova-compute[72201]: DEBUG nova.virt.disk.api [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Cannot resize image /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk to a smaller size. {{(pid=72201) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 16:11:32 user nova-compute[72201]: DEBUG nova.objects.instance [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lazy-loading 'migration_context' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:11:32 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Created local disks {{(pid=72201) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 16:11:32 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Ensure instance console log exists: /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/console.log {{(pid=72201) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 16:11:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:11:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:11:32 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:11:33 user nova-compute[72201]: DEBUG nova.network.neutron [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Successfully created port: 8eb5163c-6608-4448-a166-b3f2f5e10281 {{(pid=72201) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 16:11:33 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:34 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:11:34 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72201) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 16:11:34 user nova-compute[72201]: DEBUG nova.network.neutron [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Successfully updated port: 8eb5163c-6608-4448-a166-b3f2f5e10281 {{(pid=72201) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 16:11:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:11:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquired lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:11:34 user nova-compute[72201]: DEBUG nova.network.neutron [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Building network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 16:11:34 user nova-compute[72201]: DEBUG nova.compute.manager [req-df1e6c52-0200-47c8-b3f3-17ebabf06e3b req-545259b3-0c5b-4a50-b99c-94520aa71781 service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Received event network-changed-8eb5163c-6608-4448-a166-b3f2f5e10281 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:11:34 user nova-compute[72201]: DEBUG nova.compute.manager [req-df1e6c52-0200-47c8-b3f3-17ebabf06e3b req-545259b3-0c5b-4a50-b99c-94520aa71781 service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Refreshing instance network info cache due to event network-changed-8eb5163c-6608-4448-a166-b3f2f5e10281. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:11:34 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-df1e6c52-0200-47c8-b3f3-17ebabf06e3b req-545259b3-0c5b-4a50-b99c-94520aa71781 service nova] Acquiring lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:11:34 user nova-compute[72201]: DEBUG nova.network.neutron [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Instance cache missing network info. {{(pid=72201) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.network.neutron [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updating instance_info_cache with network_info: [{"id": "8eb5163c-6608-4448-a166-b3f2f5e10281", "address": "fa:16:3e:8b:c8:ac", "network": {"id": "37d22152-77fa-49e4-8166-24f61566fd1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-309160669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df386c71461a4a88a9a435c04d9f0d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb5163c-66", "ovs_interfaceid": "8eb5163c-6608-4448-a166-b3f2f5e10281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Releasing lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.compute.manager [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Instance network_info: |[{"id": "8eb5163c-6608-4448-a166-b3f2f5e10281", "address": "fa:16:3e:8b:c8:ac", "network": {"id": "37d22152-77fa-49e4-8166-24f61566fd1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-309160669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df386c71461a4a88a9a435c04d9f0d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb5163c-66", "ovs_interfaceid": "8eb5163c-6608-4448-a166-b3f2f5e10281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72201) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-df1e6c52-0200-47c8-b3f3-17ebabf06e3b req-545259b3-0c5b-4a50-b99c-94520aa71781 service nova] Acquired lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.network.neutron [req-df1e6c52-0200-47c8-b3f3-17ebabf06e3b req-545259b3-0c5b-4a50-b99c-94520aa71781 service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Refreshing network info cache for port 8eb5163c-6608-4448-a166-b3f2f5e10281 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Start _get_guest_xml network_info=[{"id": "8eb5163c-6608-4448-a166-b3f2f5e10281", "address": "fa:16:3e:8b:c8:ac", "network": {"id": "37d22152-77fa-49e4-8166-24f61566fd1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-309160669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df386c71461a4a88a9a435c04d9f0d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb5163c-66", "ovs_interfaceid": "8eb5163c-6608-4448-a166-b3f2f5e10281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'image_id': '73af296a-4f5f-49df-a90d-46b9fdcd9a3f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 16:11:35 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:11:35 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] CPU controller missing on host. {{(pid=72201) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.host [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] CPU controller found on host. {{(pid=72201) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72201) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T15:16:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T15:16:22Z,direct_url=<?>,disk_format='qcow2',id=73af296a-4f5f-49df-a90d-46b9fdcd9a3f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='61c269efda764109a1920e63e9db119e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T15:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Flavor limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Image limits 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Flavor pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Image pref 0:0:0 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72201) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Got 1 possible topologies {{(pid=72201) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.hardware [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72201) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:11:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-76389977',display_name='tempest-SnapshotDataIntegrityTests-server-76389977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-76389977',id=52,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+LGbv+f/IBNtLrRGide39VpuOPdub0OFfpmodIE4Q+ajq/sx5SeOpbK63LqDDxzTDYmgfH4xQCYh2mdhZOmpCYiu4SF35mcIQGvBJpJ+rt7ZT6gjwBs7MheC0qPNVc9Q==',key_name='tempest-keypair-1822066526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df386c71461a4a88a9a435c04d9f0d2d',ramdisk_id='',reservation_id='r-42fse8wo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1806369645',owner_user_name='tempest-SnapshotDataIntegrityTests-1806369645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5be08fc164fe49f4bb6b54a60c6c7c19',uuid=c3381d0b-652a-405e-a9d1-b9a9bb75c708,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eb5163c-6608-4448-a166-b3f2f5e10281", "address": "fa:16:3e:8b:c8:ac", "network": {"id": "37d22152-77fa-49e4-8166-24f61566fd1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-309160669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df386c71461a4a88a9a435c04d9f0d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb5163c-66", "ovs_interfaceid": "8eb5163c-6608-4448-a166-b3f2f5e10281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72201) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Converting VIF {"id": "8eb5163c-6608-4448-a166-b3f2f5e10281", "address": "fa:16:3e:8b:c8:ac", "network": {"id": "37d22152-77fa-49e4-8166-24f61566fd1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-309160669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df386c71461a4a88a9a435c04d9f0d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb5163c-66", "ovs_interfaceid": "8eb5163c-6608-4448-a166-b3f2f5e10281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:c8:ac,bridge_name='br-int',has_traffic_filtering=True,id=8eb5163c-6608-4448-a166-b3f2f5e10281,network=Network(37d22152-77fa-49e4-8166-24f61566fd1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb5163c-66') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.objects.instance [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lazy-loading 'pci_devices' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] End _get_guest_xml xml=<domain type="kvm">
Aug 01 16:11:35 user nova-compute[72201]:   <uuid>c3381d0b-652a-405e-a9d1-b9a9bb75c708</uuid>
Aug 01 16:11:35 user nova-compute[72201]:   <name>instance-00000034</name>
Aug 01 16:11:35 user nova-compute[72201]:   <memory>524288</memory>
Aug 01 16:11:35 user nova-compute[72201]:   <vcpu>1</vcpu>
Aug 01 16:11:35 user nova-compute[72201]:   <metadata>
Aug 01 16:11:35 user nova-compute[72201]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 16:11:35 user nova-compute[72201]:       <nova:package version="0.0.0"/>
Aug 01 16:11:35 user nova-compute[72201]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-76389977</nova:name>
Aug 01 16:11:35 user nova-compute[72201]:       <nova:creationTime>2023-08-01 16:11:35</nova:creationTime>
Aug 01 16:11:35 user nova-compute[72201]:       <nova:flavor name="m1.tiny">
Aug 01 16:11:35 user nova-compute[72201]:         <nova:memory>512</nova:memory>
Aug 01 16:11:35 user nova-compute[72201]:         <nova:disk>1</nova:disk>
Aug 01 16:11:35 user nova-compute[72201]:         <nova:swap>0</nova:swap>
Aug 01 16:11:35 user nova-compute[72201]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 16:11:35 user nova-compute[72201]:         <nova:vcpus>1</nova:vcpus>
Aug 01 16:11:35 user nova-compute[72201]:       </nova:flavor>
Aug 01 16:11:35 user nova-compute[72201]:       <nova:owner>
Aug 01 16:11:35 user nova-compute[72201]:         <nova:user uuid="5be08fc164fe49f4bb6b54a60c6c7c19">tempest-SnapshotDataIntegrityTests-1806369645-project-member</nova:user>
Aug 01 16:11:35 user nova-compute[72201]:         <nova:project uuid="df386c71461a4a88a9a435c04d9f0d2d">tempest-SnapshotDataIntegrityTests-1806369645</nova:project>
Aug 01 16:11:35 user nova-compute[72201]:       </nova:owner>
Aug 01 16:11:35 user nova-compute[72201]:       <nova:root type="image" uuid="73af296a-4f5f-49df-a90d-46b9fdcd9a3f"/>
Aug 01 16:11:35 user nova-compute[72201]:       <nova:ports>
Aug 01 16:11:35 user nova-compute[72201]:         <nova:port uuid="8eb5163c-6608-4448-a166-b3f2f5e10281">
Aug 01 16:11:35 user nova-compute[72201]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 16:11:35 user nova-compute[72201]:         </nova:port>
Aug 01 16:11:35 user nova-compute[72201]:       </nova:ports>
Aug 01 16:11:35 user nova-compute[72201]:     </nova:instance>
Aug 01 16:11:35 user nova-compute[72201]:   </metadata>
Aug 01 16:11:35 user nova-compute[72201]:   <sysinfo type="smbios">
Aug 01 16:11:35 user nova-compute[72201]:     <system>
Aug 01 16:11:35 user nova-compute[72201]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 16:11:35 user nova-compute[72201]:       <entry name="product">OpenStack Nova</entry>
Aug 01 16:11:35 user nova-compute[72201]:       <entry name="version">0.0.0</entry>
Aug 01 16:11:35 user nova-compute[72201]:       <entry name="serial">c3381d0b-652a-405e-a9d1-b9a9bb75c708</entry>
Aug 01 16:11:35 user nova-compute[72201]:       <entry name="uuid">c3381d0b-652a-405e-a9d1-b9a9bb75c708</entry>
Aug 01 16:11:35 user nova-compute[72201]:       <entry name="family">Virtual Machine</entry>
Aug 01 16:11:35 user nova-compute[72201]:     </system>
Aug 01 16:11:35 user nova-compute[72201]:   </sysinfo>
Aug 01 16:11:35 user nova-compute[72201]:   <os>
Aug 01 16:11:35 user nova-compute[72201]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 16:11:35 user nova-compute[72201]:     <boot dev="hd"/>
Aug 01 16:11:35 user nova-compute[72201]:     <smbios mode="sysinfo"/>
Aug 01 16:11:35 user nova-compute[72201]:   </os>
Aug 01 16:11:35 user nova-compute[72201]:   <features>
Aug 01 16:11:35 user nova-compute[72201]:     <acpi/>
Aug 01 16:11:35 user nova-compute[72201]:     <apic/>
Aug 01 16:11:35 user nova-compute[72201]:     <vmcoreinfo/>
Aug 01 16:11:35 user nova-compute[72201]:   </features>
Aug 01 16:11:35 user nova-compute[72201]:   <clock offset="utc">
Aug 01 16:11:35 user nova-compute[72201]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 16:11:35 user nova-compute[72201]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 16:11:35 user nova-compute[72201]:     <timer name="hpet" present="no"/>
Aug 01 16:11:35 user nova-compute[72201]:   </clock>
Aug 01 16:11:35 user nova-compute[72201]:   <cpu mode="custom" match="exact">
Aug 01 16:11:35 user nova-compute[72201]:     <model>Nehalem</model>
Aug 01 16:11:35 user nova-compute[72201]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 16:11:35 user nova-compute[72201]:   </cpu>
Aug 01 16:11:35 user nova-compute[72201]:   <devices>
Aug 01 16:11:35 user nova-compute[72201]:     <disk type="file" device="disk">
Aug 01 16:11:35 user nova-compute[72201]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 16:11:35 user nova-compute[72201]:       <source file="/opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk"/>
Aug 01 16:11:35 user nova-compute[72201]:       <target dev="vda" bus="virtio"/>
Aug 01 16:11:35 user nova-compute[72201]:     </disk>
Aug 01 16:11:35 user nova-compute[72201]:     <interface type="ethernet">
Aug 01 16:11:35 user nova-compute[72201]:       <mac address="fa:16:3e:8b:c8:ac"/>
Aug 01 16:11:35 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 16:11:35 user nova-compute[72201]:       <mtu size="1442"/>
Aug 01 16:11:35 user nova-compute[72201]:       <target dev="tap8eb5163c-66"/>
Aug 01 16:11:35 user nova-compute[72201]:     </interface>
Aug 01 16:11:35 user nova-compute[72201]:     <serial type="pty">
Aug 01 16:11:35 user nova-compute[72201]:       <log file="/opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/console.log" append="off"/>
Aug 01 16:11:35 user nova-compute[72201]:     </serial>
Aug 01 16:11:35 user nova-compute[72201]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 16:11:35 user nova-compute[72201]:     <video>
Aug 01 16:11:35 user nova-compute[72201]:       <model type="virtio"/>
Aug 01 16:11:35 user nova-compute[72201]:     </video>
Aug 01 16:11:35 user nova-compute[72201]:     <rng model="virtio">
Aug 01 16:11:35 user nova-compute[72201]:       <backend model="random">/dev/urandom</backend>
Aug 01 16:11:35 user nova-compute[72201]:     </rng>
Aug 01 16:11:35 user nova-compute[72201]:     <controller type="usb" index="0" model="none"/>
Aug 01 16:11:35 user nova-compute[72201]:     <memballoon model="virtio">
Aug 01 16:11:35 user nova-compute[72201]:       <stats period="10"/>
Aug 01 16:11:35 user nova-compute[72201]:     </memballoon>
Aug 01 16:11:35 user nova-compute[72201]:   </devices>
Aug 01 16:11:35 user nova-compute[72201]: </domain>
Aug 01 16:11:35 user nova-compute[72201]:  {{(pid=72201) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:11:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-76389977',display_name='tempest-SnapshotDataIntegrityTests-server-76389977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-76389977',id=52,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+LGbv+f/IBNtLrRGide39VpuOPdub0OFfpmodIE4Q+ajq/sx5SeOpbK63LqDDxzTDYmgfH4xQCYh2mdhZOmpCYiu4SF35mcIQGvBJpJ+rt7ZT6gjwBs7MheC0qPNVc9Q==',key_name='tempest-keypair-1822066526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df386c71461a4a88a9a435c04d9f0d2d',ramdisk_id='',reservation_id='r-42fse8wo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1806369645',owner_user_name='tempest-SnapshotDataIntegrityTests-1806369645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T16:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5be08fc164fe49f4bb6b54a60c6c7c19',uuid=c3381d0b-652a-405e-a9d1-b9a9bb75c708,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eb5163c-6608-4448-a166-b3f2f5e10281", "address": "fa:16:3e:8b:c8:ac", "network": {"id": "37d22152-77fa-49e4-8166-24f61566fd1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-309160669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df386c71461a4a88a9a435c04d9f0d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb5163c-66", "ovs_interfaceid": "8eb5163c-6608-4448-a166-b3f2f5e10281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Converting VIF {"id": "8eb5163c-6608-4448-a166-b3f2f5e10281", "address": "fa:16:3e:8b:c8:ac", "network": {"id": "37d22152-77fa-49e4-8166-24f61566fd1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-309160669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df386c71461a4a88a9a435c04d9f0d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb5163c-66", "ovs_interfaceid": "8eb5163c-6608-4448-a166-b3f2f5e10281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:c8:ac,bridge_name='br-int',has_traffic_filtering=True,id=8eb5163c-6608-4448-a166-b3f2f5e10281,network=Network(37d22152-77fa-49e4-8166-24f61566fd1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb5163c-66') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG os_vif [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:c8:ac,bridge_name='br-int',has_traffic_filtering=True,id=8eb5163c-6608-4448-a166-b3f2f5e10281,network=Network(37d22152-77fa-49e4-8166-24f61566fd1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb5163c-66') {{(pid=72201) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8eb5163c-66, may_exist=True, interface_attrs={}) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8eb5163c-66, col_values=(('external_ids', {'iface-id': '8eb5163c-6608-4448-a166-b3f2f5e10281', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:c8:ac', 'vm-uuid': 'c3381d0b-652a-405e-a9d1-b9a9bb75c708'}),), if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:35 user nova-compute[72201]: INFO os_vif [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:c8:ac,bridge_name='br-int',has_traffic_filtering=True,id=8eb5163c-6608-4448-a166-b3f2f5e10281,network=Network(37d22152-77fa-49e4-8166-24f61566fd1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb5163c-66')
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] No VIF found with MAC fa:16:3e:8b:c8:ac, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.network.neutron [req-df1e6c52-0200-47c8-b3f3-17ebabf06e3b req-545259b3-0c5b-4a50-b99c-94520aa71781 service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updated VIF entry in instance network info cache for port 8eb5163c-6608-4448-a166-b3f2f5e10281. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG nova.network.neutron [req-df1e6c52-0200-47c8-b3f3-17ebabf06e3b req-545259b3-0c5b-4a50-b99c-94520aa71781 service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updating instance_info_cache with network_info: [{"id": "8eb5163c-6608-4448-a166-b3f2f5e10281", "address": "fa:16:3e:8b:c8:ac", "network": {"id": "37d22152-77fa-49e4-8166-24f61566fd1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-309160669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df386c71461a4a88a9a435c04d9f0d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb5163c-66", "ovs_interfaceid": "8eb5163c-6608-4448-a166-b3f2f5e10281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:11:35 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-df1e6c52-0200-47c8-b3f3-17ebabf06e3b req-545259b3-0c5b-4a50-b99c-94520aa71781 service nova] Releasing lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:11:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:36 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:37 user nova-compute[72201]: DEBUG nova.compute.manager [req-aabc638d-4219-4bf1-b9d5-67564be2743c req-842cb4bf-5c69-419d-b08f-c420b37135f1 service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Received event network-vif-plugged-8eb5163c-6608-4448-a166-b3f2f5e10281 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:11:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-aabc638d-4219-4bf1-b9d5-67564be2743c req-842cb4bf-5c69-419d-b08f-c420b37135f1 service nova] Acquiring lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:11:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-aabc638d-4219-4bf1-b9d5-67564be2743c req-842cb4bf-5c69-419d-b08f-c420b37135f1 service nova] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:11:37 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-aabc638d-4219-4bf1-b9d5-67564be2743c req-842cb4bf-5c69-419d-b08f-c420b37135f1 service nova] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:11:37 user nova-compute[72201]: DEBUG nova.compute.manager [req-aabc638d-4219-4bf1-b9d5-67564be2743c req-842cb4bf-5c69-419d-b08f-c420b37135f1 service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] No waiting events found dispatching network-vif-plugged-8eb5163c-6608-4448-a166-b3f2f5e10281 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:11:37 user nova-compute[72201]: WARNING nova.compute.manager [req-aabc638d-4219-4bf1-b9d5-67564be2743c req-842cb4bf-5c69-419d-b08f-c420b37135f1 service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Received unexpected event network-vif-plugged-8eb5163c-6608-4448-a166-b3f2f5e10281 for instance with vm_state building and task_state spawning.
Aug 01 16:11:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:37 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:39 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690906299.1776006, c3381d0b-652a-405e-a9d1-b9a9bb75c708 => Resumed> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:11:39 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] VM Resumed (Lifecycle Event)
Aug 01 16:11:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Instance event wait completed in 0 seconds for  {{(pid=72201) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 16:11:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Guest created on hypervisor {{(pid=72201) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 16:11:39 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Instance spawned successfully.
Aug 01 16:11:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 16:11:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:11:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:11:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Found default for hw_cdrom_bus of ide {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:11:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Found default for hw_disk_bus of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:11:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Found default for hw_input_bus of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:11:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Found default for hw_pointer_model of None {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:11:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Found default for hw_video_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:11:39 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Found default for hw_vif_model of virtio {{(pid=72201) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 16:11:39 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:11:39 user nova-compute[72201]: DEBUG nova.virt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Emitting event <LifecycleEvent: 1690906299.1800933, c3381d0b-652a-405e-a9d1-b9a9bb75c708 => Started> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:11:39 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] VM Started (Lifecycle Event)
Aug 01 16:11:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-cf6523c0-bf21-4895-b202-bf5853b3a121 req-a2453c11-7645-4cb4-9534-8561e758f3e1 service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Received event network-vif-plugged-8eb5163c-6608-4448-a166-b3f2f5e10281 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:11:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cf6523c0-bf21-4895-b202-bf5853b3a121 req-a2453c11-7645-4cb4-9534-8561e758f3e1 service nova] Acquiring lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:11:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cf6523c0-bf21-4895-b202-bf5853b3a121 req-a2453c11-7645-4cb4-9534-8561e758f3e1 service nova] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:11:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-cf6523c0-bf21-4895-b202-bf5853b3a121 req-a2453c11-7645-4cb4-9534-8561e758f3e1 service nova] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:11:39 user nova-compute[72201]: DEBUG nova.compute.manager [req-cf6523c0-bf21-4895-b202-bf5853b3a121 req-a2453c11-7645-4cb4-9534-8561e758f3e1 service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] No waiting events found dispatching network-vif-plugged-8eb5163c-6608-4448-a166-b3f2f5e10281 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:11:39 user nova-compute[72201]: WARNING nova.compute.manager [req-cf6523c0-bf21-4895-b202-bf5853b3a121 req-a2453c11-7645-4cb4-9534-8561e758f3e1 service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Received unexpected event network-vif-plugged-8eb5163c-6608-4448-a166-b3f2f5e10281 for instance with vm_state building and task_state spawning.
Aug 01 16:11:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:11:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72201) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 16:11:39 user nova-compute[72201]: INFO nova.compute.manager [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 16:11:39 user nova-compute[72201]: INFO nova.compute.manager [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Took 7.64 seconds to spawn the instance on the hypervisor.
Aug 01 16:11:39 user nova-compute[72201]: DEBUG nova.compute.manager [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:11:39 user nova-compute[72201]: INFO nova.compute.manager [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Took 8.24 seconds to build instance.
Aug 01 16:11:39 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-8e408cef-b4cc-413b-8e69-d1d834ba7228 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.359s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:11:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:41 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:11:44 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:11:44 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:11:44 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 16:11:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:11:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:11:44 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:11:44 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:11:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:44 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updating instance_info_cache with network_info: [{"id": "8eb5163c-6608-4448-a166-b3f2f5e10281", "address": "fa:16:3e:8b:c8:ac", "network": {"id": "37d22152-77fa-49e4-8166-24f61566fd1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-309160669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df386c71461a4a88a9a435c04d9f0d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb5163c-66", "ovs_interfaceid": "8eb5163c-6608-4448-a166-b3f2f5e10281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:11:44 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:11:44 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:11:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:45 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:11:45 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:11:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:11:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:11:45 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:11:45 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:11:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:11:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:11:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:11:45 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:11:46 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:11:46 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:11:46 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8483MB free_disk=25.178668975830078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:11:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:11:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:11:46 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:11:46 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:11:46 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:11:46 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing inventories for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 16:11:46 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating ProviderTree inventory for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 16:11:46 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating inventory in ProviderTree for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 16:11:46 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing aggregate associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, aggregates: None {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 16:11:46 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing trait associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 16:11:46 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:11:46 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:11:46 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:11:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.545s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:11:48 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:11:48 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:11:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:50 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:11:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:11:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:55 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:11:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:11:59 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:11:59 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:11:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:12:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:12:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:12:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:12:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:12:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:12:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:12:20 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:12:20 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 16:12:20 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] There are 0 instances to clean {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 16:12:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:12:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:12:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:12:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:12:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:12:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:12:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:12:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:12:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:12:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:12:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:12:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:12:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:12:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:12:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:12:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:12:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:12:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:12:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:12:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:12:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:12:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:12:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:12:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:12:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:12:43 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:12:45 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:12:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:12:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:12:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:12:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:12:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:12:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:12:46 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:12:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:12:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 16:12:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:12:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:12:46 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:12:46 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:12:46 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updating instance_info_cache with network_info: [{"id": "8eb5163c-6608-4448-a166-b3f2f5e10281", "address": "fa:16:3e:8b:c8:ac", "network": {"id": "37d22152-77fa-49e4-8166-24f61566fd1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-309160669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df386c71461a4a88a9a435c04d9f0d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb5163c-66", "ovs_interfaceid": "8eb5163c-6608-4448-a166-b3f2f5e10281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:12:46 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:12:46 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:12:47 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:12:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:12:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:12:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:12:47 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:12:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:12:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:12:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:12:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:12:47 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:12:47 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:12:47 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8729MB free_disk=25.14801788330078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:12:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:12:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:12:47 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:12:47 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:12:47 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:12:48 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:12:48 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:12:48 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:12:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:12:49 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:12:49 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:12:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:12:51 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:12:54 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:12:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:12:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:12:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:12:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:12:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:12:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:13:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:13:01 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:13:01 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:13:01 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:13:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:13:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:13:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:13:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:13:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:13:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:13:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:13:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:13:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:13:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:13:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:13:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:13:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:13:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:13:22 user nova-compute[72201]: DEBUG nova.compute.manager [req-e3df5f39-8ae8-4683-8931-eb3fdf75041e req-df5ca83b-5f7b-4b89-816f-5480ffe5efe2 service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Received event network-changed-8eb5163c-6608-4448-a166-b3f2f5e10281 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:13:22 user nova-compute[72201]: DEBUG nova.compute.manager [req-e3df5f39-8ae8-4683-8931-eb3fdf75041e req-df5ca83b-5f7b-4b89-816f-5480ffe5efe2 service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Refreshing instance network info cache due to event network-changed-8eb5163c-6608-4448-a166-b3f2f5e10281. {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 16:13:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e3df5f39-8ae8-4683-8931-eb3fdf75041e req-df5ca83b-5f7b-4b89-816f-5480ffe5efe2 service nova] Acquiring lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:13:22 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e3df5f39-8ae8-4683-8931-eb3fdf75041e req-df5ca83b-5f7b-4b89-816f-5480ffe5efe2 service nova] Acquired lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:13:22 user nova-compute[72201]: DEBUG nova.network.neutron [req-e3df5f39-8ae8-4683-8931-eb3fdf75041e req-df5ca83b-5f7b-4b89-816f-5480ffe5efe2 service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Refreshing network info cache for port 8eb5163c-6608-4448-a166-b3f2f5e10281 {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 16:13:23 user nova-compute[72201]: DEBUG nova.network.neutron [req-e3df5f39-8ae8-4683-8931-eb3fdf75041e req-df5ca83b-5f7b-4b89-816f-5480ffe5efe2 service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updated VIF entry in instance network info cache for port 8eb5163c-6608-4448-a166-b3f2f5e10281. {{(pid=72201) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 16:13:23 user nova-compute[72201]: DEBUG nova.network.neutron [req-e3df5f39-8ae8-4683-8931-eb3fdf75041e req-df5ca83b-5f7b-4b89-816f-5480ffe5efe2 service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updating instance_info_cache with network_info: [{"id": "8eb5163c-6608-4448-a166-b3f2f5e10281", "address": "fa:16:3e:8b:c8:ac", "network": {"id": "37d22152-77fa-49e4-8166-24f61566fd1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-309160669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df386c71461a4a88a9a435c04d9f0d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb5163c-66", "ovs_interfaceid": "8eb5163c-6608-4448-a166-b3f2f5e10281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:13:23 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-e3df5f39-8ae8-4683-8931-eb3fdf75041e req-df5ca83b-5f7b-4b89-816f-5480ffe5efe2 service nova] Releasing lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:13:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:13:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG nova.objects.instance [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lazy-loading 'flavor' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:13:27 user nova-compute[72201]: INFO nova.compute.manager [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Attaching volume 85e72aa1-236e-4886-9125-e9f13329bf07 to /dev/vdb
Aug 01 16:13:27 user nova-compute[72201]: DEBUG os_brick.utils [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff721551-779a-4560-a2e3-fe305e86c71c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8040d0d-51f5-4e7c-a0f3-1a22a3ac6587]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[626a55d4-eff8-480e-94a3-8b2e3ea324ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d31a27-0d70-40b2-a447-1fc8a4f291b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:13:27 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:13:27 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf1f1a8-e889-44e6-bf95-937a71fab0fe]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG os_brick.utils [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:13:27 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updating existing volume attachment record: 3208cbde-4757-4b72-aa4c-ea41fe41336e {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:13:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:13:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxnsJYgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:13:34 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:13:34 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:13:34 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b028a3c7-56bf-4a81-853d-c62fefb732fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:13:34 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d79577-ceff-4cb7-8eaa-b0596058d35f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07] added
Aug 01 16:13:34 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cf8e68-2381-46b8-a63b-4c76d75eaf9f]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ceffb7b-51ed-46f5-ab5a-8c5ad4dd0f19]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GxnsJYgi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GxnsJYgi" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9625aa2e-8c6f-4a00-b019-2d6176dd8e98]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GxnsJYgi'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[10176617-9083-4524-be5f-f81b6f9576f3]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad2509c-fca7-46ae-9b69-5037989ed227]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 16:13:34 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 16:13:34 user nova-compute[72201]:  {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:13:34 user nova-compute[72201]: WARNING os_brick.initiator.connectors.iscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 16:13:34 user nova-compute[72201]: 
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260 --login" returned: 0 in 0.157s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32776e5-a54e-4bfe-b584-f7483353b8d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07, portal: 172.16.0.220,3260]
Aug 01 16:13:34 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07, portal: 172.16.0.220,3260] successful.
Aug 01 16:13:34 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[710ca1d4-a49d-4876-829b-89a870e927fd]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[598ca1bb-5b7f-45c3-8cde-60abf4b5c252]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 (non-flash)
Aug 01 16:13:34 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 (non-flash)
Aug 01 16:13:34 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] HCTL ('33', '-', '-', 0) found on session 66 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a8330d-8aad-4fcf-9048-284182eac8b2]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:34 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Searching for a device in session 66 and hctl ['33', '*', '*', 0] yield: None {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:13:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:13:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:13:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:13:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:13:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:13:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:13:35 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Searching for a device in session 66 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:13:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxnsJYgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:13:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:13:35 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '26563393930353631', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:13:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563393930353631', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:13:35 user nova-compute[72201]: DEBUG nova.objects.instance [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lazy-loading 'flavor' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:13:35 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 16:13:35 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:13:35 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 16:13:35 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:13:35 user nova-compute[72201]:   <serial>85e72aa1-236e-4886-9125-e9f13329bf07</serial>
Aug 01 16:13:35 user nova-compute[72201]: </disk>
Aug 01 16:13:35 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 16:13:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:13:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:13:36 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] No VIF found with MAC fa:16:3e:8b:c8:ac, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:13:36 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-7db70ce4-1126-4a5b-b88c-6e6401bbad35 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.133s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:13:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:13:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:13:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:13:45 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:13:45 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:13:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:13:48 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:13:48 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:13:48 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 16:13:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:13:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:13:48 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:13:48 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:13:48 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updating instance_info_cache with network_info: [{"id": "8eb5163c-6608-4448-a166-b3f2f5e10281", "address": "fa:16:3e:8b:c8:ac", "network": {"id": "37d22152-77fa-49e4-8166-24f61566fd1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-309160669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df386c71461a4a88a9a435c04d9f0d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb5163c-66", "ovs_interfaceid": "8eb5163c-6608-4448-a166-b3f2f5e10281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:13:48 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:13:48 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:13:49 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:13:49 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:13:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:13:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:13:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:13:49 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:13:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:49 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:49 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72201) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 16:13:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:13:49 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:13:49 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:13:49 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8733MB free_disk=25.138935089111328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:13:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:13:49 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:13:49 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:13:49 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:13:49 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:13:50 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:13:50 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:13:50 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:13:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:13:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:13:51 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:13:51 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:13:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:13:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:13:53 user nova-compute[72201]: INFO nova.compute.manager [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Detaching volume 85e72aa1-236e-4886-9125-e9f13329bf07
Aug 01 16:13:53 user nova-compute[72201]: INFO nova.virt.block_device [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Attempting to driver detach volume 85e72aa1-236e-4886-9125-e9f13329bf07 from mountpoint /dev/vdb
Aug 01 16:13:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Attempting to detach device vdb from instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 16:13:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:13:53 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:13:53 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 16:13:53 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:13:53 user nova-compute[72201]:   <serial>85e72aa1-236e-4886-9125-e9f13329bf07</serial>
Aug 01 16:13:53 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:13:53 user nova-compute[72201]: </disk>
Aug 01 16:13:53 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:13:53 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Successfully detached device vdb from instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 from the persistent domain config.
Aug 01 16:13:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 16:13:53 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:13:53 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:13:53 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 16:13:53 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:13:53 user nova-compute[72201]:   <serial>85e72aa1-236e-4886-9125-e9f13329bf07</serial>
Aug 01 16:13:53 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:13:53 user nova-compute[72201]: </disk>
Aug 01 16:13:53 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690906434.088019, c3381d0b-652a-405e-a9d1-b9a9bb75c708 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 16:13:54 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Successfully detached device vdb from instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 from the live domain config.
Aug 01 16:13:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxnsJYgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:13:54 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:13:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1ee867-85d0-4116-bcc4-8bf4e903f524]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55c0a8e-df39-4e3f-a479-6989d089e368]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 (non-flash)
Aug 01 16:13:54 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 (non-flash)
Aug 01 16:13:54 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc52c656560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07'): ({'sdb'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Removing single pathed devices sdb {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c1c2ba-bd03-44cd-b24c-1c55697a8f21]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ac4156-eb3b-4a05-acb5-a943f2113e15]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Flushing IO for device /dev/sdb {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82fab5f-a658-4fd7-86ac-25739658f2a7]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd83295-a09c-4996-a0ae-8bab7d283f1b]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8363ef-c32f-45f3-9183-ca113c6773ee]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cd9b0b-105f-4a6b-bf53-80534a3790a7]: (4, ('Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07, portal: 172.16.0.220,3260]\nLogout of [sid: 66, target: iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07, portal: 172.16.0.220,3260]
Aug 01 16:13:54 user nova-compute[72201]: Logout of [sid: 66, target: iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07, portal: 172.16.0.220,3260] successful.
Aug 01 16:13:54 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85e72aa1-236e-4886-9125-e9f13329bf07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c16dfa-0df5-4cdc-afed-4c25e1e68fae]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] <== disconnect_volume: return (261ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:13:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:13:55 user nova-compute[72201]: DEBUG nova.objects.instance [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lazy-loading 'flavor' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:13:55 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-a8e057b3-07fa-470b-887b-9255da25d55c tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.565s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:13:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:13:56 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:14:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:14:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:14:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:14:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:14:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:14:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:14:03 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:14:03 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:14:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:14:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:14:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:14:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:14:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:14:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:14:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:14:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:14:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:14:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:14:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:14:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:14:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:14:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:14:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:14:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:14:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:14:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:14:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:14:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:14:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:14:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:14:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:14:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:14:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:14:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:14:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:14:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:14:45 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:14:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:14:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:14:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:14:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:14:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:14:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:14:46 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:14:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:14:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:14:47 user nova-compute[72201]: DEBUG nova.objects.instance [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lazy-loading 'flavor' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:14:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:14:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:14:47 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:14:47 user nova-compute[72201]: INFO nova.compute.manager [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Attaching volume 294c8d77-9f4e-4071-a129-a3323e101832 to /dev/vdb
Aug 01 16:14:47 user nova-compute[72201]: DEBUG os_brick.utils [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:14:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:47 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[97555494-ac88-494b-83bb-bbc24ed3383f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:47 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[38eed6ff-98cf-4492-97ce-c5664ea73da4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:47 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c143e1e7-9396-4833-81a7-6b90f451b249]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:47 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff0885d-f572-4264-bd5c-85b907c9c456]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:47 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:14:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:14:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:48 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:14:48 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:14:48 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[167b8986-261d-4e96-a616-a237d4181cfd]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:14:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:14:48 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:14:48 user nova-compute[72201]: DEBUG os_brick.utils [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:14:48 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updating existing volume attachment record: 56307433-cba8-4fdb-bd72-b235f2bc79b3 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:14:49 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:14:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:14:50 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:14:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:14:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 16:14:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:14:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:14:50 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:14:50 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:14:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:14:50 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updating instance_info_cache with network_info: [{"id": "8eb5163c-6608-4448-a166-b3f2f5e10281", "address": "fa:16:3e:8b:c8:ac", "network": {"id": "37d22152-77fa-49e4-8166-24f61566fd1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-309160669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df386c71461a4a88a9a435c04d9f0d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb5163c-66", "ovs_interfaceid": "8eb5163c-6608-4448-a166-b3f2f5e10281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:14:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:14:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:14:50 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:14:50 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:14:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:14:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:14:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:14:50 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:14:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:50 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:51 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:51 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:14:51 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:14:51 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8737MB free_disk=25.138019561767578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:14:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:14:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:14:51 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:14:51 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:14:51 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:14:51 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:14:51 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:14:51 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:14:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:14:52 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:14:54 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:14:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsFagBfm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:14:54 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:14:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:14:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:14:54 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:14:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:14:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:14:54 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:14:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56ca3a4-886c-485c-ab83-4659d34c43e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:14:54 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:14:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:54 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[13108762-9a38-4288-a488-d5acd97238ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:54 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832] added
Aug 01 16:14:54 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:14:54 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8732330e-e1b1-4830-b0b4-9b191e00497b]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fa2f12-91b9-4cf4-a8e4-64f301b67953]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VsFagBfm {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VsFagBfm" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca5ba50-936e-4ff8-92f1-a2c5c752c5c2]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VsFagBfm'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c17590-e3d7-43f5-867f-426b69ffbeff]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[80910b9c-ca2e-45d7-8a68-f384f6c74c17]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 16:14:55 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 16:14:55 user nova-compute[72201]:  {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:14:55 user nova-compute[72201]: WARNING os_brick.initiator.connectors.iscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 16:14:55 user nova-compute[72201]: 
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba520f4c-55b0-472c-a4f2-50fbdf6c179a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832, portal: 172.16.0.220,3260]
Aug 01 16:14:55 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832, portal: 172.16.0.220,3260] successful.
Aug 01 16:14:55 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f220502-1baf-4962-816d-8ee1d53939be]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8677b07-814f-417e-a17a-6d367b96c322]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 (non-flash)
Aug 01 16:14:55 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 (non-flash)
Aug 01 16:14:55 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad739157-cee3-42e5-aca9-ab2683c307d3]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsFagBfm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:14:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:14:56 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:14:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:14:56 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23131613131646136', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:14:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131613131646136', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:14:56 user nova-compute[72201]: DEBUG nova.objects.instance [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lazy-loading 'flavor' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:14:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 16:14:56 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:14:56 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 16:14:56 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:14:56 user nova-compute[72201]:   <serial>294c8d77-9f4e-4071-a129-a3323e101832</serial>
Aug 01 16:14:56 user nova-compute[72201]: </disk>
Aug 01 16:14:56 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 16:14:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:14:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:14:56 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] No VIF found with MAC fa:16:3e:8b:c8:ac, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:14:56 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-2eb398cd-9130-434f-ab33-a48502a5f57f tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.954s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:14:59 user nova-compute[72201]: INFO nova.compute.manager [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Detaching volume 294c8d77-9f4e-4071-a129-a3323e101832
Aug 01 16:14:59 user nova-compute[72201]: INFO nova.virt.block_device [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Attempting to driver detach volume 294c8d77-9f4e-4071-a129-a3323e101832 from mountpoint /dev/vdb
Aug 01 16:14:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Attempting to detach device vdb from instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:14:59 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:14:59 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 16:14:59 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:14:59 user nova-compute[72201]:   <serial>294c8d77-9f4e-4071-a129-a3323e101832</serial>
Aug 01 16:14:59 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:14:59 user nova-compute[72201]: </disk>
Aug 01 16:14:59 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:14:59 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Successfully detached device vdb from instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 from the persistent domain config.
Aug 01 16:14:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:14:59 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:14:59 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 16:14:59 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:14:59 user nova-compute[72201]:   <serial>294c8d77-9f4e-4071-a129-a3323e101832</serial>
Aug 01 16:14:59 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:14:59 user nova-compute[72201]: </disk>
Aug 01 16:14:59 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690906499.6763628, c3381d0b-652a-405e-a9d1-b9a9bb75c708 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 16:14:59 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Successfully detached device vdb from instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 from the live domain config.
Aug 01 16:14:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsFagBfm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:14:59 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:14:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e44136-2482-4274-8796-8139f5634e2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f97f96b-52cc-4094-825f-8cb8a3df5406]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 (non-flash)
Aug 01 16:14:59 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 (non-flash)
Aug 01 16:14:59 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c13ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832'): ({'sdb'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Removing single pathed devices sdb {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfe6ea0-db39-4478-9015-73167491b9f7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ffecf6-c2e0-4ec3-ba6c-5ff8275e73cb]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Flushing IO for device /dev/sdb {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6a2050-0db8-4629-a265-6866601fdedb]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f34720-1c8b-4751-b3a5-d3d50c02ad25]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[24438d82-c5a1-432e-93f8-b2b5415a3b67]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5400cc42-9ea0-4394-b267-8623b023bd44]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832, portal: 172.16.0.220,3260]
Aug 01 16:14:59 user nova-compute[72201]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832, portal: 172.16.0.220,3260] successful.
Aug 01 16:14:59 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:294c8d77-9f4e-4071-a129-a3323e101832 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f886c0fd-8fa6-42ec-883c-5842dc0eaee4]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] <== disconnect_volume: return (292ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:14:59 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:15:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:15:00 user nova-compute[72201]: DEBUG nova.objects.instance [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lazy-loading 'flavor' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:15:00 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b6322763-74d6-4465-a3b2-f60cf024cdab tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.632s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:15:04 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:15:04 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:15:05 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:15:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:15:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:15:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:15:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:15:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:15:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:15:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:15:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:15:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:15:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:15:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:15:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:15:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:15:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:15:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:15:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:15:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:15:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:15:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:15:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:15:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:15:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:15:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:15:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:15:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:15:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:15:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:15:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:15:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:15:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:15:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:15:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:15:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:15:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:15:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:15:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:15:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:15:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:15:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:15:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:15:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:15:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:15:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:15:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:15:46 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:15:47 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:15:50 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:15:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:15:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 16:15:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:15:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:15:50 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:15:50 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:15:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:15:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:15:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:15:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:15:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:15:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:15:50 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updating instance_info_cache with network_info: [{"id": "8eb5163c-6608-4448-a166-b3f2f5e10281", "address": "fa:16:3e:8b:c8:ac", "network": {"id": "37d22152-77fa-49e4-8166-24f61566fd1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-309160669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df386c71461a4a88a9a435c04d9f0d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb5163c-66", "ovs_interfaceid": "8eb5163c-6608-4448-a166-b3f2f5e10281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:15:50 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:15:50 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:15:50 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:15:51 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:15:52 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:15:52 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:15:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:15:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:15:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:15:52 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:15:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:15:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:15:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:15:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:15:52 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:15:52 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:15:52 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8742MB free_disk=25.137126922607422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:15:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:15:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG nova.objects.instance [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lazy-loading 'flavor' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:15:53 user nova-compute[72201]: INFO nova.compute.manager [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Attaching volume 86163643-1edb-41f0-b205-74097ff5353b to /dev/vdb
Aug 01 16:15:53 user nova-compute[72201]: DEBUG os_brick.utils [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[067ba41e-7a5e-434a-abb2-d1aec21f8841]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b446f2c3-fe6f-4df9-9a4c-cc6284b13b38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f05ecd-15b7-4949-a449-c407d47f1b27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe7e0aa-7449-4456-aafa-9c8bc3b87b9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:15:53 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:15:53 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e3ea57-5d61-4f7a-8735-bb186c9e0652]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG os_brick.utils [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:15:53 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updating existing volume attachment record: 2ac2dc6d-d387-42ee-bdb4-01cb41394327 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:15:54 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:15:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:15:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:15:56 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQzjAYEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:16:00 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:16:00 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:16:00 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[211cc968-5b8d-4b27-85b6-8d70d5d82971]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:16:00 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79ee9e4-c3fc-4bcd-b5c8-a8e13877b6be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b] added
Aug 01 16:16:00 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[440122b1-d899-449d-b92b-3f7edd031083]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[32aeeebf-2fda-4364-87a1-49186cd1a18a]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hQzjAYEO {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hQzjAYEO" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32c41d7-e77c-4756-ae6c-79661a440b87]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hQzjAYEO'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c86fa5-2583-4366-901c-b34047d7ff25]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[804dcb5c-3fe8-46ec-8f62-a36bb23cd5a6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 16:16:00 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 16:16:00 user nova-compute[72201]:  {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:16:00 user nova-compute[72201]: WARNING os_brick.initiator.connectors.iscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 16:16:00 user nova-compute[72201]: 
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[862862de-f166-4417-bf02-9961979d0a4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b, portal: 172.16.0.220,3260]
Aug 01 16:16:00 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b, portal: 172.16.0.220,3260] successful.
Aug 01 16:16:00 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b188e8f-1ffd-4ff4-a639-e7854e190606]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[86161ba3-301a-4668-bc87-17cf8431563c]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b (non-flash)
Aug 01 16:16:00 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b (non-flash)
Aug 01 16:16:00 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[476af2da-d159-4a75-a412-664f00266307]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:00 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:16:01 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:16:01 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQzjAYEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:16:01 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:16:01 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26265613631313931', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265613631313931', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:16:01 user nova-compute[72201]: DEBUG nova.objects.instance [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lazy-loading 'flavor' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:16:01 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 16:16:01 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:16:01 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 16:16:01 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:16:01 user nova-compute[72201]:   <serial>86163643-1edb-41f0-b205-74097ff5353b</serial>
Aug 01 16:16:01 user nova-compute[72201]: </disk>
Aug 01 16:16:01 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 16:16:02 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:16:02 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:16:02 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] No VIF found with MAC fa:16:3e:8b:c8:ac, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:16:02 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-30231db7-4ab4-4ade-b315-a9c5b8e737ef tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.860s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:16:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:16:04 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:16:04 user nova-compute[72201]: INFO nova.compute.manager [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Detaching volume 86163643-1edb-41f0-b205-74097ff5353b
Aug 01 16:16:04 user nova-compute[72201]: INFO nova.virt.block_device [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Attempting to driver detach volume 86163643-1edb-41f0-b205-74097ff5353b from mountpoint /dev/vdb
Aug 01 16:16:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Attempting to detach device vdb from instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 16:16:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:16:04 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:16:04 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 16:16:04 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:16:04 user nova-compute[72201]:   <serial>86163643-1edb-41f0-b205-74097ff5353b</serial>
Aug 01 16:16:04 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:16:04 user nova-compute[72201]: </disk>
Aug 01 16:16:04 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:16:04 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Successfully detached device vdb from instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 from the persistent domain config.
Aug 01 16:16:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 16:16:04 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:16:04 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:16:04 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 16:16:04 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:16:04 user nova-compute[72201]:   <serial>86163643-1edb-41f0-b205-74097ff5353b</serial>
Aug 01 16:16:04 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:16:04 user nova-compute[72201]: </disk>
Aug 01 16:16:04 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:16:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690906565.2121694, c3381d0b-652a-405e-a9d1-b9a9bb75c708 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 16:16:05 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Successfully detached device vdb from instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 from the live domain config.
Aug 01 16:16:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hQzjAYEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:16:05 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:16:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f5c8a1-0bf0-43e9-9968-237ab67d97f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f463b18c-5fb0-4352-9594-acaee0037846]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b (non-flash)
Aug 01 16:16:05 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b (non-flash)
Aug 01 16:16:05 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc54428ec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b'): ({'sdb'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Removing single pathed devices sdb {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[12774a22-90dd-4ee3-abc7-86c4680e2911]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b66bf4-b39e-4a7f-b9d9-d2edef4720dd]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Flushing IO for device /dev/sdb {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2e0550-9bb7-4ceb-b817-470634cb4d37]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de01df9-9042-4b65-af09-4163f5089449]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ab392c-0742-4c46-94a2-9db1dd8464cf]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba646da4-4191-423e-8862-404a294b1dfd]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b, portal: 172.16.0.220,3260]
Aug 01 16:16:05 user nova-compute[72201]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b, portal: 172.16.0.220,3260] successful.
Aug 01 16:16:05 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86163643-1edb-41f0-b205-74097ff5353b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[e604c63d-f11a-4112-b18b-4ada3c4aa595]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] <== disconnect_volume: return (263ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:16:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:16:06 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:16:06 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:16:06 user nova-compute[72201]: DEBUG nova.objects.instance [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lazy-loading 'flavor' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:16:06 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-b1abb537-d4c4-4c27-95c4-8989129f5ecf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.612s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:16:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:16:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:16:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:16:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:16:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:16:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:16:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:16:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:16:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:16:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:16:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:16:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:16:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:16:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:16:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:16:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:16:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:16:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:16:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:16:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:16:34 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:16:34 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72201) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 16:16:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:16:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:16:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:16:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:16:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:16:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:16:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:16:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:16:47 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:16:49 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:16:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:16:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:16:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:16:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:16:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:16:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:16:51 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:16:51 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:16:51 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 16:16:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:16:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:16:51 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:16:51 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:16:51 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updating instance_info_cache with network_info: [{"id": "8eb5163c-6608-4448-a166-b3f2f5e10281", "address": "fa:16:3e:8b:c8:ac", "network": {"id": "37d22152-77fa-49e4-8166-24f61566fd1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-309160669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df386c71461a4a88a9a435c04d9f0d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb5163c-66", "ovs_interfaceid": "8eb5163c-6608-4448-a166-b3f2f5e10281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:16:51 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:16:51 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:16:51 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:16:51 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:16:52 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:16:52 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:16:52 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:16:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:16:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:16:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:16:52 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:16:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:52 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:52 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:16:52 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:16:52 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8751MB free_disk=25.136165618896484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:16:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:16:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:16:53 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:16:53 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:16:53 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:16:53 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing inventories for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 16:16:53 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating ProviderTree inventory for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 16:16:53 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Updating inventory in ProviderTree for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 16:16:53 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing aggregate associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, aggregates: None {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 16:16:53 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Refreshing trait associations for resource provider 4ad5f056-b591-413c-b5b7-aab61bc138ae, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=72201) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 16:16:53 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:16:53 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:16:53 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:16:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:16:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:16:58 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:16:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:16:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:16:58 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lazy-loading 'flavor' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:16:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:16:59 user nova-compute[72201]: INFO nova.compute.manager [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Attaching volume 924a6ca9-94c5-49da-a63e-7acc0903d048 to /dev/vdb
Aug 01 16:16:59 user nova-compute[72201]: DEBUG os_brick.utils [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[863a4f2a-9eb1-4fe0-91bd-ffb63494432a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:858417b88912\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[8220e881-7242-43e4-abc5-dc0667713bdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f668dc2-d26f-4811-94b7-d3f3e71616ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad3c50a-4319-49f7-bded-6c8bb19188d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Running cmd (subprocess): nvme version {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] 'nvme version' failed. Not Retrying. {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] nvme not present on system {{(pid=72201) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 16:16:59 user nova-compute[72201]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 16:16:59 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f05368-0568-4b78-8bd3-f556d50709be]: (4, '') {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72201) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.lightos [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] LIGHTOS: no hostnqn found. {{(pid=72201) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG os_brick.utils [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:858417b88912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG nova.virt.block_device [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updating existing volume attachment record: 0f8688c0-daa2-4cb3-a658-519e635d4703 {{(pid=72201) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 16:16:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:17:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:17:02 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:17:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Calling os-brick to attach iSCSI Volume {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYwWqzLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:17:06 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:17:06 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:17:06 user nova-compute[72201]: INFO os_brick.initiator.connectors.iscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260 {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[b815886c-8ec6-4f8b-a1f5-6e7d7b6e57a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 16:17:06 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260 --interface default --op new {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd0ff03-76bd-46fa-a811-99ba05d03df8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048] added\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048] added
Aug 01 16:17:06 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f65a338-2fb1-43eb-9684-eb2c057efecb]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d48c2f3-34ef-4329-bdc9-33da06cfcf57]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYwWqzLI {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYwWqzLI" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[f367ee8c-0a47-45d4-b794-a9e113626e53]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mYwWqzLI'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d3f85d-cf20-4ec3-bdb8-23dca4b49e97]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7564ac-b9ad-4a46-9749-fc3f4353bbe3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 16:17:06 user nova-compute[72201]:  {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 16:17:06 user nova-compute[72201]:  {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:17:06 user nova-compute[72201]: WARNING os_brick.initiator.connectors.iscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 16:17:06 user nova-compute[72201]: 
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260 --login {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[35df64c4-4955-4a99-b555-6b47bf91a705]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048, portal: 172.16.0.220,3260]
Aug 01 16:17:06 user nova-compute[72201]: Login to [iface: default, target: iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048, portal: 172.16.0.220,3260] successful.
Aug 01 16:17:06 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69017d9-6af8-4e47-8505-b3a64726c189]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[111b3c00-5bef-4de4-b45c-cf9ac626db96]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 (non-flash)
Aug 01 16:17:06 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 (non-flash)
Aug 01 16:17:06 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Connected to 172.16.0.220:3260 {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72201) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72201) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[24383ae2-59d1-4490-96d0-0d44ed5d07d4]: (4, ('- - 0', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:17:06 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:17:07 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72201) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 16:17:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYwWqzLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72201) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 16:17:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:17:07 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26134336231643133', 'path': '/dev/sdb'} {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:17:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134336231643133', 'path': '/dev/sdb'} {{(pid=72201) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 16:17:07 user nova-compute[72201]: DEBUG nova.objects.instance [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lazy-loading 'flavor' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:17:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 16:17:07 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:17:07 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 16:17:07 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:17:07 user nova-compute[72201]:   <serial>924a6ca9-94c5-49da-a63e-7acc0903d048</serial>
Aug 01 16:17:07 user nova-compute[72201]: </disk>
Aug 01 16:17:07 user nova-compute[72201]:  {{(pid=72201) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 16:17:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] No BDM found with device name vda, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:17:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72201) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 16:17:07 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] No VIF found with MAC fa:16:3e:8b:c8:ac, not building metadata {{(pid=72201) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 16:17:08 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-ecd27cd7-1f28-4990-b9f9-0e5e6e9c1baf tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.043s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:17:09 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:17:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:17:10 user nova-compute[72201]: INFO nova.compute.manager [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Detaching volume 924a6ca9-94c5-49da-a63e-7acc0903d048
Aug 01 16:17:10 user nova-compute[72201]: INFO nova.virt.block_device [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Attempting to driver detach volume 924a6ca9-94c5-49da-a63e-7acc0903d048 from mountpoint /dev/vdb
Aug 01 16:17:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Attempting to detach device vdb from instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 from the persistent domain config. {{(pid=72201) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:17:10 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:17:10 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 16:17:10 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:17:10 user nova-compute[72201]:   <serial>924a6ca9-94c5-49da-a63e-7acc0903d048</serial>
Aug 01 16:17:10 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:17:10 user nova-compute[72201]: </disk>
Aug 01 16:17:10 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:17:10 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Successfully detached device vdb from instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 from the persistent domain config.
Aug 01 16:17:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 from the live domain config. {{(pid=72201) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.guest [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 16:17:10 user nova-compute[72201]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 16:17:10 user nova-compute[72201]:   <source dev="/dev/sdb"/>
Aug 01 16:17:10 user nova-compute[72201]:   <target dev="vdb" bus="virtio"/>
Aug 01 16:17:10 user nova-compute[72201]:   <serial>924a6ca9-94c5-49da-a63e-7acc0903d048</serial>
Aug 01 16:17:10 user nova-compute[72201]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 16:17:10 user nova-compute[72201]: </disk>
Aug 01 16:17:10 user nova-compute[72201]:  {{(pid=72201) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-75d6aab6-38a5-4e01-8462-8f6bbcc1ff9f None None] Received event <DeviceRemovedEvent: 1690906630.8800294, c3381d0b-652a-405e-a9d1-b9a9bb75c708 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72201) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.driver [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 16:17:10 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Successfully detached device vdb from instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 from the live domain config.
Aug 01 16:17:10 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] calling os-brick to detach iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc54420b2b0>, {'target_iqns': ['iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYwWqzLI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 16:17:10 user nova-compute[72201]: WARNING os_brick.initiator.connectors.base [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 16:17:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048', 0)] {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ec819d-3821-448b-b4a8-ceb8c6e4bc61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[4383bace-490b-47f4-9227-00de85df368c]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 (non-flash)\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 (non-flash)
Aug 01 16:17:10 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 (non-flash)
Aug 01 16:17:10 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc53c345ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048'): ({'sdb'}, set())}) {{(pid=72201) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Removing single pathed devices sdb {{(pid=72201) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[483555d8-b515-4d3d-a27d-679ac5116cb1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef90244d-0731-4a71-bdc2-cc3db4870735]: (4, ('ok\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Flushing IO for device /dev/sdb {{(pid=72201) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 16:17:10 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a03dabd-2ebb-4c3f-872e-665da6d492e2]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72201) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[037556ee-9a00-4d02-9c49-8e1f4d06d16f]: (4, ('1', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG os_brick.initiator.linuxscsi [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] SCSI volumes sdb have been removed. {{(pid=72201) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048')] {{(pid=72201) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc9f7f1-d567-4251-ae24-619494df71aa]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260 --logout {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ff0d49-ab3a-460b-ac50-62be6f1525cf]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048, portal: 172.16.0.220,3260]
Aug 01 16:17:11 user nova-compute[72201]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048, portal: 172.16.0.220,3260] successful.
Aug 01 16:17:11 user nova-compute[72201]:  stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260 --op delete {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a6ca9-94c5-49da-a63e-7acc0903d048 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83290) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac45db9-7fb7-4180-9e66-c7d2fd82c148]: (4, ('', '')) {{(pid=83290) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72201) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.base [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG os_brick.initiator.connectors.iscsi [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] <== disconnect_volume: return (294ms) None {{(pid=72201) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG nova.virt.libvirt.volume.iscsi [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Disconnected iSCSI Volume {{(pid=72201) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG nova.objects.instance [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lazy-loading 'flavor' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:17:11 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-807caefd-364d-4f4a-bfc6-9ca6253f7dd5 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.578s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:17:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:17:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:17:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:17:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:17:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:17:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:17:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:17:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:17:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:17:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:17:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:17:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:17:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:17:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:17:27 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:17:27 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Cleaning up deleted instances {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 16:17:27 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] There are 0 instances to clean {{(pid=72201) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 16:17:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:17:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:17:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:17:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:17:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:17:30 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:17:35 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:17:40 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:17:45 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:17:47 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:17:50 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:17:51 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:17:52 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:17:52 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:17:52 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 16:17:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 16:17:52 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquired lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 16:17:52 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Forcefully refreshing network info cache for instance {{(pid=72201) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 16:17:52 user nova-compute[72201]: DEBUG nova.objects.instance [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lazy-loading 'info_cache' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:17:53 user nova-compute[72201]: DEBUG nova.network.neutron [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updating instance_info_cache with network_info: [{"id": "8eb5163c-6608-4448-a166-b3f2f5e10281", "address": "fa:16:3e:8b:c8:ac", "network": {"id": "37d22152-77fa-49e4-8166-24f61566fd1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-309160669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df386c71461a4a88a9a435c04d9f0d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb5163c-66", "ovs_interfaceid": "8eb5163c-6608-4448-a166-b3f2f5e10281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:17:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Releasing lock "refresh_cache-c3381d0b-652a-405e-a9d1-b9a9bb75c708" {{(pid=72201) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 16:17:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updated the network info_cache for instance {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 16:17:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:17:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:17:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:17:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:17:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:17:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:17:53 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:17:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 16:17:53 user nova-compute[72201]: DEBUG oslo_concurrency.processutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72201) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 16:17:53 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:17:53 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:17:53 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8727MB free_disk=25.135135650634766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:17:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:17:53 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:17:54 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Instance c3381d0b-652a-405e-a9d1-b9a9bb75c708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72201) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 16:17:54 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:17:54 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:17:54 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:17:54 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:17:54 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:17:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:17:55 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:17:55 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:17:58 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:17:58 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:17:58 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Triggering sync for uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 16:17:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:17:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:17:58 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:18:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:18:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:18:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:18:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:18:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:18:00 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:18:05 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:18:08 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:18:08 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:18:10 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:18:15 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:18:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:18:25 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:18:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:18:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:18:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:18:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:18:28 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:18:29 user nova-compute[72201]: INFO nova.compute.manager [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Terminating instance
Aug 01 16:18:29 user nova-compute[72201]: DEBUG nova.compute.manager [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Start destroying the instance on the hypervisor. {{(pid=72201) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-193524a4-a103-4568-bc95-407d0fde273c req-870f87fb-7957-445b-96ac-90440c7ff47b service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Received event network-vif-unplugged-8eb5163c-6608-4448-a166-b3f2f5e10281 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-193524a4-a103-4568-bc95-407d0fde273c req-870f87fb-7957-445b-96ac-90440c7ff47b service nova] Acquiring lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-193524a4-a103-4568-bc95-407d0fde273c req-870f87fb-7957-445b-96ac-90440c7ff47b service nova] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-193524a4-a103-4568-bc95-407d0fde273c req-870f87fb-7957-445b-96ac-90440c7ff47b service nova] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-193524a4-a103-4568-bc95-407d0fde273c req-870f87fb-7957-445b-96ac-90440c7ff47b service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] No waiting events found dispatching network-vif-unplugged-8eb5163c-6608-4448-a166-b3f2f5e10281 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG nova.compute.manager [req-193524a4-a103-4568-bc95-407d0fde273c req-870f87fb-7957-445b-96ac-90440c7ff47b service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Received event network-vif-unplugged-8eb5163c-6608-4448-a166-b3f2f5e10281 for instance with task_state deleting. {{(pid=72201) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:18:29 user nova-compute[72201]: INFO nova.virt.libvirt.driver [-] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Instance destroyed successfully.
Aug 01 16:18:29 user nova-compute[72201]: DEBUG nova.objects.instance [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lazy-loading 'resources' on Instance uuid c3381d0b-652a-405e-a9d1-b9a9bb75c708 {{(pid=72201) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG nova.virt.libvirt.vif [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T16:11:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-76389977',display_name='tempest-SnapshotDataIntegrityTests-server-76389977',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-76389977',id=52,image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+LGbv+f/IBNtLrRGide39VpuOPdub0OFfpmodIE4Q+ajq/sx5SeOpbK63LqDDxzTDYmgfH4xQCYh2mdhZOmpCYiu4SF35mcIQGvBJpJ+rt7ZT6gjwBs7MheC0qPNVc9Q==',key_name='tempest-keypair-1822066526',keypairs=<?>,launch_index=0,launched_at=2023-08-01T16:11:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df386c71461a4a88a9a435c04d9f0d2d',ramdisk_id='',reservation_id='r-42fse8wo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73af296a-4f5f-49df-a90d-46b9fdcd9a3f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1806369645',owner_user_name='tempest-SnapshotDataIntegrityTests-1806369645-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T16:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5be08fc164fe49f4bb6b54a60c6c7c19',uuid=c3381d0b-652a-405e-a9d1-b9a9bb75c708,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8eb5163c-6608-4448-a166-b3f2f5e10281", "address": "fa:16:3e:8b:c8:ac", "network": {"id": "37d22152-77fa-49e4-8166-24f61566fd1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-309160669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df386c71461a4a88a9a435c04d9f0d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb5163c-66", "ovs_interfaceid": "8eb5163c-6608-4448-a166-b3f2f5e10281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Converting VIF {"id": "8eb5163c-6608-4448-a166-b3f2f5e10281", "address": "fa:16:3e:8b:c8:ac", "network": {"id": "37d22152-77fa-49e4-8166-24f61566fd1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-309160669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df386c71461a4a88a9a435c04d9f0d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb5163c-66", "ovs_interfaceid": "8eb5163c-6608-4448-a166-b3f2f5e10281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG nova.network.os_vif_util [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:c8:ac,bridge_name='br-int',has_traffic_filtering=True,id=8eb5163c-6608-4448-a166-b3f2f5e10281,network=Network(37d22152-77fa-49e4-8166-24f61566fd1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb5163c-66') {{(pid=72201) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG os_vif [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:c8:ac,bridge_name='br-int',has_traffic_filtering=True,id=8eb5163c-6608-4448-a166-b3f2f5e10281,network=Network(37d22152-77fa-49e4-8166-24f61566fd1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb5163c-66') {{(pid=72201) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8eb5163c-66, bridge=br-int, if_exists=True) {{(pid=72201) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:18:29 user nova-compute[72201]: INFO os_vif [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:c8:ac,bridge_name='br-int',has_traffic_filtering=True,id=8eb5163c-6608-4448-a166-b3f2f5e10281,network=Network(37d22152-77fa-49e4-8166-24f61566fd1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb5163c-66')
Aug 01 16:18:29 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Deleting instance files /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708_del
Aug 01 16:18:29 user nova-compute[72201]: INFO nova.virt.libvirt.driver [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Deletion of /opt/stack/data/nova/instances/c3381d0b-652a-405e-a9d1-b9a9bb75c708_del complete
Aug 01 16:18:29 user nova-compute[72201]: INFO nova.compute.manager [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 16:18:29 user nova-compute[72201]: DEBUG oslo.service.loopingcall [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72201) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG nova.compute.manager [-] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Deallocating network for instance {{(pid=72201) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 16:18:29 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] deallocate_for_instance() {{(pid=72201) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 16:18:30 user nova-compute[72201]: DEBUG nova.network.neutron [-] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Updating instance_info_cache with network_info: [] {{(pid=72201) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 16:18:30 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Took 1.04 seconds to deallocate network for instance.
Aug 01 16:18:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:18:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:18:31 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:18:31 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:18:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:18:31 user nova-compute[72201]: INFO nova.scheduler.client.report [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Deleted allocations for instance c3381d0b-652a-405e-a9d1-b9a9bb75c708
Aug 01 16:18:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-fff4873b-f45a-4d1c-827a-056031ec3f51 tempest-SnapshotDataIntegrityTests-1806369645 tempest-SnapshotDataIntegrityTests-1806369645-project-member] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.443s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:18:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-29a24f93-8f26-402a-99b4-c4d7c2763b97 req-238c3a14-35d2-435b-bbd4-0f8408564299 service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Received event network-vif-plugged-8eb5163c-6608-4448-a166-b3f2f5e10281 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:18:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-29a24f93-8f26-402a-99b4-c4d7c2763b97 req-238c3a14-35d2-435b-bbd4-0f8408564299 service nova] Acquiring lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:18:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-29a24f93-8f26-402a-99b4-c4d7c2763b97 req-238c3a14-35d2-435b-bbd4-0f8408564299 service nova] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:18:31 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [req-29a24f93-8f26-402a-99b4-c4d7c2763b97 req-238c3a14-35d2-435b-bbd4-0f8408564299 service nova] Lock "c3381d0b-652a-405e-a9d1-b9a9bb75c708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:18:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-29a24f93-8f26-402a-99b4-c4d7c2763b97 req-238c3a14-35d2-435b-bbd4-0f8408564299 service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] No waiting events found dispatching network-vif-plugged-8eb5163c-6608-4448-a166-b3f2f5e10281 {{(pid=72201) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 16:18:31 user nova-compute[72201]: WARNING nova.compute.manager [req-29a24f93-8f26-402a-99b4-c4d7c2763b97 req-238c3a14-35d2-435b-bbd4-0f8408564299 service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Received unexpected event network-vif-plugged-8eb5163c-6608-4448-a166-b3f2f5e10281 for instance with vm_state deleted and task_state None.
Aug 01 16:18:31 user nova-compute[72201]: DEBUG nova.compute.manager [req-29a24f93-8f26-402a-99b4-c4d7c2763b97 req-238c3a14-35d2-435b-bbd4-0f8408564299 service nova] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Received event network-vif-deleted-8eb5163c-6608-4448-a166-b3f2f5e10281 {{(pid=72201) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 16:18:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:18:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:18:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:18:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:18:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:18:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:18:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:18:44 user nova-compute[72201]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690906709.780661, c3381d0b-652a-405e-a9d1-b9a9bb75c708 => Stopped> {{(pid=72201) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 16:18:44 user nova-compute[72201]: INFO nova.compute.manager [-] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] VM Stopped (Lifecycle Event)
Aug 01 16:18:44 user nova-compute[72201]: DEBUG nova.compute.manager [None req-4697d3ed-f9e1-40fd-84db-5202421deaf9 None None] [instance: c3381d0b-652a-405e-a9d1-b9a9bb75c708] Checking state {{(pid=72201) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 16:18:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:18:49 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:18:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:18:52 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:18:52 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:18:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:18:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Starting heal instance info cache {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 16:18:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Rebuilding the list of instances to heal {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 16:18:53 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Didn't find any instances for network info cache update. {{(pid=72201) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 16:18:53 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:18:54 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:18:54 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:18:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:18:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:18:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:18:54 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72201) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 16:18:54 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:18:54 user nova-compute[72201]: WARNING nova.virt.libvirt.driver [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 16:18:54 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Hypervisor/Node resource view: name=user free_ram=8883MB free_disk=25.162242889404297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72201) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 16:18:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 16:18:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 16:18:54 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 16:18:54 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72201) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 16:18:54 user nova-compute[72201]: DEBUG nova.compute.provider_tree [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed in ProviderTree for provider: 4ad5f056-b591-413c-b5b7-aab61bc138ae {{(pid=72201) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 16:18:54 user nova-compute[72201]: DEBUG nova.scheduler.client.report [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Inventory has not changed for provider 4ad5f056-b591-413c-b5b7-aab61bc138ae based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72201) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 16:18:54 user nova-compute[72201]: DEBUG nova.compute.resource_tracker [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Compute_service record updated for user:user {{(pid=72201) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 16:18:54 user nova-compute[72201]: DEBUG oslo_concurrency.lockutils [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=72201) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 16:18:54 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:18:59 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:18:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:18:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:18:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:18:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:18:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:18:59 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:19:04 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:19:09 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:19:09 user nova-compute[72201]: DEBUG nova.compute.manager [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72201) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 16:19:09 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:19:10 user nova-compute[72201]: DEBUG oslo_service.periodic_task [None req-f393d1f8-37c3-4d67-83a1-d41b9bb435f4 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72201) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 16:19:14 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:19:19 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:19:20 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:19:23 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:19:24 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:19:27 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:19:29 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:19:34 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:19:39 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:19:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 16:19:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:19:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72201) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 16:19:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:19:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72201) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 16:19:44 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 16:19:49 user nova-compute[72201]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72201) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}